2026-02-25T14:19:56.640 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T14:19:56.654 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:19:56.734 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221 branch: wip-yuri3-testing-2026-02-19-1610-tentacle description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false flavor: default job_id: '70221' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri3-testing-2026-02-19-1610-tentacle ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 rados replica read policy: balance global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: btree bluestore block size: 96636764160 bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2 random: true bluestore zero block detection: true crush location: root=default host=host-$id debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result - OSD_DOWN mon_bind_msgr2: false sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2026-02-19-1610-tentacle sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 6877 sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri3-testing-2026-02-19-1610-tentacle suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 targets: trial078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFpIk+MeVFhr81f4yfQAZxXNO8+2NCvlAcMSPbOOunhYPlovu1GwYKFEJMt4O9gE+OPcXPsud/AR4W64+eNmGOg= trial155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8fOW3FaYxbHPkl9kSJBeKtFz9n9tZj1yMLYWl0f9+dzaTh5tQYoF6n/FAoit3LiPrJunQskIdK9TgA3CRUhUg= trial167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMNa3zPTQyrEvWDzOdTRAszeBg6Db3+QhOuu0aogJVV2OPqCe64OxndJLzi9wR+tZ8M8Zmq4vTMClDYFxqLWlVg= trial174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqYxFH2ThPebUfrkKQcIxdGtWUtyX51PKFnGpaWub2T126Rf49jfqKDGzDNnFxisUO6oyrnjy0iot9fjcpNymM= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-25_14:09:18 tube: trial user: jayaprakash verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-25T14:19:56.734 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa; will attempt to use it 2026-02-25T14:19:56.735 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa/tasks 2026-02-25T14:19:56.735 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-25T14:19:56.736 INFO:teuthology.task.internal:Checking packages... 2026-02-25T14:19:56.737 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '36d388f27052dd940bdbaf543bb05bdba0acc155' 2026-02-25T14:19:56.737 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-25T14:19:56.737 INFO:teuthology.packaging:ref: None 2026-02-25T14:19:56.737 INFO:teuthology.packaging:tag: None 2026-02-25T14:19:56.737 INFO:teuthology.packaging:branch: wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-25T14:19:56.737 INFO:teuthology.packaging:sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T14:19:56.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-25T14:19:56.856 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-681.g36d388f2 2026-02-25T14:19:56.858 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-25T14:19:56.871 INFO:teuthology.task.internal:no buildpackages task found 2026-02-25T14:19:56.871 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-25T14:19:56.884 INFO:teuthology.task.internal:Saving configuration 2026-02-25T14:19:56.898 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-25T14:19:56.911 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-25T14:19:56.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial078.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 14:16:00.175270', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFpIk+MeVFhr81f4yfQAZxXNO8+2NCvlAcMSPbOOunhYPlovu1GwYKFEJMt4O9gE+OPcXPsud/AR4W64+eNmGOg='} 2026-02-25T14:19:57.049 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial155.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 14:16:00.174582', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8fOW3FaYxbHPkl9kSJBeKtFz9n9tZj1yMLYWl0f9+dzaTh5tQYoF6n/FAoit3LiPrJunQskIdK9TgA3CRUhUg='} 2026-02-25T14:19:57.105 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial167.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 14:16:00.175688', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMNa3zPTQyrEvWDzOdTRAszeBg6Db3+QhOuu0aogJVV2OPqCe64OxndJLzi9wR+tZ8M8Zmq4vTMClDYFxqLWlVg='} 2026-02-25T14:19:57.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial174.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 14:16:00.176076', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqYxFH2ThPebUfrkKQcIxdGtWUtyX51PKFnGpaWub2T126Rf49jfqKDGzDNnFxisUO6oyrnjy0iot9fjcpNymM='} 2026-02-25T14:19:57.160 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-25T14:19:57.170 INFO:teuthology.task.internal:roles: ubuntu@trial078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-25T14:19:57.170 INFO:teuthology.task.internal:roles: ubuntu@trial155.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-25T14:19:57.171 INFO:teuthology.task.internal:roles: ubuntu@trial167.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-25T14:19:57.171 INFO:teuthology.task.internal:roles: ubuntu@trial174.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-25T14:19:57.171 INFO:teuthology.run_tasks:Running task console_log... 2026-02-25T14:19:57.426 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7e2b52e33100>, signals=[15]) 2026-02-25T14:19:57.426 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-25T14:19:57.437 INFO:teuthology.task.internal:Opening connections... 2026-02-25T14:19:57.437 DEBUG:teuthology.task.internal:connecting to ubuntu@trial078.front.sepia.ceph.com 2026-02-25T14:19:57.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:19:57.503 DEBUG:teuthology.task.internal:connecting to ubuntu@trial155.front.sepia.ceph.com 2026-02-25T14:19:57.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:19:57.566 DEBUG:teuthology.task.internal:connecting to ubuntu@trial167.front.sepia.ceph.com 2026-02-25T14:19:57.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:19:57.631 DEBUG:teuthology.task.internal:connecting to ubuntu@trial174.front.sepia.ceph.com 2026-02-25T14:19:57.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:19:57.691 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-25T14:19:57.703 DEBUG:teuthology.orchestra.run.trial078:> uname -m 2026-02-25T14:19:57.720 INFO:teuthology.orchestra.run.trial078.stdout:x86_64 2026-02-25T14:19:57.720 DEBUG:teuthology.orchestra.run.trial078:> cat /etc/os-release 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:NAME="CentOS Stream" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:VERSION="9" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:ID="centos" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:ID_LIKE="rhel fedora" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:VERSION_ID="9" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:PLATFORM_ID="platform:el9" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:ANSI_COLOR="0;31" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:LOGO="fedora-logo-icon" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:HOME_URL="https://centos.org/" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T14:19:57.775 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T14:19:57.776 INFO:teuthology.lock.ops:Updating trial078.front.sepia.ceph.com on lock server 2026-02-25T14:19:57.847 DEBUG:teuthology.orchestra.run.trial155:> uname -m 2026-02-25T14:19:57.862 INFO:teuthology.orchestra.run.trial155.stdout:x86_64 2026-02-25T14:19:57.863 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release 2026-02-25T14:19:57.918 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream" 2026-02-25T14:19:57.918 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9" 2026-02-25T14:19:57.918 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos" 2026-02-25T14:19:57.918 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora" 2026-02-25T14:19:57.918 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9" 2026-02-25T14:19:57.918 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9" 2026-02-25T14:19:57.919 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T14:19:57.919 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31" 2026-02-25T14:19:57.919 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon" 2026-02-25T14:19:57.919 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T14:19:57.919 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/" 2026-02-25T14:19:57.919 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T14:19:57.919 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T14:19:57.919 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T14:19:57.919 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server 2026-02-25T14:19:57.998 DEBUG:teuthology.orchestra.run.trial167:> uname -m 2026-02-25T14:19:58.015 INFO:teuthology.orchestra.run.trial167.stdout:x86_64 2026-02-25T14:19:58.015 DEBUG:teuthology.orchestra.run.trial167:> cat /etc/os-release 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:NAME="CentOS Stream" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:VERSION="9" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:ID="centos" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:ID_LIKE="rhel fedora" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:VERSION_ID="9" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:PLATFORM_ID="platform:el9" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:ANSI_COLOR="0;31" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:LOGO="fedora-logo-icon" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:HOME_URL="https://centos.org/" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T14:19:58.071 INFO:teuthology.orchestra.run.trial167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T14:19:58.072 INFO:teuthology.lock.ops:Updating trial167.front.sepia.ceph.com on lock server 2026-02-25T14:19:58.152 DEBUG:teuthology.orchestra.run.trial174:> uname -m 2026-02-25T14:19:58.168 INFO:teuthology.orchestra.run.trial174.stdout:x86_64 2026-02-25T14:19:58.168 DEBUG:teuthology.orchestra.run.trial174:> cat /etc/os-release 2026-02-25T14:19:58.223 INFO:teuthology.orchestra.run.trial174.stdout:NAME="CentOS Stream" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:VERSION="9" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:ID="centos" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:ID_LIKE="rhel fedora" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:VERSION_ID="9" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:PLATFORM_ID="platform:el9" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:ANSI_COLOR="0;31" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:LOGO="fedora-logo-icon" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:HOME_URL="https://centos.org/" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T14:19:58.224 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T14:19:58.224 INFO:teuthology.lock.ops:Updating trial174.front.sepia.ceph.com on lock server 2026-02-25T14:19:58.304 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-25T14:19:58.317 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-25T14:19:58.329 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-25T14:19:58.329 DEBUG:teuthology.orchestra.run.trial078:> test '!' -e /home/ubuntu/cephtest 2026-02-25T14:19:58.331 DEBUG:teuthology.orchestra.run.trial155:> test '!' -e /home/ubuntu/cephtest 2026-02-25T14:19:58.333 DEBUG:teuthology.orchestra.run.trial167:> test '!' -e /home/ubuntu/cephtest 2026-02-25T14:19:58.335 DEBUG:teuthology.orchestra.run.trial174:> test '!' -e /home/ubuntu/cephtest 2026-02-25T14:19:58.350 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-25T14:19:58.361 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-25T14:19:58.361 DEBUG:teuthology.orchestra.run.trial078:> test -z $(ls -A /var/lib/ceph) 2026-02-25T14:19:58.387 DEBUG:teuthology.orchestra.run.trial155:> test -z $(ls -A /var/lib/ceph) 2026-02-25T14:19:58.389 DEBUG:teuthology.orchestra.run.trial167:> test -z $(ls -A /var/lib/ceph) 2026-02-25T14:19:58.391 DEBUG:teuthology.orchestra.run.trial174:> test -z $(ls -A /var/lib/ceph) 2026-02-25T14:19:58.407 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-25T14:19:58.673 INFO:teuthology.run_tasks:Running task kernel... 2026-02-25T14:19:58.692 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-25T14:19:58.692 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-25T14:19:58.692 DEBUG:teuthology.orchestra.run.trial078:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T14:19:58.693 DEBUG:teuthology.orchestra.run.trial155:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T14:19:58.693 DEBUG:teuthology.orchestra.run.trial167:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T14:19:58.693 DEBUG:teuthology.orchestra.run.trial174:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T14:19:58.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:19:58.707 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-25T14:19:58.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:19:58.708 DEBUG:teuthology.orchestra.run.trial174:> uname -r 2026-02-25T14:19:58.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:19:58.709 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-25T14:19:58.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:19:58.709 DEBUG:teuthology.orchestra.run.trial167:> uname -r 2026-02-25T14:19:58.763 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-681.el9.x86_64 2026-02-25T14:19:58.763 INFO:teuthology.task.kernel:Running kernel on trial155: 5.14.0-681.el9.x86_64 2026-02-25T14:19:58.763 DEBUG:teuthology.orchestra.run.trial155:> sudo yum install -y kernel 2026-02-25T14:19:58.764 INFO:teuthology.orchestra.run.trial167.stdout:5.14.0-681.el9.x86_64 2026-02-25T14:19:58.764 INFO:teuthology.task.kernel:Running kernel on trial167: 5.14.0-681.el9.x86_64 2026-02-25T14:19:58.764 DEBUG:teuthology.orchestra.run.trial167:> sudo yum install -y kernel 2026-02-25T14:19:58.765 INFO:teuthology.orchestra.run.trial078.stdout:5.14.0-681.el9.x86_64 2026-02-25T14:19:58.765 INFO:teuthology.task.kernel:Running kernel on trial078: 5.14.0-681.el9.x86_64 2026-02-25T14:19:58.765 DEBUG:teuthology.orchestra.run.trial078:> sudo yum install -y kernel 2026-02-25T14:19:58.769 INFO:teuthology.orchestra.run.trial174.stdout:5.14.0-681.el9.x86_64 2026-02-25T14:19:58.769 INFO:teuthology.task.kernel:Running kernel on trial174: 5.14.0-681.el9.x86_64 2026-02-25T14:19:58.769 DEBUG:teuthology.orchestra.run.trial174:> sudo yum install -y kernel 2026-02-25T14:20:00.652 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.9 MB 00:01 2026-02-25T14:20:01.015 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.9 MB 00:01 2026-02-25T14:20:01.474 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.9 MB 00:02 2026-02-25T14:20:07.693 INFO:teuthology.orchestra.run.trial167.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-25T14:20:08.618 INFO:teuthology.orchestra.run.trial167.stdout:CentOS Stream 9 - AppStream 69 MB/s | 27 MB 00:00 2026-02-25T14:20:12.105 INFO:teuthology.orchestra.run.trial167.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 8.0 MB 00:01 2026-02-25T14:20:13.031 INFO:teuthology.orchestra.run.trial167.stdout:CentOS Stream 9 - Extras packages 108 kB/s | 20 kB 00:00 2026-02-25T14:20:13.849 INFO:teuthology.orchestra.run.trial167.stdout:Extra Packages for Enterprise Linux 27 MB/s | 20 MB 00:00 2026-02-25T14:20:17.017 INFO:teuthology.orchestra.run.trial167.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-25T14:20:18.024 INFO:teuthology.orchestra.run.trial167.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T14:20:18.024 INFO:teuthology.orchestra.run.trial167.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T14:20:18.045 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:20:18.046 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:20:18.046 INFO:teuthology.orchestra.run.trial167.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:18.047 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:20:18.047 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:20:18.047 INFO:teuthology.orchestra.run.trial167.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T14:20:18.047 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:20:18.047 INFO:teuthology.orchestra.run.trial167.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T14:20:18.047 INFO:teuthology.orchestra.run.trial167.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T14:20:18.047 INFO:teuthology.orchestra.run.trial167.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T14:20:18.048 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:20:18.048 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:20:18.048 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:20:18.048 INFO:teuthology.orchestra.run.trial167.stdout:Install 4 Packages 2026-02-25T14:20:18.048 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:20:18.048 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 89 M 2026-02-25T14:20:18.048 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 135 M 2026-02-25T14:20:18.048 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:20:18.549 INFO:teuthology.orchestra.run.trial167.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 4.4 MB/s | 901 kB 00:00 2026-02-25T14:20:18.713 INFO:teuthology.orchestra.run.trial167.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 47 MB/s | 17 MB 00:00 2026-02-25T14:20:18.892 INFO:teuthology.orchestra.run.trial167.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 90 MB/s | 31 MB 00:00 2026-02-25T14:20:18.946 INFO:teuthology.orchestra.run.trial167.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2026-02-25T14:20:18.946 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:18.946 INFO:teuthology.orchestra.run.trial167.stdout:Total 99 MB/s | 89 MB 00:00 2026-02-25T14:20:19.137 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:20:19.345 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:20:19.345 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:20:19.731 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:20:19.731 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:20:20.845 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:20:21.137 INFO:teuthology.orchestra.run.trial167.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:20:21.159 INFO:teuthology.orchestra.run.trial167.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:22.843 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 27 MB 00:20 2026-02-25T14:20:23.713 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:23.746 INFO:teuthology.orchestra.run.trial167.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:25.148 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 27 MB 00:23 2026-02-25T14:20:26.411 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 8.0 MB 00:01 2026-02-25T14:20:26.781 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:26.787 INFO:teuthology.orchestra.run.trial167.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:28.048 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-25T14:20:29.070 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 20 kB 00:01 2026-02-25T14:20:29.226 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 8.0 MB 00:01 2026-02-25T14:20:29.407 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 74 MB/s | 20 MB 00:00 2026-02-25T14:20:29.902 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:30.150 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - Extras packages 108 kB/s | 20 kB 00:00 2026-02-25T14:20:30.469 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 80 MB/s | 20 MB 00:00 2026-02-25T14:20:31.590 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 8.0 MB 00:01 2026-02-25T14:20:32.602 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.1 MB/s | 50 kB 00:00 2026-02-25T14:20:33.451 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-25T14:20:33.658 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T14:20:33.658 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T14:20:33.671 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-25T14:20:33.678 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout:Install 4 Packages 2026-02-25T14:20:33.679 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:20:33.680 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 89 M 2026-02-25T14:20:33.680 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 135 M 2026-02-25T14:20:33.680 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:20:33.948 INFO:teuthology.orchestra.run.trial155.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 4.2 MB/s | 901 kB 00:00 2026-02-25T14:20:34.147 INFO:teuthology.orchestra.run.trial174.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2026-02-25T14:20:34.266 INFO:teuthology.orchestra.run.trial155.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 32 MB/s | 17 MB 00:00 2026-02-25T14:20:34.547 INFO:teuthology.orchestra.run.trial155.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 52 MB/s | 31 MB 00:00 2026-02-25T14:20:34.678 INFO:teuthology.orchestra.run.trial078.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T14:20:34.678 INFO:teuthology.orchestra.run.trial078.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T14:20:34.689 INFO:teuthology.orchestra.run.trial155.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 42 MB/s | 40 MB 00:00 2026-02-25T14:20:34.689 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:34.689 INFO:teuthology.orchestra.run.trial155.stdout:Total 88 MB/s | 89 MB 00:01 2026-02-25T14:20:34.698 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:Install 4 Packages 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 89 M 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 135 M 2026-02-25T14:20:34.699 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:20:34.880 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:20:35.022 INFO:teuthology.orchestra.run.trial078.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 12 MB/s | 901 kB 00:00 2026-02-25T14:20:35.082 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:20:35.082 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:20:35.231 INFO:teuthology.orchestra.run.trial078.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 61 MB/s | 17 MB 00:00 2026-02-25T14:20:35.406 INFO:teuthology.orchestra.run.trial078.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 81 MB/s | 31 MB 00:00 2026-02-25T14:20:35.471 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:20:35.471 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:20:35.495 INFO:teuthology.orchestra.run.trial078.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 73 MB/s | 40 MB 00:00 2026-02-25T14:20:35.495 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:35.496 INFO:teuthology.orchestra.run.trial078.stdout:Total 112 MB/s | 89 MB 00:00 2026-02-25T14:20:35.690 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:20:35.891 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:20:35.891 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:20:36.278 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:20:36.279 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:20:36.581 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:20:36.871 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:20:36.893 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:37.390 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:20:37.439 INFO:teuthology.orchestra.run.trial174.stdout:lab-extras 1.1 MB/s | 50 kB 00:00 2026-02-25T14:20:37.680 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:20:37.702 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:38.451 INFO:teuthology.orchestra.run.trial174.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T14:20:38.452 INFO:teuthology.orchestra.run.trial174.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T14:20:38.472 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:20:38.473 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:20:38.473 INFO:teuthology.orchestra.run.trial174.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:38.473 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:20:38.473 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:20:38.473 INFO:teuthology.orchestra.run.trial174.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T14:20:38.473 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:20:38.473 INFO:teuthology.orchestra.run.trial174.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T14:20:38.473 INFO:teuthology.orchestra.run.trial174.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout:Install 4 Packages 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 89 M 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 135 M 2026-02-25T14:20:38.474 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:20:38.658 INFO:teuthology.orchestra.run.trial174.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 10 MB/s | 901 kB 00:00 2026-02-25T14:20:38.731 INFO:teuthology.orchestra.run.trial174.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 108 MB/s | 17 MB 00:00 2026-02-25T14:20:38.853 INFO:teuthology.orchestra.run.trial174.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 160 MB/s | 31 MB 00:00 2026-02-25T14:20:38.956 INFO:teuthology.orchestra.run.trial174.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 104 MB/s | 40 MB 00:00 2026-02-25T14:20:38.958 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:38.958 INFO:teuthology.orchestra.run.trial174.stdout:Total 183 MB/s | 89 MB 00:00 2026-02-25T14:20:39.152 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:20:39.356 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:20:39.356 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:20:39.443 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:39.477 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:39.742 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:20:39.742 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:20:40.261 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:40.294 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:40.882 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:20:41.189 INFO:teuthology.orchestra.run.trial174.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:20:41.212 INFO:teuthology.orchestra.run.trial174.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:42.521 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:42.527 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:43.532 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:43.539 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:43.780 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:43.813 INFO:teuthology.orchestra.run.trial174.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:45.641 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:46.594 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:46.854 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:46.860 INFO:teuthology.orchestra.run.trial174.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:47.388 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:47.409 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:47.596 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:47.596 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:20:47.596 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:20:47.596 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:20:47.653 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:20:47.714 DEBUG:teuthology.orchestra.run.trial167:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:20:47.742 INFO:teuthology.orchestra.run.trial167.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:20:47.743 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:20:47.743 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T14:20:47.743 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T14:20:47.743 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T14:20:47.743 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-25T14:20:47.743 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial167.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T14:20:47.743 DEBUG:teuthology.orchestra.run.trial167:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:20:47.808 INFO:teuthology.orchestra.run.trial167.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:20:47.809 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:20:47.809 DEBUG:teuthology.orchestra.run.trial167:> sudo rpm -qi grub2-tools 2026-02-25T14:20:47.877 INFO:teuthology.orchestra.run.trial167.stdout:Name : grub2-tools 2026-02-25T14:20:47.877 INFO:teuthology.orchestra.run.trial167.stdout:Epoch : 1 2026-02-25T14:20:47.877 INFO:teuthology.orchestra.run.trial167.stdout:Version : 2.06 2026-02-25T14:20:47.877 INFO:teuthology.orchestra.run.trial167.stdout:Release : 120.el9 2026-02-25T14:20:47.877 INFO:teuthology.orchestra.run.trial167.stdout:Architecture: x86_64 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Group : Unspecified 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Size : 9108611 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:License : GPLv3+ 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Packager : builder@centos.org 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Vendor : CentOS 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T14:20:47.878 INFO:teuthology.orchestra.run.trial167.stdout:Summary : Support tools for GRUB. 2026-02-25T14:20:47.879 INFO:teuthology.orchestra.run.trial167.stdout:Description : 2026-02-25T14:20:47.879 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:20:47.879 INFO:teuthology.orchestra.run.trial167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T14:20:47.879 INFO:teuthology.orchestra.run.trial167.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T14:20:47.879 INFO:teuthology.orchestra.run.trial167.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T14:20:47.879 INFO:teuthology.orchestra.run.trial167.stdout:hardware devices. 2026-02-25T14:20:47.879 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:20:47.879 INFO:teuthology.orchestra.run.trial167.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T14:20:47.880 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T14:20:47.880 INFO:teuthology.task.kernel:Updating grub on trial167 to boot 5.14.0-686.el9.x86_64 2026-02-25T14:20:47.881 DEBUG:teuthology.orchestra.run.trial167:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T14:20:47.944 INFO:teuthology.orchestra.run.trial167.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T14:20:47.945 DEBUG:teuthology.orchestra.run.trial167:> sudo command -v grubby && echo yes || echo no 2026-02-25T14:20:48.010 INFO:teuthology.orchestra.run.trial167.stdout:/sbin/grubby 2026-02-25T14:20:48.012 INFO:teuthology.orchestra.run.trial167.stdout:yes 2026-02-25T14:20:48.012 DEBUG:teuthology.orchestra.run.trial167:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T14:20:48.076 INFO:teuthology.orchestra.run.trial167.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T14:20:48.076 DEBUG:teuthology.orchestra.run.trial167:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T14:20:48.149 DEBUG:teuthology.orchestra.run.trial167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T14:20:48.354 INFO:teuthology.orchestra.run.trial167.stderr:Generating grub configuration file ... 2026-02-25T14:20:48.423 INFO:teuthology.orchestra.run.trial167.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T14:20:48.430 INFO:teuthology.orchestra.run.trial167.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T14:20:48.683 INFO:teuthology.orchestra.run.trial167.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T14:20:48.690 INFO:teuthology.orchestra.run.trial167.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T14:20:48.724 INFO:teuthology.orchestra.run.trial167.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T14:20:48.730 INFO:teuthology.orchestra.run.trial167.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T14:20:48.761 INFO:teuthology.orchestra.run.trial167.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T14:20:48.768 INFO:teuthology.orchestra.run.trial167.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T14:20:48.791 INFO:teuthology.orchestra.run.trial167.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T14:20:48.798 INFO:teuthology.orchestra.run.trial167.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T14:20:48.884 INFO:teuthology.orchestra.run.trial167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T14:20:48.893 INFO:teuthology.orchestra.run.trial167.stderr:done 2026-02-25T14:20:48.895 DEBUG:teuthology.orchestra.run.trial167:> test -d /sys/firmware/efi 2026-02-25T14:20:48.911 DEBUG:teuthology.orchestra.run.trial167:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T14:20:48.977 INFO:teuthology.orchestra.run.trial167.stdout:/boot/efi/EFI/BOOT 2026-02-25T14:20:48.977 INFO:teuthology.orchestra.run.trial167.stdout:/boot/efi/EFI/centos 2026-02-25T14:20:48.979 DEBUG:teuthology.orchestra.run.trial167:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T14:20:49.046 INFO:teuthology.orchestra.run.trial167.stdout:no 2026-02-25T14:20:49.047 DEBUG:teuthology.orchestra.run.trial167:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T14:20:49.112 INFO:teuthology.orchestra.run.trial167.stdout:yes 2026-02-25T14:20:49.112 DEBUG:teuthology.orchestra.run.trial167:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T14:20:49.178 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial167 2026-02-25T14:20:49.179 DEBUG:teuthology.orchestra.run.trial167:> sudo bash -c ' 2026-02-25T14:20:49.179 DEBUG:teuthology.orchestra.run.trial167:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T14:20:49.179 DEBUG:teuthology.orchestra.run.trial167:> ' 2026-02-25T14:20:49.908 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:03.041 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:03.061 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:03.247 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:03.248 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:21:03.248 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:21:03.248 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:21:03.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:03.305 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:21:03.305 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:21:03.305 INFO:teuthology.orchestra.run.trial155.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:03.305 INFO:teuthology.orchestra.run.trial155.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T14:21:03.305 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T14:21:03.305 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T14:21:03.306 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:21:03.306 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:21:03.365 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:21:03.395 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:03.395 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:21:03.396 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T14:21:03.396 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T14:21:03.396 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T14:21:03.396 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-25T14:21:03.396 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial155.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T14:21:03.397 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:21:03.460 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:03.461 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:21:03.461 DEBUG:teuthology.orchestra.run.trial155:> sudo rpm -qi grub2-tools 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Name : grub2-tools 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Epoch : 1 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Version : 2.06 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Release : 120.el9 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Architecture: x86_64 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Group : Unspecified 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Size : 9108611 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:License : GPLv3+ 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Packager : builder@centos.org 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Vendor : CentOS 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Summary : Support tools for GRUB. 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:Description : 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout:hardware devices. 2026-02-25T14:21:03.530 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:21:03.531 INFO:teuthology.orchestra.run.trial155.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T14:21:03.531 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T14:21:03.531 INFO:teuthology.task.kernel:Updating grub on trial155 to boot 5.14.0-686.el9.x86_64 2026-02-25T14:21:03.531 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T14:21:03.594 INFO:teuthology.orchestra.run.trial155.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T14:21:03.596 DEBUG:teuthology.orchestra.run.trial155:> sudo command -v grubby && echo yes || echo no 2026-02-25T14:21:03.659 INFO:teuthology.orchestra.run.trial155.stdout:/sbin/grubby 2026-02-25T14:21:03.659 INFO:teuthology.orchestra.run.trial155.stdout:yes 2026-02-25T14:21:03.660 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T14:21:03.726 INFO:teuthology.orchestra.run.trial155.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T14:21:03.727 DEBUG:teuthology.orchestra.run.trial155:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T14:21:03.802 DEBUG:teuthology.orchestra.run.trial155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T14:21:03.879 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:03.901 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:04.007 INFO:teuthology.orchestra.run.trial155.stderr:Generating grub configuration file ... 2026-02-25T14:21:04.074 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.081 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T14:21:04.087 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:04.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:21:04.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:21:04.088 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:21:04.145 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:21:04.207 DEBUG:teuthology.orchestra.run.trial078:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:21:04.236 INFO:teuthology.orchestra.run.trial078.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.236 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:21:04.237 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T14:21:04.237 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T14:21:04.237 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T14:21:04.237 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-25T14:21:04.237 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial078.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T14:21:04.238 DEBUG:teuthology.orchestra.run.trial078:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:21:04.300 INFO:teuthology.orchestra.run.trial078.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.301 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:21:04.302 DEBUG:teuthology.orchestra.run.trial078:> sudo rpm -qi grub2-tools 2026-02-25T14:21:04.335 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T14:21:04.342 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T14:21:04.372 INFO:teuthology.orchestra.run.trial078.stdout:Name : grub2-tools 2026-02-25T14:21:04.372 INFO:teuthology.orchestra.run.trial078.stdout:Epoch : 1 2026-02-25T14:21:04.372 INFO:teuthology.orchestra.run.trial078.stdout:Version : 2.06 2026-02-25T14:21:04.372 INFO:teuthology.orchestra.run.trial078.stdout:Release : 120.el9 2026-02-25T14:21:04.372 INFO:teuthology.orchestra.run.trial078.stdout:Architecture: x86_64 2026-02-25T14:21:04.372 INFO:teuthology.orchestra.run.trial078.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Group : Unspecified 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Size : 9108611 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:License : GPLv3+ 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Packager : builder@centos.org 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Vendor : CentOS 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Summary : Support tools for GRUB. 2026-02-25T14:21:04.373 INFO:teuthology.orchestra.run.trial078.stdout:Description : 2026-02-25T14:21:04.374 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:21:04.374 INFO:teuthology.orchestra.run.trial078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T14:21:04.374 INFO:teuthology.orchestra.run.trial078.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T14:21:04.374 INFO:teuthology.orchestra.run.trial078.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T14:21:04.374 INFO:teuthology.orchestra.run.trial078.stdout:hardware devices. 2026-02-25T14:21:04.374 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:21:04.374 INFO:teuthology.orchestra.run.trial078.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T14:21:04.375 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T14:21:04.375 INFO:teuthology.task.kernel:Updating grub on trial078 to boot 5.14.0-686.el9.x86_64 2026-02-25T14:21:04.376 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T14:21:04.376 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T14:21:04.382 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T14:21:04.413 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T14:21:04.420 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T14:21:04.439 INFO:teuthology.orchestra.run.trial078.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T14:21:04.440 DEBUG:teuthology.orchestra.run.trial078:> sudo command -v grubby && echo yes || echo no 2026-02-25T14:21:04.443 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T14:21:04.450 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T14:21:04.504 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/grubby 2026-02-25T14:21:04.506 INFO:teuthology.orchestra.run.trial078.stdout:yes 2026-02-25T14:21:04.506 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T14:21:04.536 INFO:teuthology.orchestra.run.trial155.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T14:21:04.545 INFO:teuthology.orchestra.run.trial155.stderr:done 2026-02-25T14:21:04.547 DEBUG:teuthology.orchestra.run.trial155:> test -d /sys/firmware/efi 2026-02-25T14:21:04.564 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T14:21:04.571 INFO:teuthology.orchestra.run.trial078.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T14:21:04.572 DEBUG:teuthology.orchestra.run.trial078:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.628 INFO:teuthology.orchestra.run.trial155.stdout:/boot/efi/EFI/BOOT 2026-02-25T14:21:04.629 INFO:teuthology.orchestra.run.trial155.stdout:/boot/efi/EFI/centos 2026-02-25T14:21:04.630 DEBUG:teuthology.orchestra.run.trial155:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T14:21:04.646 DEBUG:teuthology.orchestra.run.trial078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T14:21:04.698 INFO:teuthology.orchestra.run.trial155.stdout:no 2026-02-25T14:21:04.698 DEBUG:teuthology.orchestra.run.trial155:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T14:21:04.761 INFO:teuthology.orchestra.run.trial155.stdout:yes 2026-02-25T14:21:04.762 DEBUG:teuthology.orchestra.run.trial155:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T14:21:04.825 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial155 2026-02-25T14:21:04.825 DEBUG:teuthology.orchestra.run.trial155:> sudo bash -c ' 2026-02-25T14:21:04.825 DEBUG:teuthology.orchestra.run.trial155:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T14:21:04.825 DEBUG:teuthology.orchestra.run.trial155:> ' 2026-02-25T14:21:04.849 INFO:teuthology.orchestra.run.trial078.stderr:Generating grub configuration file ... 2026-02-25T14:21:04.916 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T14:21:04.923 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T14:21:05.174 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T14:21:05.181 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T14:21:05.216 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T14:21:05.222 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T14:21:05.253 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T14:21:05.260 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T14:21:05.283 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T14:21:05.289 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T14:21:05.374 INFO:teuthology.orchestra.run.trial078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T14:21:05.383 INFO:teuthology.orchestra.run.trial078.stderr:done 2026-02-25T14:21:05.384 DEBUG:teuthology.orchestra.run.trial078:> test -d /sys/firmware/efi 2026-02-25T14:21:05.409 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T14:21:05.480 INFO:teuthology.orchestra.run.trial078.stdout:/boot/efi/EFI/BOOT 2026-02-25T14:21:05.480 INFO:teuthology.orchestra.run.trial078.stdout:/boot/efi/EFI/centos 2026-02-25T14:21:05.482 DEBUG:teuthology.orchestra.run.trial078:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T14:21:05.547 INFO:teuthology.orchestra.run.trial078.stdout:no 2026-02-25T14:21:05.547 DEBUG:teuthology.orchestra.run.trial078:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T14:21:05.613 INFO:teuthology.orchestra.run.trial078.stdout:yes 2026-02-25T14:21:05.613 DEBUG:teuthology.orchestra.run.trial078:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T14:21:05.677 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial078 2026-02-25T14:21:05.677 DEBUG:teuthology.orchestra.run.trial078:> sudo bash -c ' 2026-02-25T14:21:05.677 DEBUG:teuthology.orchestra.run.trial078:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T14:21:05.677 DEBUG:teuthology.orchestra.run.trial078:> ' 2026-02-25T14:21:07.427 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:07.450 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:07.639 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:07.639 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:21:07.639 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:21:07.639 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:21:07.696 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:21:07.697 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:21:07.697 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:21:07.697 INFO:teuthology.orchestra.run.trial174.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:07.697 INFO:teuthology.orchestra.run.trial174.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T14:21:07.697 INFO:teuthology.orchestra.run.trial174.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T14:21:07.697 INFO:teuthology.orchestra.run.trial174.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T14:21:07.697 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:21:07.697 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:21:07.758 DEBUG:teuthology.orchestra.run.trial174:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:21:07.787 INFO:teuthology.orchestra.run.trial174.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:07.788 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:21:07.789 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T14:21:07.789 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T14:21:07.789 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T14:21:07.789 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-25T14:21:07.789 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial174.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T14:21:07.789 DEBUG:teuthology.orchestra.run.trial174:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:21:07.854 INFO:teuthology.orchestra.run.trial174.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:21:07.855 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:21:07.856 DEBUG:teuthology.orchestra.run.trial174:> sudo rpm -qi grub2-tools 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Name : grub2-tools 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Epoch : 1 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Version : 2.06 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Release : 120.el9 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Architecture: x86_64 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Group : Unspecified 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Size : 9108611 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:License : GPLv3+ 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Packager : builder@centos.org 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Vendor : CentOS 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Summary : Support tools for GRUB. 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:Description : 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:hardware devices. 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:21:07.926 INFO:teuthology.orchestra.run.trial174.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T14:21:07.927 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T14:21:07.927 INFO:teuthology.task.kernel:Updating grub on trial174 to boot 5.14.0-686.el9.x86_64 2026-02-25T14:21:07.927 DEBUG:teuthology.orchestra.run.trial174:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T14:21:07.991 INFO:teuthology.orchestra.run.trial174.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T14:21:07.993 DEBUG:teuthology.orchestra.run.trial174:> sudo command -v grubby && echo yes || echo no 2026-02-25T14:21:08.056 INFO:teuthology.orchestra.run.trial174.stdout:/sbin/grubby 2026-02-25T14:21:08.057 INFO:teuthology.orchestra.run.trial174.stdout:yes 2026-02-25T14:21:08.058 DEBUG:teuthology.orchestra.run.trial174:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T14:21:08.121 INFO:teuthology.orchestra.run.trial174.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T14:21:08.122 DEBUG:teuthology.orchestra.run.trial174:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T14:21:08.195 DEBUG:teuthology.orchestra.run.trial174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T14:21:08.409 INFO:teuthology.orchestra.run.trial174.stderr:Generating grub configuration file ... 2026-02-25T14:21:08.478 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T14:21:08.485 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T14:21:08.742 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T14:21:08.749 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T14:21:08.784 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T14:21:08.791 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T14:21:08.822 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T14:21:08.829 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T14:21:08.853 INFO:teuthology.orchestra.run.trial174.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T14:21:08.859 INFO:teuthology.orchestra.run.trial174.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T14:21:08.946 INFO:teuthology.orchestra.run.trial174.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T14:21:08.954 INFO:teuthology.orchestra.run.trial174.stderr:done 2026-02-25T14:21:08.957 DEBUG:teuthology.orchestra.run.trial174:> test -d /sys/firmware/efi 2026-02-25T14:21:08.973 DEBUG:teuthology.orchestra.run.trial174:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T14:21:09.040 INFO:teuthology.orchestra.run.trial174.stdout:/boot/efi/EFI/BOOT 2026-02-25T14:21:09.040 INFO:teuthology.orchestra.run.trial174.stdout:/boot/efi/EFI/centos 2026-02-25T14:21:09.042 DEBUG:teuthology.orchestra.run.trial174:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T14:21:09.110 INFO:teuthology.orchestra.run.trial174.stdout:no 2026-02-25T14:21:09.110 DEBUG:teuthology.orchestra.run.trial174:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T14:21:09.176 INFO:teuthology.orchestra.run.trial174.stdout:yes 2026-02-25T14:21:09.176 DEBUG:teuthology.orchestra.run.trial174:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T14:21:09.240 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial174 2026-02-25T14:21:09.240 DEBUG:teuthology.orchestra.run.trial174:> sudo bash -c ' 2026-02-25T14:21:09.241 DEBUG:teuthology.orchestra.run.trial174:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T14:21:09.241 DEBUG:teuthology.orchestra.run.trial174:> ' 2026-02-25T14:21:19.221 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-25T14:21:19.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial167.front.sepia.ceph.com' 2026-02-25T14:21:19.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:21:34.868 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-25T14:21:34.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-25T14:21:34.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:21:35.720 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-25T14:21:35.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-25T14:21:35.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:21:39.284 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-25T14:21:39.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-25T14:21:39.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:22:19.264 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T14:22:28.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial167.front.sepia.ceph.com' 2026-02-25T14:22:28.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:22:28.384 DEBUG:teuthology.orchestra.run.trial167:> true 2026-02-25T14:22:28.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial167.front.sepia.ceph.com' 2026-02-25T14:22:28.543 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-686.el9.x86_64"... 2026-02-25T14:22:28.543 DEBUG:teuthology.orchestra.run.trial167:> uname -r 2026-02-25T14:22:28.598 INFO:teuthology.orchestra.run.trial167.stdout:5.14.0-686.el9.x86_64 2026-02-25T14:22:28.598 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T14:22:28.598 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T14:22:28.598 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T14:22:29.599 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-25T14:22:29.600 DEBUG:teuthology.orchestra.run.trial167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T14:22:29.630 INFO:teuthology.orchestra.run.trial167.stdout:ttyS1 2026-02-25T14:22:29.653 DEBUG:teuthology.parallel:result is None 2026-02-25T14:22:34.873 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T14:22:35.724 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T14:22:39.287 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T14:22:43.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-25T14:22:43.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:22:44.012 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-25T14:22:44.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-25T14:22:44.170 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-686.el9.x86_64"... 2026-02-25T14:22:44.170 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-25T14:22:44.227 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-686.el9.x86_64 2026-02-25T14:22:44.227 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T14:22:44.227 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T14:22:44.227 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T14:22:44.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-25T14:22:44.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:22:44.827 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-25T14:22:44.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-25T14:22:44.986 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-25T14:22:44.986 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-25T14:22:45.042 INFO:teuthology.orchestra.run.trial078.stdout:5.14.0-686.el9.x86_64 2026-02-25T14:22:45.043 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T14:22:45.043 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T14:22:45.043 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T14:22:45.228 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-25T14:22:45.228 DEBUG:teuthology.orchestra.run.trial155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T14:22:45.259 INFO:teuthology.orchestra.run.trial155.stdout:ttyS1 2026-02-25T14:22:45.280 DEBUG:teuthology.parallel:result is None 2026-02-25T14:22:46.043 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-25T14:22:46.043 DEBUG:teuthology.orchestra.run.trial078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T14:22:46.072 INFO:teuthology.orchestra.run.trial078.stdout:ttyS1 2026-02-25T14:22:46.091 DEBUG:teuthology.parallel:result is None 2026-02-25T14:22:48.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-25T14:22:48.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:22:48.415 DEBUG:teuthology.orchestra.run.trial174:> true 2026-02-25T14:22:48.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-25T14:22:48.580 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-686.el9.x86_64"... 2026-02-25T14:22:48.580 DEBUG:teuthology.orchestra.run.trial174:> uname -r 2026-02-25T14:22:48.637 INFO:teuthology.orchestra.run.trial174.stdout:5.14.0-686.el9.x86_64 2026-02-25T14:22:48.638 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T14:22:48.638 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T14:22:48.638 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T14:22:49.638 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-25T14:22:49.639 DEBUG:teuthology.orchestra.run.trial174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T14:22:49.669 INFO:teuthology.orchestra.run.trial174.stdout:ttyS1 2026-02-25T14:22:49.695 DEBUG:teuthology.parallel:result is None 2026-02-25T14:22:49.695 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-25T14:22:49.703 INFO:teuthology.task.internal:Creating test directory... 2026-02-25T14:22:49.703 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T14:22:49.705 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T14:22:49.707 DEBUG:teuthology.orchestra.run.trial167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T14:22:49.709 DEBUG:teuthology.orchestra.run.trial174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T14:22:49.750 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-25T14:22:49.761 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-25T14:22:49.774 INFO:teuthology.task.internal:Creating archive directory... 2026-02-25T14:22:49.775 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T14:22:49.777 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T14:22:49.779 DEBUG:teuthology.orchestra.run.trial167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T14:22:49.782 DEBUG:teuthology.orchestra.run.trial174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T14:22:49.817 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-25T14:22:49.828 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-25T14:22:49.829 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T14:22:49.835 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T14:22:49.838 DEBUG:teuthology.orchestra.run.trial167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T14:22:49.840 DEBUG:teuthology.orchestra.run.trial174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T14:22:49.857 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:22:49.860 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:22:49.862 INFO:teuthology.orchestra.run.trial167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:22:49.866 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:22:49.869 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:22:49.871 INFO:teuthology.orchestra.run.trial167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:22:49.871 INFO:teuthology.orchestra.run.trial174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:22:49.880 INFO:teuthology.orchestra.run.trial174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:22:49.881 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-25T14:22:49.893 INFO:teuthology.task.internal:Configuring sudo... 2026-02-25T14:22:49.893 DEBUG:teuthology.orchestra.run.trial078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T14:22:49.910 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T14:22:49.913 DEBUG:teuthology.orchestra.run.trial167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T14:22:49.915 DEBUG:teuthology.orchestra.run.trial174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T14:22:49.946 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-25T14:22:49.963 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-25T14:22:49.963 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T14:22:49.974 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T14:22:49.977 DEBUG:teuthology.orchestra.run.trial167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T14:22:49.979 DEBUG:teuthology.orchestra.run.trial174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T14:22:50.003 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:22:50.144 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:22:50.169 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:22:50.441 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:22:50.464 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T14:22:50.464 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T14:22:50.528 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:22:50.647 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:22:50.672 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:22:50.818 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:22:50.841 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T14:22:50.841 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T14:22:50.904 DEBUG:teuthology.orchestra.run.trial167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:22:50.987 DEBUG:teuthology.orchestra.run.trial167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:22:51.012 DEBUG:teuthology.orchestra.run.trial167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:22:51.150 DEBUG:teuthology.orchestra.run.trial167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:22:51.175 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T14:22:51.175 DEBUG:teuthology.orchestra.run.trial167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T14:22:51.238 DEBUG:teuthology.orchestra.run.trial174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:22:51.336 DEBUG:teuthology.orchestra.run.trial174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:22:51.360 DEBUG:teuthology.orchestra.run.trial174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:22:51.503 DEBUG:teuthology.orchestra.run.trial174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:22:51.528 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T14:22:51.528 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T14:22:51.592 DEBUG:teuthology.orchestra.run.trial078:> sudo service rsyslog restart 2026-02-25T14:22:51.595 DEBUG:teuthology.orchestra.run.trial155:> sudo service rsyslog restart 2026-02-25T14:22:51.597 DEBUG:teuthology.orchestra.run.trial167:> sudo service rsyslog restart 2026-02-25T14:22:51.599 DEBUG:teuthology.orchestra.run.trial174:> sudo service rsyslog restart 2026-02-25T14:22:51.621 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T14:22:51.623 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T14:22:51.626 INFO:teuthology.orchestra.run.trial167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T14:22:51.660 INFO:teuthology.orchestra.run.trial174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T14:22:52.078 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-25T14:22:52.091 INFO:teuthology.task.internal:Starting timer... 2026-02-25T14:22:52.091 INFO:teuthology.run_tasks:Running task pcp... 2026-02-25T14:22:52.112 INFO:teuthology.run_tasks:Running task selinux... 2026-02-25T14:22:52.136 DEBUG:teuthology.orchestra.run.trial078:> sudo service auditd rotate 2026-02-25T14:22:52.167 INFO:teuthology.orchestra.run.trial078.stdout:Rotating logs: 2026-02-25T14:22:52.169 DEBUG:teuthology.orchestra.run.trial155:> sudo service auditd rotate 2026-02-25T14:22:52.197 INFO:teuthology.orchestra.run.trial155.stdout:Rotating logs: 2026-02-25T14:22:52.199 DEBUG:teuthology.orchestra.run.trial167:> sudo service auditd rotate 2026-02-25T14:22:52.229 INFO:teuthology.orchestra.run.trial167.stdout:Rotating logs: 2026-02-25T14:22:52.231 DEBUG:teuthology.orchestra.run.trial174:> sudo service auditd rotate 2026-02-25T14:22:52.261 INFO:teuthology.orchestra.run.trial174.stdout:Rotating logs: 2026-02-25T14:22:52.263 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-25T14:22:52.263 DEBUG:teuthology.orchestra.run.trial078:> /usr/sbin/getenforce 2026-02-25T14:22:52.281 INFO:teuthology.orchestra.run.trial078.stdout:Permissive 2026-02-25T14:22:52.281 DEBUG:teuthology.orchestra.run.trial155:> /usr/sbin/getenforce 2026-02-25T14:22:52.299 INFO:teuthology.orchestra.run.trial155.stdout:Permissive 2026-02-25T14:22:52.299 DEBUG:teuthology.orchestra.run.trial167:> /usr/sbin/getenforce 2026-02-25T14:22:52.317 INFO:teuthology.orchestra.run.trial167.stdout:Permissive 2026-02-25T14:22:52.317 DEBUG:teuthology.orchestra.run.trial174:> /usr/sbin/getenforce 2026-02-25T14:22:52.333 INFO:teuthology.orchestra.run.trial174.stdout:Permissive 2026-02-25T14:22:52.334 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial078.front.sepia.ceph.com': 'permissive', 'ubuntu@trial155.front.sepia.ceph.com': 'permissive', 'ubuntu@trial167.front.sepia.ceph.com': 'permissive', 'ubuntu@trial174.front.sepia.ceph.com': 'permissive'} 2026-02-25T14:22:52.334 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T14:22:52.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:22:52.360 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T14:22:52.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:22:52.385 DEBUG:teuthology.orchestra.run.trial167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T14:22:52.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:22:52.410 DEBUG:teuthology.orchestra.run.trial174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T14:22:52.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:22:52.437 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-25T14:22:52.437 DEBUG:teuthology.orchestra.run.trial078:> sudo /usr/sbin/setenforce permissive 2026-02-25T14:22:52.462 DEBUG:teuthology.orchestra.run.trial155:> sudo /usr/sbin/setenforce permissive 2026-02-25T14:22:52.488 DEBUG:teuthology.orchestra.run.trial167:> sudo /usr/sbin/setenforce permissive 2026-02-25T14:22:52.514 DEBUG:teuthology.orchestra.run.trial174:> sudo /usr/sbin/setenforce permissive 2026-02-25T14:22:52.539 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-25T14:22:52.552 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-25T14:22:52.555 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-25T14:22:52.666 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-25T14:22:52.677 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-25T14:22:52.679 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial078.front.sepia.ceph.com,trial155.front.sepia.ceph.com,trial167.front.sepia.ceph.com,trial174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-25T14:25:48.172 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial078.front.sepia.ceph.com'), Remote(name='ubuntu@trial155.front.sepia.ceph.com'), Remote(name='ubuntu@trial167.front.sepia.ceph.com'), Remote(name='ubuntu@trial174.front.sepia.ceph.com')] 2026-02-25T14:25:48.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-25T14:25:48.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:25:48.284 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-25T14:25:48.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-25T14:25:48.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-25T14:25:48.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:25:48.459 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-25T14:25:48.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-25T14:25:48.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial167.front.sepia.ceph.com' 2026-02-25T14:25:48.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:25:48.629 DEBUG:teuthology.orchestra.run.trial167:> true 2026-02-25T14:25:48.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial167.front.sepia.ceph.com' 2026-02-25T14:25:48.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-25T14:25:48.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:25:48.788 DEBUG:teuthology.orchestra.run.trial174:> true 2026-02-25T14:25:48.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-25T14:25:48.866 INFO:teuthology.run_tasks:Running task clock... 2026-02-25T14:25:48.880 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-25T14:25:48.880 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T14:25:48.881 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T14:25:48.883 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T14:25:48.883 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T14:25:48.885 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T14:25:48.886 DEBUG:teuthology.orchestra.run.trial167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T14:25:48.888 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T14:25:48.888 DEBUG:teuthology.orchestra.run.trial174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T14:25:48.909 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T14:25:48.911 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T14:25:48.913 INFO:teuthology.orchestra.run.trial167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T14:25:48.921 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T14:25:48.923 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T14:25:48.925 INFO:teuthology.orchestra.run.trial167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T14:25:48.930 INFO:teuthology.orchestra.run.trial174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T14:25:48.941 INFO:teuthology.orchestra.run.trial078.stderr:sudo: ntpd: command not found 2026-02-25T14:25:48.943 INFO:teuthology.orchestra.run.trial174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T14:25:48.943 INFO:teuthology.orchestra.run.trial155.stderr:sudo: ntpd: command not found 2026-02-25T14:25:48.946 INFO:teuthology.orchestra.run.trial167.stderr:sudo: ntpd: command not found 2026-02-25T14:25:48.952 INFO:teuthology.orchestra.run.trial078.stdout:506 Cannot talk to daemon 2026-02-25T14:25:48.954 INFO:teuthology.orchestra.run.trial155.stdout:506 Cannot talk to daemon 2026-02-25T14:25:48.956 INFO:teuthology.orchestra.run.trial167.stdout:506 Cannot talk to daemon 2026-02-25T14:25:48.964 INFO:teuthology.orchestra.run.trial174.stderr:sudo: ntpd: command not found 2026-02-25T14:25:48.965 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T14:25:48.966 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T14:25:48.967 INFO:teuthology.orchestra.run.trial167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T14:25:48.974 INFO:teuthology.orchestra.run.trial174.stdout:506 Cannot talk to daemon 2026-02-25T14:25:48.977 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T14:25:48.978 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T14:25:48.979 INFO:teuthology.orchestra.run.trial167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T14:25:48.985 INFO:teuthology.orchestra.run.trial174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T14:25:48.996 INFO:teuthology.orchestra.run.trial174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T14:25:49.026 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-25T14:25:49.027 INFO:teuthology.orchestra.run.trial167.stderr:bash: line 1: ntpq: command not found 2026-02-25T14:25:49.028 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T14:25:49.028 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-25T14:25:49.029 INFO:teuthology.orchestra.run.trial167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T14:25:49.029 INFO:teuthology.orchestra.run.trial167.stdout:=============================================================================== 2026-02-25T14:25:49.030 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-25T14:25:49.031 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T14:25:49.032 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-25T14:25:49.051 INFO:teuthology.orchestra.run.trial174.stderr:bash: line 1: ntpq: command not found 2026-02-25T14:25:49.061 INFO:teuthology.orchestra.run.trial174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T14:25:49.061 INFO:teuthology.orchestra.run.trial174.stdout:=============================================================================== 2026-02-25T14:25:49.061 INFO:teuthology.orchestra.run.trial174.stdout:^? 149.248.12.167.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-25T14:25:49.063 INFO:teuthology.run_tasks:Running task install... 2026-02-25T14:25:49.078 DEBUG:teuthology.task.install:project ceph 2026-02-25T14:25:49.078 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}} 2026-02-25T14:25:49.079 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'} 2026-02-25T14:25:49.079 INFO:teuthology.task.install:Using flavor: default 2026-02-25T14:25:49.087 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-25T14:25:49.088 INFO:teuthology.task.install:extra packages: [] 2026-02-25T14:25:49.088 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-25T14:25:49.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T14:25:49.091 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-25T14:25:49.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T14:25:49.093 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-25T14:25:49.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T14:25:49.095 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-25T14:25:49.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T14:25:49.386 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-25T14:25:49.386 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-25T14:25:49.388 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-25T14:25:49.389 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-25T14:25:49.392 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-25T14:25:49.392 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-25T14:25:49.396 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-25T14:25:49.396 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-25T14:25:49.811 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T14:25:49.811 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T14:25:49.811 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T14:25:49.814 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T14:25:49.814 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T14:25:49.814 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T14:25:49.837 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-25T14:25:49.838 DEBUG:teuthology.orchestra.run.trial078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T14:25:49.842 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T14:25:49.842 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T14:25:49.842 DEBUG:teuthology.orchestra.run.trial167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T14:25:49.844 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-25T14:25:49.844 DEBUG:teuthology.orchestra.run.trial155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T14:25:49.869 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-25T14:25:49.870 DEBUG:teuthology.orchestra.run.trial167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T14:25:49.878 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T14:25:49.878 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T14:25:49.878 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T14:25:49.905 DEBUG:teuthology.orchestra.run.trial078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T14:25:49.906 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-25T14:25:49.906 DEBUG:teuthology.orchestra.run.trial174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T14:25:49.909 DEBUG:teuthology.orchestra.run.trial155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T14:25:49.933 DEBUG:teuthology.orchestra.run.trial167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T14:25:49.971 DEBUG:teuthology.orchestra.run.trial174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T14:25:49.976 DEBUG:teuthology.orchestra.run.trial078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T14:25:49.980 DEBUG:teuthology.orchestra.run.trial155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T14:25:50.005 DEBUG:teuthology.orchestra.run.trial167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T14:25:50.040 INFO:teuthology.orchestra.run.trial078.stdout:check_obsoletes = 1 2026-02-25T14:25:50.042 DEBUG:teuthology.orchestra.run.trial078:> sudo yum clean all 2026-02-25T14:25:50.043 INFO:teuthology.orchestra.run.trial155.stdout:check_obsoletes = 1 2026-02-25T14:25:50.045 DEBUG:teuthology.orchestra.run.trial174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T14:25:50.046 DEBUG:teuthology.orchestra.run.trial155:> sudo yum clean all 2026-02-25T14:25:50.069 INFO:teuthology.orchestra.run.trial167.stdout:check_obsoletes = 1 2026-02-25T14:25:50.071 DEBUG:teuthology.orchestra.run.trial167:> sudo yum clean all 2026-02-25T14:25:50.108 INFO:teuthology.orchestra.run.trial174.stdout:check_obsoletes = 1 2026-02-25T14:25:50.110 DEBUG:teuthology.orchestra.run.trial174:> sudo yum clean all 2026-02-25T14:25:50.190 INFO:teuthology.orchestra.run.trial078.stdout:41 files removed 2026-02-25T14:25:50.194 INFO:teuthology.orchestra.run.trial155.stdout:41 files removed 2026-02-25T14:25:50.203 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-radosgw 2026-02-25T14:25:50.208 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-radosgw 2026-02-25T14:25:50.218 INFO:teuthology.orchestra.run.trial167.stdout:41 files removed 2026-02-25T14:25:50.232 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-radosgw 2026-02-25T14:25:50.258 INFO:teuthology.orchestra.run.trial174.stdout:41 files removed 2026-02-25T14:25:50.273 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-radosgw 2026-02-25T14:25:51.025 INFO:teuthology.orchestra.run.trial078.stdout:ceph packages for x86_64 129 kB/s | 87 kB 00:00 2026-02-25T14:25:51.032 INFO:teuthology.orchestra.run.trial155.stdout:ceph packages for x86_64 129 kB/s | 87 kB 00:00 2026-02-25T14:25:51.062 INFO:teuthology.orchestra.run.trial167.stdout:ceph packages for x86_64 128 kB/s | 87 kB 00:00 2026-02-25T14:25:51.101 INFO:teuthology.orchestra.run.trial174.stdout:ceph packages for x86_64 128 kB/s | 87 kB 00:00 2026-02-25T14:25:51.648 INFO:teuthology.orchestra.run.trial155.stdout:ceph noarch packages 31 kB/s | 18 kB 00:00 2026-02-25T14:25:51.718 INFO:teuthology.orchestra.run.trial078.stdout:ceph noarch packages 27 kB/s | 18 kB 00:00 2026-02-25T14:25:51.721 INFO:teuthology.orchestra.run.trial167.stdout:ceph noarch packages 29 kB/s | 18 kB 00:00 2026-02-25T14:25:51.721 INFO:teuthology.orchestra.run.trial174.stdout:ceph noarch packages 30 kB/s | 18 kB 00:00 2026-02-25T14:25:52.217 INFO:teuthology.orchestra.run.trial155.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2026-02-25T14:25:52.282 INFO:teuthology.orchestra.run.trial078.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2026-02-25T14:25:52.284 INFO:teuthology.orchestra.run.trial167.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2026-02-25T14:25:52.285 INFO:teuthology.orchestra.run.trial174.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2026-02-25T14:25:52.514 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 32 MB/s | 8.9 MB 00:00 2026-02-25T14:25:52.974 INFO:teuthology.orchestra.run.trial167.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-25T14:25:53.492 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.9 MB 00:01 2026-02-25T14:25:55.105 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.9 MB 00:02 2026-02-25T14:25:55.534 INFO:teuthology.orchestra.run.trial167.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-25T14:25:55.826 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 27 MB 00:02 2026-02-25T14:25:56.917 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 27 MB 00:02 2026-02-25T14:25:58.861 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-25T14:25:59.260 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 8.0 MB 00:01 2026-02-25T14:26:00.274 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 8.0 MB 00:00 2026-02-25T14:26:01.029 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-25T14:26:01.667 INFO:teuthology.orchestra.run.trial167.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 8.0 MB 00:03 2026-02-25T14:26:02.152 INFO:teuthology.orchestra.run.trial174.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-25T14:26:02.374 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-25T14:26:02.900 INFO:teuthology.orchestra.run.trial167.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 20 kB 00:00 2026-02-25T14:26:03.085 INFO:teuthology.orchestra.run.trial174.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-25T14:26:03.305 INFO:teuthology.orchestra.run.trial167.stdout:Extra Packages for Enterprise Linux 60 MB/s | 20 MB 00:00 2026-02-25T14:26:04.269 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 8.0 MB 00:02 2026-02-25T14:26:05.568 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.9 MB/s | 50 kB 00:00 2026-02-25T14:26:06.039 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-25T14:26:06.302 INFO:teuthology.orchestra.run.trial174.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-25T14:26:06.498 INFO:teuthology.orchestra.run.trial167.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-25T14:26:06.508 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 50 MB/s | 20 MB 00:00 2026-02-25T14:26:06.794 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout:Upgrading: 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-25T14:26:06.796 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout:Install 32 Packages 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout:Upgrade 2 Packages 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 78 M 2026-02-25T14:26:06.797 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:26:07.512 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:26:07.514 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:26:07.514 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:26:07.514 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:26:07.514 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:26:07.514 INFO:teuthology.orchestra.run.trial174.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-25T14:26:07.514 INFO:teuthology.orchestra.run.trial174.stdout:Upgrading: 2026-02-25T14:26:07.514 INFO:teuthology.orchestra.run.trial174.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-25T14:26:07.514 INFO:teuthology.orchestra.run.trial174.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T14:26:07.515 INFO:teuthology.orchestra.run.trial174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-25T14:26:07.516 INFO:teuthology.orchestra.run.trial174.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout:Installing weak dependencies: 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:26:07.517 INFO:teuthology.orchestra.run.trial174.stdout:Install 32 Packages 2026-02-25T14:26:07.518 INFO:teuthology.orchestra.run.trial174.stdout:Upgrade 2 Packages 2026-02-25T14:26:07.518 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:07.518 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 78 M 2026-02-25T14:26:07.518 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:26:07.714 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:26:07.716 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:26:07.716 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:26:07.716 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:26:07.716 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:26:07.716 INFO:teuthology.orchestra.run.trial167.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout:Upgrading: 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T14:26:07.717 INFO:teuthology.orchestra.run.trial167.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T14:26:07.718 INFO:teuthology.orchestra.run.trial167.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout:Installing weak dependencies: 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:07.719 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:26:07.720 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:26:07.720 INFO:teuthology.orchestra.run.trial167.stdout:Install 32 Packages 2026-02-25T14:26:07.720 INFO:teuthology.orchestra.run.trial167.stdout:Upgrade 2 Packages 2026-02-25T14:26:07.720 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:07.720 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 78 M 2026-02-25T14:26:07.721 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:26:09.721 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-25T14:26:10.330 INFO:teuthology.orchestra.run.trial155.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 1.8 MB/s | 5.9 MB 00:03 2026-02-25T14:26:10.390 INFO:teuthology.orchestra.run.trial155.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 413 kB/s | 25 kB 00:00 2026-02-25T14:26:10.823 INFO:teuthology.orchestra.run.trial155.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 2.0 MB/s | 869 kB 00:00 2026-02-25T14:26:10.941 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout:Upgrading: 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-25T14:26:10.943 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T14:26:10.944 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-25T14:26:10.945 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout:Installing weak dependencies: 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:26:10.946 INFO:teuthology.orchestra.run.trial078.stdout:Install 32 Packages 2026-02-25T14:26:10.947 INFO:teuthology.orchestra.run.trial078.stdout:Upgrade 2 Packages 2026-02-25T14:26:10.947 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:10.947 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 78 M 2026-02-25T14:26:10.947 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:26:10.949 INFO:teuthology.orchestra.run.trial155.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.9 MB/s | 250 kB 00:00 2026-02-25T14:26:11.316 INFO:teuthology.orchestra.run.trial167.stdout:(1/34): ceph-common-20.2.0-681.g36d388f2.el9.x8 7.0 MB/s | 24 MB 00:03 2026-02-25T14:26:11.370 INFO:teuthology.orchestra.run.trial167.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 465 kB/s | 25 kB 00:00 2026-02-25T14:26:11.494 INFO:teuthology.orchestra.run.trial167.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 6.9 MB/s | 869 kB 00:00 2026-02-25T14:26:11.554 INFO:teuthology.orchestra.run.trial167.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 4.1 MB/s | 250 kB 00:00 2026-02-25T14:26:11.888 INFO:teuthology.orchestra.run.trial167.stdout:(5/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 1.5 MB/s | 5.9 MB 00:03 2026-02-25T14:26:11.958 INFO:teuthology.orchestra.run.trial167.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 642 kB/s | 45 kB 00:00 2026-02-25T14:26:12.163 INFO:teuthology.orchestra.run.trial167.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 855 kB/s | 175 kB 00:00 2026-02-25T14:26:12.233 INFO:teuthology.orchestra.run.trial167.stdout:(8/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 9.4 MB/s | 6.4 MB 00:00 2026-02-25T14:26:12.277 INFO:teuthology.orchestra.run.trial167.stdout:(9/34): python3-cephfs-20.2.0-681.g36d388f2.el9 1.4 MB/s | 163 kB 00:00 2026-02-25T14:26:12.491 INFO:teuthology.orchestra.run.trial167.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 306 kB 00:00 2026-02-25T14:26:12.606 INFO:teuthology.orchestra.run.trial167.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 865 kB/s | 99 kB 00:00 2026-02-25T14:26:12.660 INFO:teuthology.orchestra.run.trial167.stdout:(12/34): python3-rados-20.2.0-681.g36d388f2.el9 759 kB/s | 323 kB 00:00 2026-02-25T14:26:12.670 INFO:teuthology.orchestra.run.trial167.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 524 kB/s | 33 kB 00:00 2026-02-25T14:26:12.720 INFO:teuthology.orchestra.run.trial167.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 2.0 MB/s | 104 kB 00:00 2026-02-25T14:26:12.723 INFO:teuthology.orchestra.run.trial167.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.4 MB/s | 93 kB 00:00 2026-02-25T14:26:12.752 INFO:teuthology.orchestra.run.trial167.stdout:(16/34): libnbd-1.20.3-4.el9.x86_64.rpm 5.0 MB/s | 164 kB 00:00 2026-02-25T14:26:12.756 INFO:teuthology.orchestra.run.trial167.stdout:(17/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.9 MB/s | 160 kB 00:00 2026-02-25T14:26:12.783 INFO:teuthology.orchestra.run.trial167.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 23 MB/s | 662 kB 00:00 2026-02-25T14:26:12.784 INFO:teuthology.orchestra.run.trial167.stdout:(19/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 45 kB 00:00 2026-02-25T14:26:12.815 INFO:teuthology.orchestra.run.trial167.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.1 MB/s | 292 kB 00:00 2026-02-25T14:26:12.816 INFO:teuthology.orchestra.run.trial167.stdout:(21/34): qatlib-25.08.0-2.el9.x86_64.rpm 7.4 MB/s | 240 kB 00:00 2026-02-25T14:26:12.839 INFO:teuthology.orchestra.run.trial167.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.8 MB/s | 66 kB 00:00 2026-02-25T14:26:12.839 INFO:teuthology.orchestra.run.trial167.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.5 MB/s | 37 kB 00:00 2026-02-25T14:26:12.873 INFO:teuthology.orchestra.run.trial167.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 8.9 MB/s | 308 kB 00:00 2026-02-25T14:26:12.877 INFO:teuthology.orchestra.run.trial167.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 7.2 MB/s | 25 kB 00:00 2026-02-25T14:26:12.880 INFO:teuthology.orchestra.run.trial167.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 14 MB/s | 49 kB 00:00 2026-02-25T14:26:12.884 INFO:teuthology.orchestra.run.trial167.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 20 MB/s | 67 kB 00:00 2026-02-25T14:26:12.890 INFO:teuthology.orchestra.run.trial167.stdout:(28/34): libarrow-9.0.0-15.el9.x86_64.rpm 88 MB/s | 4.4 MB 00:00 2026-02-25T14:26:12.895 INFO:teuthology.orchestra.run.trial167.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 75 MB/s | 838 kB 00:00 2026-02-25T14:26:12.896 INFO:teuthology.orchestra.run.trial167.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 36 MB/s | 191 kB 00:00 2026-02-25T14:26:12.904 INFO:teuthology.orchestra.run.trial167.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 187 MB/s | 1.6 MB 00:00 2026-02-25T14:26:13.306 INFO:teuthology.orchestra.run.trial167.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 7.1 MB/s | 2.8 MB 00:00 2026-02-25T14:26:13.522 INFO:teuthology.orchestra.run.trial155.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 2.5 MB/s | 6.4 MB 00:02 2026-02-25T14:26:13.581 INFO:teuthology.orchestra.run.trial155.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 759 kB/s | 45 kB 00:00 2026-02-25T14:26:13.703 INFO:teuthology.orchestra.run.trial155.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 1.4 MB/s | 175 kB 00:00 2026-02-25T14:26:13.769 INFO:teuthology.orchestra.run.trial155.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 2.4 MB/s | 163 kB 00:00 2026-02-25T14:26:13.906 INFO:teuthology.orchestra.run.trial155.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 2.3 MB/s | 323 kB 00:00 2026-02-25T14:26:14.051 INFO:teuthology.orchestra.run.trial155.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 2.1 MB/s | 306 kB 00:00 2026-02-25T14:26:14.121 INFO:teuthology.orchestra.run.trial155.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 99 kB 00:00 2026-02-25T14:26:14.687 INFO:teuthology.orchestra.run.trial155.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 59 kB/s | 33 kB 00:00 2026-02-25T14:26:15.071 INFO:teuthology.orchestra.run.trial167.stdout:(33/34): librados2-20.2.0-681.g36d388f2.el9.x86 1.6 MB/s | 3.5 MB 00:02 2026-02-25T14:26:15.341 INFO:teuthology.orchestra.run.trial155.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 142 kB/s | 93 kB 00:00 2026-02-25T14:26:15.382 INFO:teuthology.orchestra.run.trial155.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 2.5 MB/s | 104 kB 00:00 2026-02-25T14:26:15.400 INFO:teuthology.orchestra.run.trial155.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 8.9 MB/s | 164 kB 00:00 2026-02-25T14:26:15.412 INFO:teuthology.orchestra.run.trial155.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 13 MB/s | 160 kB 00:00 2026-02-25T14:26:15.421 INFO:teuthology.orchestra.run.trial155.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.7 MB/s | 45 kB 00:00 2026-02-25T14:26:15.443 INFO:teuthology.orchestra.run.trial155.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 31 MB/s | 662 kB 00:00 2026-02-25T14:26:15.454 INFO:teuthology.orchestra.run.trial155.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 25 MB/s | 292 kB 00:00 2026-02-25T14:26:15.465 INFO:teuthology.orchestra.run.trial155.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 21 MB/s | 240 kB 00:00 2026-02-25T14:26:15.474 INFO:teuthology.orchestra.run.trial155.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 4.0 MB/s | 37 kB 00:00 2026-02-25T14:26:15.484 INFO:teuthology.orchestra.run.trial155.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.0 MB/s | 66 kB 00:00 2026-02-25T14:26:15.514 INFO:teuthology.orchestra.run.trial174.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 776 kB/s | 5.9 MB 00:07 2026-02-25T14:26:15.580 INFO:teuthology.orchestra.run.trial174.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 382 kB/s | 25 kB 00:00 2026-02-25T14:26:15.999 INFO:teuthology.orchestra.run.trial155.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 597 kB/s | 308 kB 00:00 2026-02-25T14:26:16.198 INFO:teuthology.orchestra.run.trial174.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 1.4 MB/s | 869 kB 00:00 2026-02-25T14:26:16.297 INFO:teuthology.orchestra.run.trial155.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2026-02-25T14:26:16.370 INFO:teuthology.orchestra.run.trial155.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 343 kB/s | 25 kB 00:00 2026-02-25T14:26:16.380 INFO:teuthology.orchestra.run.trial174.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.3 MB/s | 250 kB 00:00 2026-02-25T14:26:16.442 INFO:teuthology.orchestra.run.trial155.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 673 kB/s | 49 kB 00:00 2026-02-25T14:26:16.481 INFO:teuthology.orchestra.run.trial174.stdout:(5/34): ceph-radosgw-20.2.0-681.g36d388f2.el9.x 2.7 MB/s | 24 MB 00:08 2026-02-25T14:26:16.516 INFO:teuthology.orchestra.run.trial155.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 919 kB/s | 67 kB 00:00 2026-02-25T14:26:16.531 INFO:teuthology.orchestra.run.trial174.stdout:(6/34): ceph-common-20.2.0-681.g36d388f2.el9.x8 2.7 MB/s | 24 MB 00:08 2026-02-25T14:26:16.545 INFO:teuthology.orchestra.run.trial174.stdout:(7/34): python3-ceph-argparse-20.2.0-681.g36d38 699 kB/s | 45 kB 00:00 2026-02-25T14:26:16.607 INFO:teuthology.orchestra.run.trial155.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 9.0 MB/s | 838 kB 00:00 2026-02-25T14:26:16.668 INFO:teuthology.orchestra.run.trial174.stdout:(8/34): python3-ceph-common-20.2.0-681.g36d388f 1.2 MB/s | 175 kB 00:00 2026-02-25T14:26:16.683 INFO:teuthology.orchestra.run.trial174.stdout:(9/34): python3-cephfs-20.2.0-681.g36d388f2.el9 1.2 MB/s | 163 kB 00:00 2026-02-25T14:26:16.683 INFO:teuthology.orchestra.run.trial155.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2026-02-25T14:26:16.789 INFO:teuthology.orchestra.run.trial155.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2026-02-25T14:26:16.930 INFO:teuthology.orchestra.run.trial174.stdout:(10/34): python3-rados-20.2.0-681.g36d388f2.el9 1.2 MB/s | 323 kB 00:00 2026-02-25T14:26:17.002 INFO:teuthology.orchestra.run.trial174.stdout:(11/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 958 kB/s | 306 kB 00:00 2026-02-25T14:26:17.048 INFO:teuthology.orchestra.run.trial174.stdout:(12/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 837 kB/s | 99 kB 00:00 2026-02-25T14:26:17.357 INFO:teuthology.orchestra.run.trial078.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 974 kB/s | 5.9 MB 00:06 2026-02-25T14:26:17.409 INFO:teuthology.orchestra.run.trial174.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 81 kB/s | 33 kB 00:00 2026-02-25T14:26:17.422 INFO:teuthology.orchestra.run.trial078.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 384 kB/s | 25 kB 00:00 2026-02-25T14:26:17.613 INFO:teuthology.orchestra.run.trial174.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 165 kB/s | 93 kB 00:00 2026-02-25T14:26:17.809 INFO:teuthology.orchestra.run.trial174.stdout:(15/34): boost-program-options-1.75.0-13.el9.x8 260 kB/s | 104 kB 00:00 2026-02-25T14:26:17.986 INFO:teuthology.orchestra.run.trial174.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 906 kB/s | 160 kB 00:00 2026-02-25T14:26:18.066 INFO:teuthology.orchestra.run.trial174.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 362 kB/s | 164 kB 00:00 2026-02-25T14:26:18.074 INFO:teuthology.orchestra.run.trial174.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 512 kB/s | 45 kB 00:00 2026-02-25T14:26:18.094 INFO:teuthology.orchestra.run.trial078.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 1.3 MB/s | 869 kB 00:00 2026-02-25T14:26:18.231 INFO:teuthology.orchestra.run.trial174.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2026-02-25T14:26:18.265 INFO:teuthology.orchestra.run.trial155.stdout:(31/34): librados2-20.2.0-681.g36d388f2.el9.x86 2.4 MB/s | 3.5 MB 00:01 2026-02-25T14:26:18.323 INFO:teuthology.orchestra.run.trial155.stdout:(32/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 2.1 MB/s | 24 MB 00:11 2026-02-25T14:26:18.331 INFO:teuthology.orchestra.run.trial174.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 2.3 MB/s | 240 kB 00:00 2026-02-25T14:26:18.335 INFO:teuthology.orchestra.run.trial174.stdout:(21/34): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2026-02-25T14:26:18.337 INFO:teuthology.orchestra.run.trial078.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.0 MB/s | 250 kB 00:00 2026-02-25T14:26:18.412 INFO:teuthology.orchestra.run.trial174.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 460 kB/s | 37 kB 00:00 2026-02-25T14:26:18.417 INFO:teuthology.orchestra.run.trial174.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 805 kB/s | 66 kB 00:00 2026-02-25T14:26:18.562 INFO:teuthology.orchestra.run.trial174.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.0 MB/s | 308 kB 00:00 2026-02-25T14:26:18.586 INFO:teuthology.orchestra.run.trial174.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.0 MB/s | 25 kB 00:00 2026-02-25T14:26:18.611 INFO:teuthology.orchestra.run.trial174.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-25T14:26:18.635 INFO:teuthology.orchestra.run.trial174.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2026-02-25T14:26:18.658 INFO:teuthology.orchestra.run.trial174.stdout:(28/34): libarrow-9.0.0-15.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2026-02-25T14:26:18.683 INFO:teuthology.orchestra.run.trial174.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 17 MB/s | 838 kB 00:00 2026-02-25T14:26:18.685 INFO:teuthology.orchestra.run.trial174.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 7.2 MB/s | 191 kB 00:00 2026-02-25T14:26:18.759 INFO:teuthology.orchestra.run.trial174.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2026-02-25T14:26:18.849 INFO:teuthology.orchestra.run.trial174.stdout:(32/34): librgw2-20.2.0-681.g36d388f2.el9.x86_6 2.6 MB/s | 6.4 MB 00:02 2026-02-25T14:26:18.933 INFO:teuthology.orchestra.run.trial078.stdout:(5/34): ceph-radosgw-20.2.0-681.g36d388f2.el9.x 3.0 MB/s | 24 MB 00:07 2026-02-25T14:26:18.996 INFO:teuthology.orchestra.run.trial078.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 723 kB/s | 45 kB 00:00 2026-02-25T14:26:19.058 INFO:teuthology.orchestra.run.trial078.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 2.7 MB/s | 175 kB 00:00 2026-02-25T14:26:19.125 INFO:teuthology.orchestra.run.trial078.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 2.4 MB/s | 163 kB 00:00 2026-02-25T14:26:19.216 INFO:teuthology.orchestra.run.trial155.stdout:(33/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 3.0 MB/s | 2.8 MB 00:00 2026-02-25T14:26:19.262 INFO:teuthology.orchestra.run.trial078.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 2.3 MB/s | 323 kB 00:00 2026-02-25T14:26:19.402 INFO:teuthology.orchestra.run.trial078.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 2.1 MB/s | 306 kB 00:00 2026-02-25T14:26:19.467 INFO:teuthology.orchestra.run.trial078.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.5 MB/s | 99 kB 00:00 2026-02-25T14:26:19.531 INFO:teuthology.orchestra.run.trial078.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 517 kB/s | 33 kB 00:00 2026-02-25T14:26:19.574 INFO:teuthology.orchestra.run.trial078.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 2.1 MB/s | 93 kB 00:00 2026-02-25T14:26:19.746 INFO:teuthology.orchestra.run.trial078.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 607 kB/s | 104 kB 00:00 2026-02-25T14:26:19.790 INFO:teuthology.orchestra.run.trial078.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 3.6 MB/s | 164 kB 00:00 2026-02-25T14:26:19.815 INFO:teuthology.orchestra.run.trial078.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.4 MB/s | 160 kB 00:00 2026-02-25T14:26:19.837 INFO:teuthology.orchestra.run.trial078.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-25T14:26:19.884 INFO:teuthology.orchestra.run.trial078.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-25T14:26:19.908 INFO:teuthology.orchestra.run.trial078.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-25T14:26:19.931 INFO:teuthology.orchestra.run.trial078.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 9.9 MB/s | 240 kB 00:00 2026-02-25T14:26:19.953 INFO:teuthology.orchestra.run.trial078.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-25T14:26:19.976 INFO:teuthology.orchestra.run.trial078.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-25T14:26:20.064 INFO:teuthology.orchestra.run.trial078.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.4 MB/s | 308 kB 00:00 2026-02-25T14:26:21.029 INFO:teuthology.orchestra.run.trial078.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2026-02-25T14:26:21.047 INFO:teuthology.orchestra.run.trial078.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.4 MB/s | 25 kB 00:00 2026-02-25T14:26:21.067 INFO:teuthology.orchestra.run.trial078.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 2.3 MB/s | 49 kB 00:00 2026-02-25T14:26:21.091 INFO:teuthology.orchestra.run.trial078.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2026-02-25T14:26:21.164 INFO:teuthology.orchestra.run.trial174.stdout:(33/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 1.2 MB/s | 2.8 MB 00:02 2026-02-25T14:26:21.214 INFO:teuthology.orchestra.run.trial174.stdout:(34/34): librados2-20.2.0-681.g36d388f2.el9.x86 1.4 MB/s | 3.5 MB 00:02 2026-02-25T14:26:21.218 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:26:21.218 INFO:teuthology.orchestra.run.trial174.stdout:Total 5.7 MB/s | 78 MB 00:13 2026-02-25T14:26:21.268 INFO:teuthology.orchestra.run.trial078.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.6 MB/s | 838 kB 00:00 2026-02-25T14:26:21.306 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:26:21.324 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:26:21.324 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:26:21.586 INFO:teuthology.orchestra.run.trial078.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 601 kB/s | 191 kB 00:00 2026-02-25T14:26:21.615 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:26:21.615 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:26:21.858 INFO:teuthology.orchestra.run.trial078.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2026-02-25T14:26:21.951 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:26:21.962 INFO:teuthology.orchestra.run.trial174.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-25T14:26:22.117 INFO:teuthology.orchestra.run.trial174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-25T14:26:22.118 INFO:teuthology.orchestra.run.trial167.stdout:(34/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.7 MB/s | 24 MB 00:14 2026-02-25T14:26:22.121 INFO:teuthology.orchestra.run.trial174.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:22.122 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:26:22.122 INFO:teuthology.orchestra.run.trial167.stdout:Total 5.4 MB/s | 78 MB 00:14 2026-02-25T14:26:22.152 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:22.189 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-25T14:26:22.190 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:22.202 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:22.212 INFO:teuthology.orchestra.run.trial174.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-25T14:26:22.213 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:26:22.215 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-25T14:26:22.218 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-25T14:26:22.222 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-25T14:26:22.230 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:26:22.230 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:26:22.231 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-25T14:26:22.243 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-25T14:26:22.244 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:22.258 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:22.290 INFO:teuthology.orchestra.run.trial174.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-25T14:26:22.294 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-25T14:26:22.301 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-25T14:26:22.303 INFO:teuthology.orchestra.run.trial174.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-25T14:26:22.307 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-25T14:26:22.429 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-25T14:26:22.430 INFO:teuthology.orchestra.run.trial174.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-25T14:26:22.455 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-25T14:26:22.458 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-25T14:26:22.464 INFO:teuthology.orchestra.run.trial174.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-25T14:26:22.522 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:26:22.522 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:26:22.741 INFO:teuthology.orchestra.run.trial174.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-25T14:26:22.742 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-25T14:26:22.758 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-25T14:26:22.762 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-25T14:26:22.767 INFO:teuthology.orchestra.run.trial174.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-25T14:26:22.770 INFO:teuthology.orchestra.run.trial174.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-25T14:26:22.771 INFO:teuthology.orchestra.run.trial174.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-25T14:26:22.787 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-25T14:26:22.790 INFO:teuthology.orchestra.run.trial174.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-25T14:26:22.821 INFO:teuthology.orchestra.run.trial174.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-25T14:26:22.823 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-25T14:26:22.864 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:26:22.875 INFO:teuthology.orchestra.run.trial167.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-25T14:26:22.975 INFO:teuthology.orchestra.run.trial078.stdout:(31/34): librados2-20.2.0-681.g36d388f2.el9.x86 3.1 MB/s | 3.5 MB 00:01 2026-02-25T14:26:23.029 INFO:teuthology.orchestra.run.trial167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-25T14:26:23.034 INFO:teuthology.orchestra.run.trial167.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:23.062 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:23.098 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-25T14:26:23.099 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:23.109 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:23.110 INFO:teuthology.orchestra.run.trial078.stdout:(32/34): librgw2-20.2.0-681.g36d388f2.el9.x86_6 1.3 MB/s | 6.4 MB 00:04 2026-02-25T14:26:23.118 INFO:teuthology.orchestra.run.trial167.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-25T14:26:23.120 INFO:teuthology.orchestra.run.trial167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-25T14:26:23.123 INFO:teuthology.orchestra.run.trial167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-25T14:26:23.128 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-25T14:26:23.136 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-25T14:26:23.148 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-25T14:26:23.149 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:23.162 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:23.193 INFO:teuthology.orchestra.run.trial167.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-25T14:26:23.199 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-25T14:26:23.205 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-25T14:26:23.207 INFO:teuthology.orchestra.run.trial167.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-25T14:26:23.212 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-25T14:26:23.334 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-25T14:26:23.336 INFO:teuthology.orchestra.run.trial167.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-25T14:26:23.362 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-25T14:26:23.364 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-25T14:26:23.370 INFO:teuthology.orchestra.run.trial167.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-25T14:26:23.647 INFO:teuthology.orchestra.run.trial167.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-25T14:26:23.648 INFO:teuthology.orchestra.run.trial167.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-25T14:26:23.664 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-25T14:26:23.669 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-25T14:26:23.674 INFO:teuthology.orchestra.run.trial167.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-25T14:26:23.676 INFO:teuthology.orchestra.run.trial167.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-25T14:26:23.677 INFO:teuthology.orchestra.run.trial167.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-25T14:26:23.694 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-25T14:26:23.698 INFO:teuthology.orchestra.run.trial167.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-25T14:26:23.726 INFO:teuthology.orchestra.run.trial078.stdout:(33/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 3.8 MB/s | 2.8 MB 00:00 2026-02-25T14:26:23.730 INFO:teuthology.orchestra.run.trial167.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-25T14:26:23.732 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-25T14:26:23.897 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:23.900 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:24.195 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:24.199 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-25T14:26:24.242 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-25T14:26:24.243 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T14:26:24.243 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T14:26:24.243 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:24.246 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:24.350 INFO:teuthology.orchestra.run.trial155.stdout:(34/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 24 MB 00:17 2026-02-25T14:26:24.353 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:26:24.353 INFO:teuthology.orchestra.run.trial155.stdout:Total 4.4 MB/s | 78 MB 00:17 2026-02-25T14:26:24.440 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:26:24.457 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:26:24.457 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:26:24.747 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:26:24.747 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:26:24.805 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:24.808 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:25.080 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:26:25.092 INFO:teuthology.orchestra.run.trial155.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-25T14:26:25.107 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:25.111 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-25T14:26:25.152 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-25T14:26:25.152 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T14:26:25.152 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T14:26:25.152 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:25.156 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:25.245 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-25T14:26:25.251 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:25.279 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:25.315 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-25T14:26:25.316 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:25.328 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:25.340 INFO:teuthology.orchestra.run.trial155.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-25T14:26:25.343 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-25T14:26:25.347 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-25T14:26:25.351 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-25T14:26:25.360 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-25T14:26:25.371 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-25T14:26:25.372 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:25.386 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:25.421 INFO:teuthology.orchestra.run.trial155.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-25T14:26:25.426 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-25T14:26:25.432 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-25T14:26:25.434 INFO:teuthology.orchestra.run.trial155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-25T14:26:25.438 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-25T14:26:25.561 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-25T14:26:25.562 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-25T14:26:25.588 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-25T14:26:25.590 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-25T14:26:25.597 INFO:teuthology.orchestra.run.trial155.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-25T14:26:25.876 INFO:teuthology.orchestra.run.trial155.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-25T14:26:25.877 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-25T14:26:25.893 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-25T14:26:25.898 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-25T14:26:25.903 INFO:teuthology.orchestra.run.trial155.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-25T14:26:25.906 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-25T14:26:25.906 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-25T14:26:25.924 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-25T14:26:25.927 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-25T14:26:25.961 INFO:teuthology.orchestra.run.trial155.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-25T14:26:25.962 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-25T14:26:27.042 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:27.044 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:27.346 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:27.350 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-25T14:26:27.394 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-25T14:26:27.394 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T14:26:27.394 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T14:26:27.394 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:27.398 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:28.759 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:28.759 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /sys 2026-02-25T14:26:28.759 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /proc 2026-02-25T14:26:28.759 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /mnt 2026-02-25T14:26:28.759 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /var/tmp 2026-02-25T14:26:28.759 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /home 2026-02-25T14:26:28.759 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /root 2026-02-25T14:26:28.760 INFO:teuthology.orchestra.run.trial174.stdout:skipping the directory /tmp 2026-02-25T14:26:28.760 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:29.641 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:29.641 INFO:teuthology.orchestra.run.trial167.stdout:skipping the directory /sys 2026-02-25T14:26:29.641 INFO:teuthology.orchestra.run.trial167.stdout:skipping the directory /proc 2026-02-25T14:26:29.641 INFO:teuthology.orchestra.run.trial167.stdout:skipping the directory /mnt 2026-02-25T14:26:29.642 INFO:teuthology.orchestra.run.trial167.stdout:skipping the directory /var/tmp 2026-02-25T14:26:29.642 INFO:teuthology.orchestra.run.trial167.stdout:skipping the directory /home 2026-02-25T14:26:29.642 INFO:teuthology.orchestra.run.trial167.stdout:skipping the directory /root 2026-02-25T14:26:29.642 INFO:teuthology.orchestra.run.trial167.stdout:skipping the directory /tmp 2026-02-25T14:26:29.642 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:29.789 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-25T14:26:29.812 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-25T14:26:29.812 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:26:29.812 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T14:26:29.812 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:26:29.812 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:26:29.812 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:29.814 INFO:teuthology.orchestra.run.trial174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-25T14:26:29.826 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-25T14:26:29.826 INFO:teuthology.orchestra.run.trial174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:29.884 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:29.884 INFO:teuthology.orchestra.run.trial174.stdout:Creating group 'qat' with GID 992. 2026-02-25T14:26:29.884 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:30.210 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-25T14:26:30.211 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-25T14:26:30.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-25T14:26:30.213 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-25T14:26:30.279 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:30.279 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout:Upgraded: 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T14:26:30.280 INFO:teuthology.orchestra.run.trial174.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T14:26:30.281 INFO:teuthology.orchestra.run.trial174.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T14:26:30.282 INFO:teuthology.orchestra.run.trial174.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T14:26:30.283 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:30.283 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:26:30.321 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-test 2026-02-25T14:26:30.645 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:00:24 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:26:30.667 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-25T14:26:30.691 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-25T14:26:30.692 INFO:teuthology.orchestra.run.trial167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:26:30.692 INFO:teuthology.orchestra.run.trial167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T14:26:30.692 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:26:30.692 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:26:30.692 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:30.694 INFO:teuthology.orchestra.run.trial167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-25T14:26:30.706 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-25T14:26:30.706 INFO:teuthology.orchestra.run.trial167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:30.728 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:26:30.729 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:26:30.729 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:26:30.729 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:26:30.729 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:26:30.729 INFO:teuthology.orchestra.run.trial174.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-25T14:26:30.729 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:26:30.729 INFO:teuthology.orchestra.run.trial174.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout:Install 5 Packages 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 85 M 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 365 M 2026-02-25T14:26:30.730 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:26:30.762 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:30.762 INFO:teuthology.orchestra.run.trial167.stdout:Creating group 'qat' with GID 992. 2026-02-25T14:26:30.762 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:30.841 INFO:teuthology.orchestra.run.trial174.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.2 MB/s | 233 kB 00:00 2026-02-25T14:26:30.871 INFO:teuthology.orchestra.run.trial174.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 9.8 MB/s | 303 kB 00:00 2026-02-25T14:26:30.898 INFO:teuthology.orchestra.run.trial174.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.3 MB/s | 64 kB 00:00 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-25T14:26:31.094 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-25T14:26:31.095 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:31.096 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-25T14:26:31.097 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-25T14:26:31.161 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:31.161 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:31.161 INFO:teuthology.orchestra.run.trial167.stdout:Upgraded: 2026-02-25T14:26:31.161 INFO:teuthology.orchestra.run.trial167.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.161 INFO:teuthology.orchestra.run.trial167.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T14:26:31.162 INFO:teuthology.orchestra.run.trial167.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.163 INFO:teuthology.orchestra.run.trial167.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:31.164 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:26:31.206 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-test 2026-02-25T14:26:31.250 INFO:teuthology.orchestra.run.trial174.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 354 kB/s | 164 kB 00:00 2026-02-25T14:26:31.523 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:00:25 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:26:31.606 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:26:31.607 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:26:31.607 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:26:31.607 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:26:31.607 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:26:31.607 INFO:teuthology.orchestra.run.trial167.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-25T14:26:31.607 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:26:31.607 INFO:teuthology.orchestra.run.trial167.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-25T14:26:31.607 INFO:teuthology.orchestra.run.trial167.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout:Install 5 Packages 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 85 M 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 365 M 2026-02-25T14:26:31.608 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:26:31.863 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:31.863 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /sys 2026-02-25T14:26:31.864 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /proc 2026-02-25T14:26:31.864 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /mnt 2026-02-25T14:26:31.864 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /var/tmp 2026-02-25T14:26:31.864 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /home 2026-02-25T14:26:31.864 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /root 2026-02-25T14:26:31.864 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /tmp 2026-02-25T14:26:31.864 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:32.367 INFO:teuthology.orchestra.run.trial167.stdout:(1/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 360 kB/s | 164 kB 00:00 2026-02-25T14:26:32.680 INFO:teuthology.orchestra.run.trial167.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 303 kB/s | 233 kB 00:00 2026-02-25T14:26:32.894 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-25T14:26:32.918 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-25T14:26:32.918 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:26:32.918 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T14:26:32.918 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:26:32.918 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:26:32.918 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:32.920 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-25T14:26:32.932 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-25T14:26:32.932 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:32.987 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:32.987 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'qat' with GID 992. 2026-02-25T14:26:32.987 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:33.159 INFO:teuthology.orchestra.run.trial167.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 383 kB/s | 303 kB 00:00 2026-02-25T14:26:33.300 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-25T14:26:33.300 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:33.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-25T14:26:33.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-25T14:26:33.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-25T14:26:33.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-25T14:26:33.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-25T14:26:33.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-25T14:26:33.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-25T14:26:33.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:33.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-25T14:26:33.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-25T14:26:33.304 INFO:teuthology.orchestra.run.trial167.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2026-02-25T14:26:33.366 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:33.366 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:33.366 INFO:teuthology.orchestra.run.trial155.stdout:Upgraded: 2026-02-25T14:26:33.366 INFO:teuthology.orchestra.run.trial155.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.366 INFO:teuthology.orchestra.run.trial155.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.366 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:26:33.366 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T14:26:33.366 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T14:26:33.367 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.368 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:33.369 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T14:26:33.369 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T14:26:33.369 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T14:26:33.369 INFO:teuthology.orchestra.run.trial155.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T14:26:33.369 INFO:teuthology.orchestra.run.trial155.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T14:26:33.369 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:33.369 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:26:33.410 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-test 2026-02-25T14:26:33.723 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:28 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:26:33.807 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:26:33.808 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:26:33.808 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:26:33.808 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:26:33.808 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:26:33.808 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-25T14:26:33.808 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:26:33.808 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout:Install 5 Packages 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 85 M 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 365 M 2026-02-25T14:26:33.809 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:26:33.987 INFO:teuthology.orchestra.run.trial078.stdout:(34/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.0 MB/s | 24 MB 00:22 2026-02-25T14:26:33.989 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:26:33.989 INFO:teuthology.orchestra.run.trial078.stdout:Total 3.4 MB/s | 78 MB 00:23 2026-02-25T14:26:34.078 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:26:34.096 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:26:34.096 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:26:34.386 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:26:34.386 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:26:34.420 INFO:teuthology.orchestra.run.trial155.stdout:(1/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 298 kB/s | 164 kB 00:00 2026-02-25T14:26:34.625 INFO:teuthology.orchestra.run.trial155.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 309 kB/s | 233 kB 00:00 2026-02-25T14:26:34.719 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:26:34.730 INFO:teuthology.orchestra.run.trial078.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-25T14:26:34.883 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-25T14:26:34.887 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:34.917 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:34.955 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-25T14:26:34.956 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:34.967 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:34.976 INFO:teuthology.orchestra.run.trial078.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-25T14:26:34.978 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-25T14:26:34.981 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-25T14:26:34.985 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-25T14:26:34.994 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-25T14:26:35.006 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-25T14:26:35.006 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:35.018 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:35.050 INFO:teuthology.orchestra.run.trial078.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-25T14:26:35.054 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-25T14:26:35.060 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-25T14:26:35.062 INFO:teuthology.orchestra.run.trial078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-25T14:26:35.066 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-25T14:26:35.190 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-25T14:26:35.191 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-25T14:26:35.208 INFO:teuthology.orchestra.run.trial155.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 385 kB/s | 303 kB 00:00 2026-02-25T14:26:35.215 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-25T14:26:35.218 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-25T14:26:35.224 INFO:teuthology.orchestra.run.trial078.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-25T14:26:35.246 INFO:teuthology.orchestra.run.trial155.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2026-02-25T14:26:35.502 INFO:teuthology.orchestra.run.trial078.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-25T14:26:35.504 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-25T14:26:35.519 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-25T14:26:35.523 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-25T14:26:35.527 INFO:teuthology.orchestra.run.trial078.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-25T14:26:35.530 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-25T14:26:35.530 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-25T14:26:35.548 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-25T14:26:35.551 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-25T14:26:35.584 INFO:teuthology.orchestra.run.trial078.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-25T14:26:35.586 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-25T14:26:36.666 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:36.669 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:36.967 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-25T14:26:36.971 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-25T14:26:37.013 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-25T14:26:37.013 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T14:26:37.013 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T14:26:37.013 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:37.017 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:41.468 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:41.468 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /sys 2026-02-25T14:26:41.468 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /proc 2026-02-25T14:26:41.468 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /mnt 2026-02-25T14:26:41.468 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /var/tmp 2026-02-25T14:26:41.468 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /home 2026-02-25T14:26:41.468 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /root 2026-02-25T14:26:41.468 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /tmp 2026-02-25T14:26:41.469 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:42.499 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-25T14:26:42.523 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-25T14:26:42.523 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:26:42.523 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T14:26:42.523 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:26:42.523 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:26:42.523 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:42.525 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-25T14:26:42.537 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-25T14:26:42.537 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:42.591 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:42.591 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'qat' with GID 992. 2026-02-25T14:26:42.591 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:42.916 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-25T14:26:42.916 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-25T14:26:42.916 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-25T14:26:42.916 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-25T14:26:42.917 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-25T14:26:42.918 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-25T14:26:42.918 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-25T14:26:42.918 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-25T14:26:42.918 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-25T14:26:42.918 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-25T14:26:42.918 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-25T14:26:42.919 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-25T14:26:42.919 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-25T14:26:42.919 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-25T14:26:42.919 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-25T14:26:42.919 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-25T14:26:42.919 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-25T14:26:42.919 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-25T14:26:42.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-25T14:26:42.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-25T14:26:42.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-25T14:26:42.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-25T14:26:42.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-25T14:26:42.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-25T14:26:42.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-25T14:26:42.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-25T14:26:42.921 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-25T14:26:42.981 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout:Upgraded: 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.982 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.983 INFO:teuthology.orchestra.run.trial078.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T14:26:42.984 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T14:26:42.985 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T14:26:42.985 INFO:teuthology.orchestra.run.trial078.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T14:26:42.985 INFO:teuthology.orchestra.run.trial078.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T14:26:42.985 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:42.985 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:26:43.028 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-test 2026-02-25T14:26:43.351 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:34 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:26:43.436 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:26:43.437 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:26:43.437 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:26:43.437 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:26:43.437 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:26:43.438 INFO:teuthology.orchestra.run.trial078.stdout:Install 5 Packages 2026-02-25T14:26:43.439 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:26:43.439 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 85 M 2026-02-25T14:26:43.439 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 365 M 2026-02-25T14:26:43.439 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:26:43.661 INFO:teuthology.orchestra.run.trial078.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.4 MB/s | 233 kB 00:00 2026-02-25T14:26:43.714 INFO:teuthology.orchestra.run.trial078.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 5.7 MB/s | 303 kB 00:00 2026-02-25T14:26:43.740 INFO:teuthology.orchestra.run.trial078.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-25T14:26:43.934 INFO:teuthology.orchestra.run.trial078.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 376 kB/s | 164 kB 00:00 2026-02-25T14:26:56.476 INFO:teuthology.orchestra.run.trial167.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 3.4 MB/s | 84 MB 00:24 2026-02-25T14:26:56.477 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:26:56.477 INFO:teuthology.orchestra.run.trial167.stdout:Total 3.4 MB/s | 85 MB 00:24 2026-02-25T14:26:56.502 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:26:56.512 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:26:56.513 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:26:56.800 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:26:56.800 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:26:57.114 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:26:57.119 INFO:teuthology.orchestra.run.trial167.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T14:26:57.123 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T14:26:57.131 INFO:teuthology.orchestra.run.trial167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T14:26:57.132 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-25T14:27:00.922 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-25T14:27:00.941 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-25T14:27:01.310 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-25T14:27:01.310 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-25T14:27:01.310 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-25T14:27:01.310 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T14:27:01.311 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T14:27:01.368 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T14:27:01.368 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:01.368 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:01.368 INFO:teuthology.orchestra.run.trial167.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:01.369 INFO:teuthology.orchestra.run.trial167.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:01.369 INFO:teuthology.orchestra.run.trial167.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T14:27:01.369 INFO:teuthology.orchestra.run.trial167.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T14:27:01.369 INFO:teuthology.orchestra.run.trial167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T14:27:01.369 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:01.369 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:01.405 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph 2026-02-25T14:27:01.723 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:00:55 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:01.809 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:01.810 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:01.810 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:27:01.810 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T14:27:01.811 INFO:teuthology.orchestra.run.trial167.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T14:27:01.812 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T14:27:01.813 INFO:teuthology.orchestra.run.trial167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout:Install 40 Packages 2026-02-25T14:27:01.814 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:01.815 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 30 M 2026-02-25T14:27:01.815 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 100 M 2026-02-25T14:27:01.815 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:02.453 INFO:teuthology.orchestra.run.trial167.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 20 kB/s | 6.5 kB 00:00 2026-02-25T14:27:02.782 INFO:teuthology.orchestra.run.trial174.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 2.6 MB/s | 84 MB 00:31 2026-02-25T14:27:02.783 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:02.784 INFO:teuthology.orchestra.run.trial174.stdout:Total 2.6 MB/s | 85 MB 00:32 2026-02-25T14:27:02.807 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:02.817 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:02.817 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:02.927 INFO:teuthology.orchestra.run.trial167.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 1.2 MB/s | 961 kB 00:00 2026-02-25T14:27:03.107 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:03.107 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:03.348 INFO:teuthology.orchestra.run.trial167.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.9 MB/s | 2.3 MB 00:01 2026-02-25T14:27:03.422 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:03.428 INFO:teuthology.orchestra.run.trial174.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T14:27:03.432 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T14:27:03.440 INFO:teuthology.orchestra.run.trial174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T14:27:03.440 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-25T14:27:03.477 INFO:teuthology.orchestra.run.trial167.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 2.2 MB/s | 290 kB 00:00 2026-02-25T14:27:04.055 INFO:teuthology.orchestra.run.trial167.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-25T14:27:04.293 INFO:teuthology.orchestra.run.trial167.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 304 kB/s | 72 kB 00:00 2026-02-25T14:27:04.398 INFO:teuthology.orchestra.run.trial167.stdout:(7/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 2.6 MB/s | 5.1 MB 00:01 2026-02-25T14:27:04.688 INFO:teuthology.orchestra.run.trial167.stdout:(8/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 641 kB/s | 253 kB 00:00 2026-02-25T14:27:04.925 INFO:teuthology.orchestra.run.trial167.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 449 kB/s | 106 kB 00:00 2026-02-25T14:27:05.165 INFO:teuthology.orchestra.run.trial167.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 565 kB/s | 135 kB 00:00 2026-02-25T14:27:05.480 INFO:teuthology.orchestra.run.trial167.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 476 kB/s | 150 kB 00:00 2026-02-25T14:27:05.718 INFO:teuthology.orchestra.run.trial167.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 532 kB/s | 126 kB 00:00 2026-02-25T14:27:06.074 INFO:teuthology.orchestra.run.trial155.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 2.6 MB/s | 84 MB 00:32 2026-02-25T14:27:06.075 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:06.075 INFO:teuthology.orchestra.run.trial155.stdout:Total 2.6 MB/s | 85 MB 00:32 2026-02-25T14:27:06.099 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:06.110 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:06.110 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:06.113 INFO:teuthology.orchestra.run.trial167.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 551 kB/s | 218 kB 00:00 2026-02-25T14:27:06.400 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:06.401 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:06.429 INFO:teuthology.orchestra.run.trial167.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 576 kB/s | 182 kB 00:00 2026-02-25T14:27:06.717 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:06.723 INFO:teuthology.orchestra.run.trial155.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T14:27:06.727 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T14:27:06.735 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T14:27:06.736 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-25T14:27:06.823 INFO:teuthology.orchestra.run.trial167.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 674 kB/s | 266 kB 00:00 2026-02-25T14:27:07.187 INFO:teuthology.orchestra.run.trial167.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 678 kB/s | 246 kB 00:00 2026-02-25T14:27:07.267 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-25T14:27:07.285 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-25T14:27:07.367 INFO:teuthology.orchestra.run.trial167.stdout:(17/40): python3-cryptography-36.0.1-5.el9.x86_ 430 kB/s | 1.2 MB 00:02 2026-02-25T14:27:07.443 INFO:teuthology.orchestra.run.trial167.stdout:(18/40): lua-5.4.4-4.el9.x86_64.rpm 735 kB/s | 188 kB 00:00 2026-02-25T14:27:07.621 INFO:teuthology.orchestra.run.trial167.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 433 kB/s | 77 kB 00:00 2026-02-25T14:27:07.622 INFO:teuthology.orchestra.run.trial167.stdout:(20/40): python3-libstoragemgmt-1.10.1-1.el9.x8 693 kB/s | 177 kB 00:00 2026-02-25T14:27:07.637 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-25T14:27:07.637 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-25T14:27:07.637 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-25T14:27:07.637 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T14:27:07.637 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T14:27:07.642 INFO:teuthology.orchestra.run.trial167.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 22 kB 00:00 2026-02-25T14:27:07.671 INFO:teuthology.orchestra.run.trial167.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 5.1 MB/s | 151 kB 00:00 2026-02-25T14:27:07.674 INFO:teuthology.orchestra.run.trial167.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 8.2 MB/s | 29 kB 00:00 2026-02-25T14:27:07.678 INFO:teuthology.orchestra.run.trial167.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 17 MB/s | 60 kB 00:00 2026-02-25T14:27:07.682 INFO:teuthology.orchestra.run.trial167.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 12 MB/s | 43 kB 00:00 2026-02-25T14:27:07.688 INFO:teuthology.orchestra.run.trial167.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 25 MB/s | 173 kB 00:00 2026-02-25T14:27:07.696 INFO:teuthology.orchestra.run.trial167.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 51 MB/s | 358 kB 00:00 2026-02-25T14:27:07.697 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T14:27:07.697 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:07.697 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:07.697 INFO:teuthology.orchestra.run.trial174.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:07.697 INFO:teuthology.orchestra.run.trial174.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:07.698 INFO:teuthology.orchestra.run.trial174.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T14:27:07.698 INFO:teuthology.orchestra.run.trial174.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T14:27:07.698 INFO:teuthology.orchestra.run.trial174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T14:27:07.698 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:07.698 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:07.699 INFO:teuthology.orchestra.run.trial167.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.1 MB/s | 11 kB 00:00 2026-02-25T14:27:07.703 INFO:teuthology.orchestra.run.trial167.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 5.1 MB/s | 18 kB 00:00 2026-02-25T14:27:07.706 INFO:teuthology.orchestra.run.trial167.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 6.6 MB/s | 23 kB 00:00 2026-02-25T14:27:07.710 INFO:teuthology.orchestra.run.trial167.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 5.7 MB/s | 20 kB 00:00 2026-02-25T14:27:07.713 INFO:teuthology.orchestra.run.trial167.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 5.6 MB/s | 19 kB 00:00 2026-02-25T14:27:07.717 INFO:teuthology.orchestra.run.trial167.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 7.5 MB/s | 26 kB 00:00 2026-02-25T14:27:07.720 INFO:teuthology.orchestra.run.trial167.stdout:(34/40): python3-more-itertools-8.12.0-2.el9.no 21 MB/s | 79 kB 00:00 2026-02-25T14:27:07.721 INFO:teuthology.orchestra.run.trial167.stdout:(35/40): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2026-02-25T14:27:07.724 INFO:teuthology.orchestra.run.trial167.stdout:(36/40): python3-portend-3.1.0-2.el9.noarch.rpm 4.7 MB/s | 16 kB 00:00 2026-02-25T14:27:07.725 INFO:teuthology.orchestra.run.trial167.stdout:(37/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 25 MB/s | 90 kB 00:00 2026-02-25T14:27:07.728 INFO:teuthology.orchestra.run.trial167.stdout:(38/40): python3-tempora-5.0.0-2.el9.noarch.rpm 9.9 MB/s | 36 kB 00:00 2026-02-25T14:27:07.729 INFO:teuthology.orchestra.run.trial167.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 5.0 MB/s | 20 kB 00:00 2026-02-25T14:27:07.730 INFO:teuthology.orchestra.run.trial078.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 3.5 MB/s | 84 MB 00:24 2026-02-25T14:27:07.731 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:07.732 INFO:teuthology.orchestra.run.trial078.stdout:Total 3.5 MB/s | 85 MB 00:24 2026-02-25T14:27:07.734 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph 2026-02-25T14:27:07.758 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:07.768 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:07.768 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:07.786 INFO:teuthology.orchestra.run.trial167.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 3.5 MB/s | 17 MB 00:04 2026-02-25T14:27:07.788 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:07.789 INFO:teuthology.orchestra.run.trial167.stdout:Total 5.1 MB/s | 30 MB 00:05 2026-02-25T14:27:07.933 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:07.950 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:07.951 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:08.055 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:02 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:08.056 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:08.056 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:08.096 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:08.096 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:08.139 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-25T14:27:08.141 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T14:27:08.142 INFO:teuthology.orchestra.run.trial174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T14:27:08.143 INFO:teuthology.orchestra.run.trial174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T14:27:08.144 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:08.145 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:08.145 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:08.145 INFO:teuthology.orchestra.run.trial174.stdout:Install 40 Packages 2026-02-25T14:27:08.145 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:08.146 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 30 M 2026-02-25T14:27:08.146 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 100 M 2026-02-25T14:27:08.146 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:08.279 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:08.281 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-25T14:27:08.286 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-25T14:27:08.291 INFO:teuthology.orchestra.run.trial167.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-25T14:27:08.293 INFO:teuthology.orchestra.run.trial167.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-25T14:27:08.299 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-25T14:27:08.323 INFO:teuthology.orchestra.run.trial167.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-25T14:27:08.327 INFO:teuthology.orchestra.run.trial167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-25T14:27:08.332 INFO:teuthology.orchestra.run.trial167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-25T14:27:08.337 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-25T14:27:08.343 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-25T14:27:08.347 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-25T14:27:08.353 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-25T14:27:08.358 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-25T14:27:08.362 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-25T14:27:08.367 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-25T14:27:08.369 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:08.371 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-25T14:27:08.375 INFO:teuthology.orchestra.run.trial078.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T14:27:08.378 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-25T14:27:08.379 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T14:27:08.381 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-25T14:27:08.387 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T14:27:08.388 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-25T14:27:08.403 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-25T14:27:08.416 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-25T14:27:08.421 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-25T14:27:08.430 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-25T14:27:08.437 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-25T14:27:08.450 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-25T14:27:08.465 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-25T14:27:08.539 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-25T14:27:08.547 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-25T14:27:08.570 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-25T14:27:08.599 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-25T14:27:08.604 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-25T14:27:08.650 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-25T14:27:08.693 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-25T14:27:08.694 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-25T14:27:08.719 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-25T14:27:08.719 INFO:teuthology.orchestra.run.trial167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:08.719 INFO:teuthology.orchestra.run.trial167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T14:27:08.719 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:27:08.719 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:27:08.719 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:08.723 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-25T14:27:08.741 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:08.741 INFO:teuthology.orchestra.run.trial167.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T14:27:08.742 INFO:teuthology.orchestra.run.trial167.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T14:27:08.742 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:08.751 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:08.775 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:08.775 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T14:27:08.775 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:08.985 INFO:teuthology.orchestra.run.trial174.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 32 kB/s | 6.5 kB 00:00 2026-02-25T14:27:09.434 INFO:teuthology.orchestra.run.trial174.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 1.4 MB/s | 961 kB 00:00 2026-02-25T14:27:09.487 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-25T14:27:09.489 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-25T14:27:09.515 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-25T14:27:09.515 INFO:teuthology.orchestra.run.trial167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:09.515 INFO:teuthology.orchestra.run.trial167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T14:27:09.515 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:27:09.515 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:27:09.515 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:09.738 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-25T14:27:09.754 INFO:teuthology.orchestra.run.trial174.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 2.4 MB/s | 2.3 MB 00:00 2026-02-25T14:27:09.761 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-25T14:27:09.761 INFO:teuthology.orchestra.run.trial167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:09.761 INFO:teuthology.orchestra.run.trial167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T14:27:09.761 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:27:09.761 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:27:09.762 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:09.862 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-25T14:27:09.882 INFO:teuthology.orchestra.run.trial174.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 2.2 MB/s | 290 kB 00:00 2026-02-25T14:27:09.884 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-25T14:27:09.884 INFO:teuthology.orchestra.run.trial167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:09.884 INFO:teuthology.orchestra.run.trial167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T14:27:09.884 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:27:09.884 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:27:09.884 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:09.902 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-25T14:27:10.234 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-25T14:27:10.234 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-25T14:27:10.234 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-25T14:27:10.234 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-25T14:27:10.234 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-25T14:27:10.234 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-25T14:27:10.235 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-25T14:27:10.236 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-25T14:27:10.237 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-25T14:27:10.237 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-25T14:27:10.237 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-25T14:27:10.237 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-25T14:27:10.237 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-25T14:27:10.237 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-25T14:27:10.237 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-25T14:27:10.237 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:10.296 INFO:teuthology.orchestra.run.trial167.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T14:27:10.297 INFO:teuthology.orchestra.run.trial167.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T14:27:10.298 INFO:teuthology.orchestra.run.trial167.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T14:27:10.299 INFO:teuthology.orchestra.run.trial167.stdout: zip-3.0-35.el9.x86_64 2026-02-25T14:27:10.300 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:10.300 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:10.334 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-base 2026-02-25T14:27:10.381 INFO:teuthology.orchestra.run.trial174.stdout:(5/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 3.6 MB/s | 5.1 MB 00:01 2026-02-25T14:27:10.495 INFO:teuthology.orchestra.run.trial174.stdout:(6/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 66 kB/s | 40 kB 00:00 2026-02-25T14:27:10.651 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-25T14:27:10.653 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:04 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:10.670 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-25T14:27:10.717 INFO:teuthology.orchestra.run.trial167.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:10.735 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:10.736 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:10.736 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:10.757 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install cephadm 2026-02-25T14:27:11.003 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-25T14:27:11.003 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-25T14:27:11.003 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-25T14:27:11.003 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T14:27:11.003 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T14:27:11.013 INFO:teuthology.orchestra.run.trial174.stdout:(7/40): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-25T14:27:11.061 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T14:27:11.061 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:11.061 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:11.061 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:11.061 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:11.061 INFO:teuthology.orchestra.run.trial155.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T14:27:11.061 INFO:teuthology.orchestra.run.trial155.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T14:27:11.062 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T14:27:11.062 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:11.062 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:11.073 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:05 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:11.099 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph 2026-02-25T14:27:11.155 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:11.156 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:27:11.157 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:11.157 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 1.0 M 2026-02-25T14:27:11.157 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 1.0 M 2026-02-25T14:27:11.157 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:11.258 INFO:teuthology.orchestra.run.trial174.stdout:(8/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 332 kB/s | 253 kB 00:00 2026-02-25T14:27:11.413 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:06 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:11.497 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:11.498 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:11.498 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:27:11.498 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T14:27:11.499 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T14:27:11.500 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T14:27:11.501 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout:Install 40 Packages 2026-02-25T14:27:11.502 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:11.503 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 30 M 2026-02-25T14:27:11.503 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 100 M 2026-02-25T14:27:11.503 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:11.630 INFO:teuthology.orchestra.run.trial174.stdout:(9/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_6 7.7 MB/s | 17 MB 00:02 2026-02-25T14:27:11.888 INFO:teuthology.orchestra.run.trial167.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 1.4 MB/s | 1.0 MB 00:00 2026-02-25T14:27:11.888 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:11.888 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.4 MB/s | 1.0 MB 00:00 2026-02-25T14:27:11.889 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:11.891 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:11.891 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:11.895 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:11.895 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:11.913 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:11.928 INFO:teuthology.orchestra.run.trial174.stdout:(10/40): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2026-02-25T14:27:11.961 INFO:teuthology.orchestra.run.trial174.stdout:(11/40): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-25T14:27:11.979 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:11.994 INFO:teuthology.orchestra.run.trial167.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:12.067 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:12.099 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-25T14:27:12.118 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-25T14:27:12.127 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:12.127 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:12.127 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:12.127 INFO:teuthology.orchestra.run.trial167.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:12.127 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:12.127 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:12.154 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T14:27:12.157 INFO:teuthology.orchestra.run.trial155.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 38 kB/s | 6.5 kB 00:00 2026-02-25T14:27:12.333 INFO:teuthology.orchestra.run.trial174.stdout:(12/40): python3-pycparser-2.20-6.el9.noarch.rp 192 kB/s | 135 kB 00:00 2026-02-25T14:27:12.474 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:06 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:12.490 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-25T14:27:12.490 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-25T14:27:12.490 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-25T14:27:12.490 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T14:27:12.490 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T14:27:12.495 INFO:teuthology.orchestra.run.trial155.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 1.8 MB/s | 961 kB 00:00 2026-02-25T14:27:12.548 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T14:27:12.548 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:12.548 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:12.548 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:12.549 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:12.549 INFO:teuthology.orchestra.run.trial078.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T14:27:12.549 INFO:teuthology.orchestra.run.trial078.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T14:27:12.549 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T14:27:12.549 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:12.549 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:12.557 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:27:12.558 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:12.559 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 154 k 2026-02-25T14:27:12.559 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 447 k 2026-02-25T14:27:12.559 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:12.588 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph 2026-02-25T14:27:12.641 INFO:teuthology.orchestra.run.trial174.stdout:(13/40): python3-pyparsing-2.4.7-9.el9.noarch.r 211 kB/s | 150 kB 00:00 2026-02-25T14:27:12.656 INFO:teuthology.orchestra.run.trial174.stdout:(14/40): python3-requests-2.25.1-10.el9.noarch. 182 kB/s | 126 kB 00:00 2026-02-25T14:27:12.776 INFO:teuthology.orchestra.run.trial155.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 3.0 MB/s | 2.3 MB 00:00 2026-02-25T14:27:12.841 INFO:teuthology.orchestra.run.trial155.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 4.4 MB/s | 290 kB 00:00 2026-02-25T14:27:12.900 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:03 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:12.938 INFO:teuthology.orchestra.run.trial155.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 417 kB/s | 40 kB 00:00 2026-02-25T14:27:12.983 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:12.984 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-25T14:27:12.985 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T14:27:12.986 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T14:27:12.987 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:12.988 INFO:teuthology.orchestra.run.trial078.stdout:Install 40 Packages 2026-02-25T14:27:12.989 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:12.989 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 30 M 2026-02-25T14:27:12.989 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 100 M 2026-02-25T14:27:12.989 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:12.990 INFO:teuthology.orchestra.run.trial167.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 357 kB/s | 154 kB 00:00 2026-02-25T14:27:12.990 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:12.990 INFO:teuthology.orchestra.run.trial167.stdout:Total 356 kB/s | 154 kB 00:00 2026-02-25T14:27:12.991 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:12.995 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:12.995 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:12.997 INFO:teuthology.orchestra.run.trial155.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-02-25T14:27:13.022 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:13.023 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:13.069 INFO:teuthology.orchestra.run.trial155.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 253 kB 00:00 2026-02-25T14:27:13.073 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:13.074 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:13.088 INFO:teuthology.orchestra.run.trial174.stdout:(15/40): python3-urllib3-1.26.5-7.el9.noarch.rp 289 kB/s | 218 kB 00:00 2026-02-25T14:27:13.098 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:13.098 INFO:teuthology.orchestra.run.trial167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:13.098 INFO:teuthology.orchestra.run.trial167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T14:27:13.098 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:13.157 INFO:teuthology.orchestra.run.trial155.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 14 MB/s | 1.2 MB 00:00 2026-02-25T14:27:13.184 INFO:teuthology.orchestra.run.trial155.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 3.9 MB/s | 106 kB 00:00 2026-02-25T14:27:13.211 INFO:teuthology.orchestra.run.trial155.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 4.9 MB/s | 135 kB 00:00 2026-02-25T14:27:13.238 INFO:teuthology.orchestra.run.trial155.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 5.4 MB/s | 150 kB 00:00 2026-02-25T14:27:13.266 INFO:teuthology.orchestra.run.trial155.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 4.5 MB/s | 126 kB 00:00 2026-02-25T14:27:13.293 INFO:teuthology.orchestra.run.trial155.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 7.7 MB/s | 218 kB 00:00 2026-02-25T14:27:13.345 INFO:teuthology.orchestra.run.trial155.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 3.4 MB/s | 182 kB 00:00 2026-02-25T14:27:13.368 INFO:teuthology.orchestra.run.trial174.stdout:(16/40): unzip-6.0-59.el9.x86_64.rpm 250 kB/s | 182 kB 00:00 2026-02-25T14:27:13.373 INFO:teuthology.orchestra.run.trial155.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 9.5 MB/s | 266 kB 00:00 2026-02-25T14:27:13.384 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:13.384 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:13.384 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:13.384 INFO:teuthology.orchestra.run.trial167.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:13.384 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:13.384 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:13.412 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-mgr 2026-02-25T14:27:13.427 INFO:teuthology.orchestra.run.trial174.stdout:(17/40): zip-3.0-35.el9.x86_64.rpm 345 kB/s | 266 kB 00:00 2026-02-25T14:27:13.566 INFO:teuthology.orchestra.run.trial078.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 25 kB/s | 6.5 kB 00:00 2026-02-25T14:27:13.734 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:07 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:13.798 INFO:teuthology.orchestra.run.trial167.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:13.816 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:13.816 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:13.816 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:13.836 INFO:teuthology.orchestra.run.trial174.stdout:(18/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 330 kB/s | 246 kB 00:00 2026-02-25T14:27:13.837 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-mgr-dashboard 2026-02-25T14:27:14.000 INFO:teuthology.orchestra.run.trial174.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 469 kB/s | 77 kB 00:00 2026-02-25T14:27:14.008 INFO:teuthology.orchestra.run.trial174.stdout:(20/40): lua-5.4.4-4.el9.x86_64.rpm 294 kB/s | 188 kB 00:00 2026-02-25T14:27:14.068 INFO:teuthology.orchestra.run.trial174.stdout:(21/40): python3-libstoragemgmt-1.10.1-1.el9.x8 276 kB/s | 177 kB 00:00 2026-02-25T14:27:14.086 INFO:teuthology.orchestra.run.trial174.stdout:(22/40): python3-toml-0.10.2-6.el9.noarch.rpm 485 kB/s | 42 kB 00:00 2026-02-25T14:27:14.121 INFO:teuthology.orchestra.run.trial078.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 1.1 MB/s | 961 kB 00:00 2026-02-25T14:27:14.136 INFO:teuthology.orchestra.run.trial174.stdout:(23/40): lua-devel-5.4.4-4.el9.x86_64.rpm 175 kB/s | 22 kB 00:00 2026-02-25T14:27:14.153 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:08 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:14.235 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:14.236 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:14.236 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:27:14.236 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:14.236 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T14:27:14.237 INFO:teuthology.orchestra.run.trial167.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T14:27:14.238 INFO:teuthology.orchestra.run.trial167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T14:27:14.238 INFO:teuthology.orchestra.run.trial167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T14:27:14.238 INFO:teuthology.orchestra.run.trial167.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T14:27:14.238 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:14.238 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:14.238 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:14.238 INFO:teuthology.orchestra.run.trial167.stdout:Install 14 Packages 2026-02-25T14:27:14.238 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:14.239 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 16 M 2026-02-25T14:27:14.239 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 158 M 2026-02-25T14:27:14.239 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:14.245 INFO:teuthology.orchestra.run.trial155.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 282 kB/s | 246 kB 00:00 2026-02-25T14:27:14.254 INFO:teuthology.orchestra.run.trial155.stdout:(17/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 2.4 MB/s | 5.1 MB 00:02 2026-02-25T14:27:14.288 INFO:teuthology.orchestra.run.trial174.stdout:(24/40): python3-autocommand-2.2.2-8.el9.noarch 146 kB/s | 29 kB 00:00 2026-02-25T14:27:14.404 INFO:teuthology.orchestra.run.trial174.stdout:(25/40): python3-backports-tarfile-1.2.0-1.el9. 224 kB/s | 60 kB 00:00 2026-02-25T14:27:14.405 INFO:teuthology.orchestra.run.trial174.stdout:(26/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 375 kB/s | 43 kB 00:00 2026-02-25T14:27:14.427 INFO:teuthology.orchestra.run.trial174.stdout:(27/40): luarocks-3.9.2-5.el9.noarch.rpm 422 kB/s | 151 kB 00:00 2026-02-25T14:27:14.491 INFO:teuthology.orchestra.run.trial174.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 168 kB/s | 11 kB 00:00 2026-02-25T14:27:14.557 INFO:teuthology.orchestra.run.trial174.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 267 kB/s | 18 kB 00:00 2026-02-25T14:27:14.562 INFO:teuthology.orchestra.run.trial155.stdout:(18/40): lua-5.4.4-4.el9.x86_64.rpm 595 kB/s | 188 kB 00:00 2026-02-25T14:27:14.590 INFO:teuthology.orchestra.run.trial174.stdout:(30/40): python3-cheroot-10.0.1-4.el9.noarch.rp 932 kB/s | 173 kB 00:00 2026-02-25T14:27:14.625 INFO:teuthology.orchestra.run.trial174.stdout:(31/40): python3-jaraco-collections-3.0.0-8.el9 343 kB/s | 23 kB 00:00 2026-02-25T14:27:14.657 INFO:teuthology.orchestra.run.trial174.stdout:(32/40): python3-jaraco-context-6.0.1-3.el9.noa 295 kB/s | 20 kB 00:00 2026-02-25T14:27:14.658 INFO:teuthology.orchestra.run.trial174.stdout:(33/40): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2026-02-25T14:27:14.691 INFO:teuthology.orchestra.run.trial174.stdout:(34/40): python3-jaraco-functools-3.5.0-2.el9.n 295 kB/s | 19 kB 00:00 2026-02-25T14:27:14.724 INFO:teuthology.orchestra.run.trial174.stdout:(35/40): python3-jaraco-text-4.0.0-2.el9.noarch 390 kB/s | 26 kB 00:00 2026-02-25T14:27:14.727 INFO:teuthology.orchestra.run.trial174.stdout:(36/40): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2026-02-25T14:27:14.756 INFO:teuthology.orchestra.run.trial174.stdout:(37/40): python3-portend-3.1.0-2.el9.noarch.rpm 251 kB/s | 16 kB 00:00 2026-02-25T14:27:14.792 INFO:teuthology.orchestra.run.trial174.stdout:(38/40): python3-tempora-5.0.0-2.el9.noarch.rpm 551 kB/s | 36 kB 00:00 2026-02-25T14:27:14.799 INFO:teuthology.orchestra.run.trial155.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 325 kB/s | 77 kB 00:00 2026-02-25T14:27:14.808 INFO:teuthology.orchestra.run.trial174.stdout:(39/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2026-02-25T14:27:14.823 INFO:teuthology.orchestra.run.trial174.stdout:(40/40): python3-zc-lockfile-2.0-10.el9.noarch. 297 kB/s | 20 kB 00:00 2026-02-25T14:27:14.825 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:14.825 INFO:teuthology.orchestra.run.trial174.stdout:Total 4.5 MB/s | 30 MB 00:06 2026-02-25T14:27:14.933 INFO:teuthology.orchestra.run.trial078.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.4 MB/s | 2.3 MB 00:01 2026-02-25T14:27:14.959 INFO:teuthology.orchestra.run.trial155.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 261 kB/s | 42 kB 00:00 2026-02-25T14:27:14.965 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:14.984 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:14.984 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:15.004 INFO:teuthology.orchestra.run.trial155.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 488 kB/s | 22 kB 00:00 2026-02-25T14:27:15.036 INFO:teuthology.orchestra.run.trial155.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2026-02-25T14:27:15.042 INFO:teuthology.orchestra.run.trial155.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 5.0 MB/s | 29 kB 00:00 2026-02-25T14:27:15.049 INFO:teuthology.orchestra.run.trial155.stdout:(24/40): python3-libstoragemgmt-1.10.1-1.el9.x8 223 kB/s | 177 kB 00:00 2026-02-25T14:27:15.064 INFO:teuthology.orchestra.run.trial078.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 2.2 MB/s | 290 kB 00:00 2026-02-25T14:27:15.065 INFO:teuthology.orchestra.run.trial155.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.7 MB/s | 43 kB 00:00 2026-02-25T14:27:15.081 INFO:teuthology.orchestra.run.trial155.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 10 MB/s | 173 kB 00:00 2026-02-25T14:27:15.097 INFO:teuthology.orchestra.run.trial155.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 23 MB/s | 358 kB 00:00 2026-02-25T14:27:15.102 INFO:teuthology.orchestra.run.trial155.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 2.1 MB/s | 11 kB 00:00 2026-02-25T14:27:15.107 INFO:teuthology.orchestra.run.trial155.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 3.3 MB/s | 18 kB 00:00 2026-02-25T14:27:15.114 INFO:teuthology.orchestra.run.trial155.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 3.5 MB/s | 23 kB 00:00 2026-02-25T14:27:15.120 INFO:teuthology.orchestra.run.trial155.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 3.6 MB/s | 20 kB 00:00 2026-02-25T14:27:15.125 INFO:teuthology.orchestra.run.trial155.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 3.7 MB/s | 19 kB 00:00 2026-02-25T14:27:15.129 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:15.130 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:15.130 INFO:teuthology.orchestra.run.trial155.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 5.0 MB/s | 26 kB 00:00 2026-02-25T14:27:15.132 INFO:teuthology.orchestra.run.trial078.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 595 kB/s | 40 kB 00:00 2026-02-25T14:27:15.136 INFO:teuthology.orchestra.run.trial155.stdout:(34/40): python3-more-itertools-8.12.0-2.el9.no 13 MB/s | 79 kB 00:00 2026-02-25T14:27:15.141 INFO:teuthology.orchestra.run.trial155.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 3.1 MB/s | 16 kB 00:00 2026-02-25T14:27:15.148 INFO:teuthology.orchestra.run.trial155.stdout:(36/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 14 MB/s | 90 kB 00:00 2026-02-25T14:27:15.153 INFO:teuthology.orchestra.run.trial155.stdout:(37/40): python3-tempora-5.0.0-2.el9.noarch.rpm 6.5 MB/s | 36 kB 00:00 2026-02-25T14:27:15.158 INFO:teuthology.orchestra.run.trial155.stdout:(38/40): python3-zc-lockfile-2.0-10.el9.noarch. 3.8 MB/s | 20 kB 00:00 2026-02-25T14:27:15.166 INFO:teuthology.orchestra.run.trial078.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 2.1 MB/s | 72 kB 00:00 2026-02-25T14:27:15.198 INFO:teuthology.orchestra.run.trial078.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.9 MB/s | 253 kB 00:00 2026-02-25T14:27:15.207 INFO:teuthology.orchestra.run.trial167.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 52 kB/s | 17 kB 00:00 2026-02-25T14:27:15.236 INFO:teuthology.orchestra.run.trial078.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 33 MB/s | 1.2 MB 00:00 2026-02-25T14:27:15.265 INFO:teuthology.orchestra.run.trial167.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 111 kB/s | 43 kB 00:00 2026-02-25T14:27:15.266 INFO:teuthology.orchestra.run.trial078.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 3.5 MB/s | 106 kB 00:00 2026-02-25T14:27:15.303 INFO:teuthology.orchestra.run.trial078.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 135 kB 00:00 2026-02-25T14:27:15.319 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:15.321 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-25T14:27:15.326 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-25T14:27:15.331 INFO:teuthology.orchestra.run.trial174.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-25T14:27:15.332 INFO:teuthology.orchestra.run.trial078.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 5.1 MB/s | 150 kB 00:00 2026-02-25T14:27:15.333 INFO:teuthology.orchestra.run.trial174.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-25T14:27:15.338 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-25T14:27:15.350 INFO:teuthology.orchestra.run.trial167.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 561 kB/s | 48 kB 00:00 2026-02-25T14:27:15.359 INFO:teuthology.orchestra.run.trial078.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 4.6 MB/s | 126 kB 00:00 2026-02-25T14:27:15.362 INFO:teuthology.orchestra.run.trial174.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-25T14:27:15.367 INFO:teuthology.orchestra.run.trial174.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-25T14:27:15.369 INFO:teuthology.orchestra.run.trial155.stdout:(39/40): python3-backports-tarfile-1.2.0-1.el9. 184 kB/s | 60 kB 00:00 2026-02-25T14:27:15.372 INFO:teuthology.orchestra.run.trial174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-25T14:27:15.377 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-25T14:27:15.383 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-25T14:27:15.383 INFO:teuthology.orchestra.run.trial167.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 5.7 MB/s | 1.0 MB 00:00 2026-02-25T14:27:15.387 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-25T14:27:15.387 INFO:teuthology.orchestra.run.trial078.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 7.5 MB/s | 218 kB 00:00 2026-02-25T14:27:15.393 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-25T14:27:15.398 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-25T14:27:15.401 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-25T14:27:15.407 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-25T14:27:15.411 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-25T14:27:15.417 INFO:teuthology.orchestra.run.trial167.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 3.9 MB/s | 267 kB 00:00 2026-02-25T14:27:15.417 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-25T14:27:15.418 INFO:teuthology.orchestra.run.trial078.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 5.8 MB/s | 182 kB 00:00 2026-02-25T14:27:15.421 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-25T14:27:15.443 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-25T14:27:15.452 INFO:teuthology.orchestra.run.trial078.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 7.7 MB/s | 266 kB 00:00 2026-02-25T14:27:15.456 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-25T14:27:15.461 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-25T14:27:15.471 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-25T14:27:15.477 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-25T14:27:15.490 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-25T14:27:15.506 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-25T14:27:15.564 INFO:teuthology.orchestra.run.trial167.stdout:(6/14): protobuf-compiler-3.14.0-17.el9.x86_64. 4.6 MB/s | 862 kB 00:00 2026-02-25T14:27:15.580 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-25T14:27:15.589 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-25T14:27:15.612 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-25T14:27:15.641 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-25T14:27:15.646 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-25T14:27:15.693 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-25T14:27:15.713 INFO:teuthology.orchestra.run.trial155.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 5.3 MB/s | 17 MB 00:03 2026-02-25T14:27:15.715 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:15.715 INFO:teuthology.orchestra.run.trial155.stdout:Total 7.2 MB/s | 30 MB 00:04 2026-02-25T14:27:15.736 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-25T14:27:15.737 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-25T14:27:15.761 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-25T14:27:15.761 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:15.761 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T14:27:15.761 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:27:15.761 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:27:15.761 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:15.766 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-25T14:27:15.773 INFO:teuthology.orchestra.run.trial167.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 93 kB/s | 19 kB 00:00 2026-02-25T14:27:15.783 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:15.783 INFO:teuthology.orchestra.run.trial174.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T14:27:15.783 INFO:teuthology.orchestra.run.trial174.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T14:27:15.783 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:15.792 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:15.815 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:15.816 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T14:27:15.816 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:15.835 INFO:teuthology.orchestra.run.trial078.stdout:(16/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 2.2 MB/s | 5.1 MB 00:02 2026-02-25T14:27:15.859 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:15.878 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:15.879 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:15.917 INFO:teuthology.orchestra.run.trial167.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-25T14:27:16.026 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:16.026 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:16.197 INFO:teuthology.orchestra.run.trial078.stdout:(17/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 331 kB/s | 246 kB 00:00 2026-02-25T14:27:16.211 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:16.213 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-25T14:27:16.218 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-25T14:27:16.222 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-25T14:27:16.224 INFO:teuthology.orchestra.run.trial155.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-25T14:27:16.230 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-25T14:27:16.254 INFO:teuthology.orchestra.run.trial155.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-25T14:27:16.258 INFO:teuthology.orchestra.run.trial155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-25T14:27:16.263 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-25T14:27:16.267 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-25T14:27:16.273 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-25T14:27:16.276 INFO:teuthology.orchestra.run.trial167.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 403 kB/s | 144 kB 00:00 2026-02-25T14:27:16.277 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-25T14:27:16.283 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-25T14:27:16.288 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-25T14:27:16.292 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-25T14:27:16.297 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-25T14:27:16.301 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-25T14:27:16.308 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-25T14:27:16.311 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-25T14:27:16.334 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-25T14:27:16.347 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-25T14:27:16.352 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-25T14:27:16.361 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-25T14:27:16.368 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-25T14:27:16.381 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-25T14:27:16.397 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-25T14:27:16.406 INFO:teuthology.orchestra.run.trial078.stdout:(18/40): lua-5.4.4-4.el9.x86_64.rpm 330 kB/s | 188 kB 00:00 2026-02-25T14:27:16.451 INFO:teuthology.orchestra.run.trial078.stdout:(19/40): python3-libstoragemgmt-1.10.1-1.el9.x8 696 kB/s | 177 kB 00:00 2026-02-25T14:27:16.472 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-25T14:27:16.475 INFO:teuthology.orchestra.run.trial167.stdout:(10/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.9 MB/s | 2.0 MB 00:00 2026-02-25T14:27:16.480 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-25T14:27:16.488 INFO:teuthology.orchestra.run.trial167.stdout:(11/14): python3-repoze-lru-0.7-16.el9.noarch.r 145 kB/s | 31 kB 00:00 2026-02-25T14:27:16.496 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-25T14:27:16.498 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-25T14:27:16.503 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-25T14:27:16.505 INFO:teuthology.orchestra.run.trial078.stdout:(20/40): python3-packaging-20.9-5.el9.noarch.rp 779 kB/s | 77 kB 00:00 2026-02-25T14:27:16.523 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-25T14:27:16.523 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:16.523 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T14:27:16.523 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:27:16.523 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:27:16.523 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:16.533 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-25T14:27:16.538 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-25T14:27:16.550 INFO:teuthology.orchestra.run.trial078.stdout:(21/40): python3-toml-0.10.2-6.el9.noarch.rpm 420 kB/s | 42 kB 00:00 2026-02-25T14:27:16.581 INFO:teuthology.orchestra.run.trial078.stdout:(22/40): lua-devel-5.4.4-4.el9.x86_64.rpm 294 kB/s | 22 kB 00:00 2026-02-25T14:27:16.585 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-25T14:27:16.628 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-25T14:27:16.630 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-25T14:27:16.653 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-25T14:27:16.654 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:16.654 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T14:27:16.654 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:27:16.654 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:27:16.654 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:16.659 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-25T14:27:16.676 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:16.676 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T14:27:16.676 INFO:teuthology.orchestra.run.trial155.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T14:27:16.676 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:16.685 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:16.699 INFO:teuthology.orchestra.run.trial167.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 105 kB/s | 22 kB 00:00 2026-02-25T14:27:16.708 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:16.709 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T14:27:16.709 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:16.743 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-25T14:27:16.765 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-25T14:27:16.766 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:16.766 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T14:27:16.766 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:27:16.766 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:27:16.766 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:16.789 INFO:teuthology.orchestra.run.trial078.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 141 kB/s | 29 kB 00:00 2026-02-25T14:27:16.794 INFO:teuthology.orchestra.run.trial167.stdout:(13/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 5.5 MB/s | 11 MB 00:01 2026-02-25T14:27:16.834 INFO:teuthology.orchestra.run.trial167.stdout:(14/14): python3-routes-2.5.1-5.el9.noarch.rpm 525 kB/s | 188 kB 00:00 2026-02-25T14:27:16.836 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:16.836 INFO:teuthology.orchestra.run.trial167.stdout:Total 6.1 MB/s | 16 MB 00:02 2026-02-25T14:27:16.865 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-25T14:27:16.871 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:16.881 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:16.881 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:16.886 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-25T14:27:16.886 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:16.887 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T14:27:16.887 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:27:16.887 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:27:16.887 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:16.901 INFO:teuthology.orchestra.run.trial078.stdout:(24/40): luarocks-3.9.2-5.el9.noarch.rpm 432 kB/s | 151 kB 00:00 2026-02-25T14:27:16.905 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-25T14:27:16.977 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:16.978 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:17.079 INFO:teuthology.orchestra.run.trial078.stdout:(25/40): python3-backports-tarfile-1.2.0-1.el9. 208 kB/s | 60 kB 00:00 2026-02-25T14:27:17.096 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:17.104 INFO:teuthology.orchestra.run.trial167.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-25T14:27:17.108 INFO:teuthology.orchestra.run.trial167.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-25T14:27:17.113 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-25T14:27:17.119 INFO:teuthology.orchestra.run.trial078.stdout:(26/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 199 kB/s | 43 kB 00:00 2026-02-25T14:27:17.124 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-25T14:27:17.126 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-25T14:27:17.153 INFO:teuthology.orchestra.run.trial167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-25T14:27:17.196 INFO:teuthology.orchestra.run.trial167.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-25T14:27:17.225 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-25T14:27:17.235 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-25T14:27:17.242 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-25T14:27:17.245 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-25T14:27:17.245 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-25T14:27:17.245 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-25T14:27:17.245 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-25T14:27:17.246 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-25T14:27:17.247 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-25T14:27:17.248 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-25T14:27:17.249 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-25T14:27:17.251 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-25T14:27:17.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-25T14:27:17.307 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:17.307 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:17.307 INFO:teuthology.orchestra.run.trial174.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:17.307 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:17.307 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:17.307 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:17.307 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T14:27:17.308 INFO:teuthology.orchestra.run.trial174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T14:27:17.309 INFO:teuthology.orchestra.run.trial174.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: zip-3.0-35.el9.x86_64 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:17.310 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:17.344 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-base 2026-02-25T14:27:17.396 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-25T14:27:17.398 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-25T14:27:17.423 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-25T14:27:17.423 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:17.423 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T14:27:17.423 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:27:17.423 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:27:17.423 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:17.427 INFO:teuthology.orchestra.run.trial078.stdout:(27/40): python3-cheroot-10.0.1-4.el9.noarch.rp 497 kB/s | 173 kB 00:00 2026-02-25T14:27:17.548 INFO:teuthology.orchestra.run.trial078.stdout:(28/40): python3-cherrypy-18.6.1-2.el9.noarch.r 835 kB/s | 358 kB 00:00 2026-02-25T14:27:17.568 INFO:teuthology.orchestra.run.trial078.stdout:(29/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 76 kB/s | 11 kB 00:00 2026-02-25T14:27:17.637 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-25T14:27:17.657 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-25T14:27:17.657 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:17.658 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T14:27:17.658 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:27:17.658 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:27:17.658 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:17.661 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:11 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:17.684 INFO:teuthology.orchestra.run.trial078.stdout:(30/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 4.8 MB/s | 17 MB 00:03 2026-02-25T14:27:17.727 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:17.744 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:17.745 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:27:17.745 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:17.755 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-25T14:27:17.759 INFO:teuthology.orchestra.run.trial078.stdout:(31/40): python3-jaraco-classes-3.2.1-5.el9.noa 84 kB/s | 18 kB 00:00 2026-02-25T14:27:17.766 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install cephadm 2026-02-25T14:27:17.776 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-25T14:27:17.776 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:17.776 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T14:27:17.777 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:27:17.777 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:27:17.777 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:17.778 INFO:teuthology.orchestra.run.trial078.stdout:(32/40): python3-jaraco-collections-3.0.0-8.el9 111 kB/s | 23 kB 00:00 2026-02-25T14:27:17.794 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-25T14:27:17.893 INFO:teuthology.orchestra.run.trial078.stdout:(33/40): python3-jaraco-context-6.0.1-3.el9.noa 94 kB/s | 20 kB 00:00 2026-02-25T14:27:17.968 INFO:teuthology.orchestra.run.trial078.stdout:(34/40): python3-jaraco-functools-3.5.0-2.el9.n 93 kB/s | 19 kB 00:00 2026-02-25T14:27:17.995 INFO:teuthology.orchestra.run.trial078.stdout:(35/40): python3-jaraco-text-4.0.0-2.el9.noarch 121 kB/s | 26 kB 00:00 2026-02-25T14:27:18.079 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:12 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:18.144 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-25T14:27:18.144 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-25T14:27:18.144 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-25T14:27:18.145 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-25T14:27:18.146 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-25T14:27:18.147 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-25T14:27:18.161 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:18.162 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:18.162 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:27:18.162 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:18.162 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:18.162 INFO:teuthology.orchestra.run.trial174.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-25T14:27:18.162 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:18.163 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:18.163 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:18.163 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:27:18.163 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:18.163 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 1.0 M 2026-02-25T14:27:18.163 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 1.0 M 2026-02-25T14:27:18.163 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:18.174 INFO:teuthology.orchestra.run.trial078.stdout:(36/40): python3-more-itertools-8.12.0-2.el9.no 280 kB/s | 79 kB 00:00 2026-02-25T14:27:18.178 INFO:teuthology.orchestra.run.trial078.stdout:(37/40): python3-portend-3.1.0-2.el9.noarch.rpm 78 kB/s | 16 kB 00:00 2026-02-25T14:27:18.204 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T14:27:18.205 INFO:teuthology.orchestra.run.trial155.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T14:27:18.206 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T14:27:18.207 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout: zip-3.0-35.el9.x86_64 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:18.208 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:18.242 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-base 2026-02-25T14:27:18.285 INFO:teuthology.orchestra.run.trial078.stdout:(38/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 310 kB/s | 90 kB 00:00 2026-02-25T14:27:18.378 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-25T14:27:18.383 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-25T14:27:18.392 INFO:teuthology.orchestra.run.trial078.stdout:(39/40): python3-tempora-5.0.0-2.el9.noarch.rpm 164 kB/s | 36 kB 00:00 2026-02-25T14:27:18.393 INFO:teuthology.orchestra.run.trial078.stdout:(40/40): python3-zc-lockfile-2.0-10.el9.noarch. 93 kB/s | 20 kB 00:00 2026-02-25T14:27:18.400 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:18.400 INFO:teuthology.orchestra.run.trial078.stdout:Total 5.6 MB/s | 30 MB 00:05 2026-02-25T14:27:18.539 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:18.557 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:18.557 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:18.563 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:18.578 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-25T14:27:18.578 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-25T14:27:18.579 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-25T14:27:18.580 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-25T14:27:18.629 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:18.638 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T14:27:18.639 INFO:teuthology.orchestra.run.trial167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T14:27:18.640 INFO:teuthology.orchestra.run.trial167.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T14:27:18.640 INFO:teuthology.orchestra.run.trial167.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T14:27:18.640 INFO:teuthology.orchestra.run.trial167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T14:27:18.640 INFO:teuthology.orchestra.run.trial167.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T14:27:18.640 INFO:teuthology.orchestra.run.trial167.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T14:27:18.640 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:18.640 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:18.646 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:18.647 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:18.647 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:18.668 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install cephadm 2026-02-25T14:27:18.672 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-25T14:27:18.702 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:18.703 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:18.757 INFO:teuthology.orchestra.run.trial174.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 1.7 MB/s | 1.0 MB 00:00 2026-02-25T14:27:18.758 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:18.759 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.7 MB/s | 1.0 MB 00:00 2026-02-25T14:27:18.759 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:18.762 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:18.762 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:18.766 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:18.766 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:18.784 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:18.850 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:18.865 INFO:teuthology.orchestra.run.trial174.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:18.884 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:18.886 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-25T14:27:18.891 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-25T14:27:18.896 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-25T14:27:18.898 INFO:teuthology.orchestra.run.trial078.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-25T14:27:18.904 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-25T14:27:18.927 INFO:teuthology.orchestra.run.trial078.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-25T14:27:18.933 INFO:teuthology.orchestra.run.trial078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-25T14:27:18.937 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-25T14:27:18.941 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:18.942 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-25T14:27:18.948 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-25T14:27:18.952 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-25T14:27:18.958 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-25T14:27:18.963 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-25T14:27:18.966 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-25T14:27:18.972 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-25T14:27:18.976 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-25T14:27:18.982 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-25T14:27:18.984 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:18.986 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-25T14:27:18.988 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:12 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:19.001 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:19.001 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:19.001 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:19.001 INFO:teuthology.orchestra.run.trial174.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:19.002 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:19.002 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:19.008 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-25T14:27:19.021 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-25T14:27:19.026 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-25T14:27:19.027 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T14:27:19.035 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-25T14:27:19.042 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-25T14:27:19.055 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-25T14:27:19.067 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:19.067 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 1.0 M 2026-02-25T14:27:19.068 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 1.0 M 2026-02-25T14:27:19.069 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:19.071 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-25T14:27:19.071 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:19.072 INFO:teuthology.orchestra.run.trial167.stdout:====================================================================================== 2026-02-25T14:27:19.072 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:27:19.072 INFO:teuthology.orchestra.run.trial167.stdout:====================================================================================== 2026-02-25T14:27:19.072 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:19.072 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T14:27:19.073 INFO:teuthology.orchestra.run.trial167.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T14:27:19.074 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:19.074 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:19.074 INFO:teuthology.orchestra.run.trial167.stdout:====================================================================================== 2026-02-25T14:27:19.074 INFO:teuthology.orchestra.run.trial167.stdout:Install 12 Packages 2026-02-25T14:27:19.074 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:19.075 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 43 M 2026-02-25T14:27:19.075 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 234 M 2026-02-25T14:27:19.075 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:19.145 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-25T14:27:19.153 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-25T14:27:19.176 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-25T14:27:19.205 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-25T14:27:19.211 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-25T14:27:19.257 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-25T14:27:19.300 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-25T14:27:19.301 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-25T14:27:19.325 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-25T14:27:19.325 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:19.325 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T14:27:19.325 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:27:19.325 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:27:19.325 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:19.326 INFO:teuthology.orchestra.run.trial167.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 184 kB 00:00 2026-02-25T14:27:19.330 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-25T14:27:19.344 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:19.347 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:19.347 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T14:27:19.348 INFO:teuthology.orchestra.run.trial078.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T14:27:19.348 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:19.356 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:19.379 INFO:teuthology.orchestra.run.trial167.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 5.1 MB/s | 794 kB 00:00 2026-02-25T14:27:19.379 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-25T14:27:19.379 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T14:27:19.380 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:19.381 INFO:teuthology.orchestra.run.trial167.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 531 kB/s | 30 kB 00:00 2026-02-25T14:27:19.428 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:19.428 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:19.428 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:27:19.428 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:19.428 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 154 k 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 447 k 2026-02-25T14:27:19.429 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:19.430 INFO:teuthology.orchestra.run.trial167.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 315 kB/s | 15 kB 00:00 2026-02-25T14:27:19.453 INFO:teuthology.orchestra.run.trial167.stdout:(5/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 40 MB/s | 3.0 MB 00:00 2026-02-25T14:27:19.458 INFO:teuthology.orchestra.run.trial167.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 1.4 MB/s | 42 kB 00:00 2026-02-25T14:27:19.487 INFO:teuthology.orchestra.run.trial167.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 8.3 MB/s | 244 kB 00:00 2026-02-25T14:27:19.507 INFO:teuthology.orchestra.run.trial167.stdout:(8/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 98 MB/s | 5.3 MB 00:00 2026-02-25T14:27:19.538 INFO:teuthology.orchestra.run.trial167.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 14 MB/s | 442 kB 00:00 2026-02-25T14:27:19.552 INFO:teuthology.orchestra.run.trial167.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 95 MB/s | 6.1 MB 00:00 2026-02-25T14:27:19.666 INFO:teuthology.orchestra.run.trial167.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 150 MB/s | 19 MB 00:00 2026-02-25T14:27:19.849 INFO:teuthology.orchestra.run.trial155.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 1.3 MB/s | 1.0 MB 00:00 2026-02-25T14:27:19.850 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:19.851 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.3 MB/s | 1.0 MB 00:00 2026-02-25T14:27:19.851 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:19.853 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:19.854 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:19.857 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:19.858 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:19.876 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:19.945 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:19.959 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:19.966 INFO:teuthology.orchestra.run.trial174.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 286 kB/s | 154 kB 00:00 2026-02-25T14:27:19.966 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:19.966 INFO:teuthology.orchestra.run.trial174.stdout:Total 286 kB/s | 154 kB 00:00 2026-02-25T14:27:19.966 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:19.972 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:19.972 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:19.999 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:19.999 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:20.029 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:20.049 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:20.050 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:20.064 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-25T14:27:20.066 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-25T14:27:20.073 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:20.073 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:20.073 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T14:27:20.073 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:20.088 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:20.088 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:20.088 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:20.088 INFO:teuthology.orchestra.run.trial155.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:20.089 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:20.089 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:20.091 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-25T14:27:20.091 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:20.091 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T14:27:20.091 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:27:20.091 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:27:20.091 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:20.115 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T14:27:20.307 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-25T14:27:20.329 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-25T14:27:20.329 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:20.329 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T14:27:20.329 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:27:20.329 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:27:20.329 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:20.404 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:20.404 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:20.404 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:20.404 INFO:teuthology.orchestra.run.trial174.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:20.404 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:20.404 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:20.426 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-25T14:27:20.432 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr 2026-02-25T14:27:20.433 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:15 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:20.446 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-25T14:27:20.446 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:20.446 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T14:27:20.446 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:27:20.447 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:27:20.447 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:20.464 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-25T14:27:20.516 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:20.516 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:20.516 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 154 k 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 447 k 2026-02-25T14:27:20.517 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:20.754 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:14 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:20.796 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-25T14:27:20.796 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-25T14:27:20.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-25T14:27:20.798 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-25T14:27:20.799 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-25T14:27:20.818 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:20.836 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:20.837 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:27:20.837 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:20.858 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-dashboard 2026-02-25T14:27:20.859 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-25T14:27:20.859 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:20.859 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:20.859 INFO:teuthology.orchestra.run.trial078.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:20.859 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:20.859 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T14:27:20.860 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:27:20.861 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T14:27:20.862 INFO:teuthology.orchestra.run.trial078.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T14:27:20.863 INFO:teuthology.orchestra.run.trial078.stdout: zip-3.0-35.el9.x86_64 2026-02-25T14:27:20.863 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:20.863 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:20.897 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-base 2026-02-25T14:27:20.933 INFO:teuthology.orchestra.run.trial155.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 370 kB/s | 154 kB 00:00 2026-02-25T14:27:20.934 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:20.934 INFO:teuthology.orchestra.run.trial155.stdout:Total 369 kB/s | 154 kB 00:00 2026-02-25T14:27:20.934 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:20.939 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:20.939 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:20.965 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:20.965 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:21.015 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:21.017 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:21.039 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:21.039 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:21.039 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T14:27:21.039 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:21.173 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:15 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:21.217 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:12 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:21.256 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:21.256 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:21.256 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:27:21.256 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T14:27:21.257 INFO:teuthology.orchestra.run.trial174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout:Install 14 Packages 2026-02-25T14:27:21.258 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:21.259 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 16 M 2026-02-25T14:27:21.259 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 158 M 2026-02-25T14:27:21.259 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:21.281 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:21.298 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:21.299 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:21.299 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:21.320 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install cephadm 2026-02-25T14:27:21.356 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:21.356 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:21.356 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:21.356 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:21.356 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:21.357 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:21.385 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr 2026-02-25T14:27:21.635 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:12 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:21.708 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:16 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:21.718 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:21.718 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:27:21.719 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:21.720 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 1.0 M 2026-02-25T14:27:21.720 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 1.0 M 2026-02-25T14:27:21.720 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:21.772 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:21.789 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:21.790 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:21.790 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:21.811 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-dashboard 2026-02-25T14:27:22.131 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:17 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:22.216 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-25T14:27:22.217 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:22.218 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:22.219 INFO:teuthology.orchestra.run.trial155.stdout:Install 14 Packages 2026-02-25T14:27:22.219 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:22.219 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 16 M 2026-02-25T14:27:22.219 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 158 M 2026-02-25T14:27:22.220 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:22.324 INFO:teuthology.orchestra.run.trial174.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 49 kB/s | 17 kB 00:00 2026-02-25T14:27:22.391 INFO:teuthology.orchestra.run.trial174.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 103 kB/s | 43 kB 00:00 2026-02-25T14:27:22.514 INFO:teuthology.orchestra.run.trial078.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 1.3 MB/s | 1.0 MB 00:00 2026-02-25T14:27:22.514 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:22.515 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.3 MB/s | 1.0 MB 00:00 2026-02-25T14:27:22.515 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:22.517 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:22.518 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:22.521 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:22.522 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:22.540 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:22.608 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:22.623 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:22.697 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:22.757 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-25T14:27:22.757 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:22.757 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:22.758 INFO:teuthology.orchestra.run.trial078.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:22.758 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:22.758 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:22.761 INFO:teuthology.orchestra.run.trial155.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 55 kB/s | 17 kB 00:00 2026-02-25T14:27:22.785 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T14:27:22.821 INFO:teuthology.orchestra.run.trial155.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 114 kB/s | 43 kB 00:00 2026-02-25T14:27:22.919 INFO:teuthology.orchestra.run.trial155.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 485 kB/s | 48 kB 00:00 2026-02-25T14:27:22.967 INFO:teuthology.orchestra.run.trial155.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 4.9 MB/s | 1.0 MB 00:00 2026-02-25T14:27:22.997 INFO:teuthology.orchestra.run.trial155.stdout:(5/14): protobuf-compiler-3.14.0-17.el9.x86_64. 28 MB/s | 862 kB 00:00 2026-02-25T14:27:23.007 INFO:teuthology.orchestra.run.trial155.stdout:(6/14): python3-protobuf-3.14.0-17.el9.noarch.r 3.0 MB/s | 267 kB 00:00 2026-02-25T14:27:23.026 INFO:teuthology.orchestra.run.trial174.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 75 kB/s | 48 kB 00:00 2026-02-25T14:27:23.096 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:14 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:23.180 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:23.181 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:23.181 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:27:23.181 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:23.181 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:23.181 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-25T14:27:23.181 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:23.181 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:23.182 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:23.182 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:27:23.182 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:23.182 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 154 k 2026-02-25T14:27:23.182 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 447 k 2026-02-25T14:27:23.182 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:23.308 INFO:teuthology.orchestra.run.trial155.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2026-02-25T14:27:23.499 INFO:teuthology.orchestra.run.trial174.stdout:(4/14): python3-protobuf-3.14.0-17.el9.noarch.r 566 kB/s | 267 kB 00:00 2026-02-25T14:27:23.579 INFO:teuthology.orchestra.run.trial155.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 947 kB/s | 551 kB 00:00 2026-02-25T14:27:23.616 INFO:teuthology.orchestra.run.trial078.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 354 kB/s | 154 kB 00:00 2026-02-25T14:27:23.618 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:23.618 INFO:teuthology.orchestra.run.trial078.stdout:Total 352 kB/s | 154 kB 00:00 2026-02-25T14:27:23.618 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:23.623 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:23.623 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:23.649 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:23.650 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:23.700 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:23.701 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:23.723 INFO:teuthology.orchestra.run.trial155.stdout:(9/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 4.9 MB/s | 2.0 MB 00:00 2026-02-25T14:27:23.723 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:23.723 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:23.723 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T14:27:23.724 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:23.724 INFO:teuthology.orchestra.run.trial155.stdout:(10/14): python3-grpcio-tools-1.46.7-10.el9.x86 1.0 MB/s | 144 kB 00:00 2026-02-25T14:27:23.794 INFO:teuthology.orchestra.run.trial155.stdout:(11/14): python3-repoze-lru-0.7-16.el9.noarch.r 430 kB/s | 31 kB 00:00 2026-02-25T14:27:23.799 INFO:teuthology.orchestra.run.trial155.stdout:(12/14): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2026-02-25T14:27:23.841 INFO:teuthology.orchestra.run.trial167.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.6 MB/s | 7.4 MB 00:04 2026-02-25T14:27:23.843 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:23.843 INFO:teuthology.orchestra.run.trial167.stdout:Total 9.0 MB/s | 43 MB 00:04 2026-02-25T14:27:23.866 INFO:teuthology.orchestra.run.trial155.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 309 kB/s | 22 kB 00:00 2026-02-25T14:27:24.003 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:24.016 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:24.016 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:24.018 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-25T14:27:24.018 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:24.018 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:24.018 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:24.018 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:24.018 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:24.047 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr 2026-02-25T14:27:24.085 INFO:teuthology.orchestra.run.trial174.stdout:(5/14): protobuf-3.14.0-17.el9.x86_64.rpm 584 kB/s | 1.0 MB 00:01 2026-02-25T14:27:24.218 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:24.219 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:24.220 INFO:teuthology.orchestra.run.trial174.stdout:(6/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 4.0 MB/s | 551 kB 00:00 2026-02-25T14:27:24.238 INFO:teuthology.orchestra.run.trial174.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2026-02-25T14:27:24.299 INFO:teuthology.orchestra.run.trial174.stdout:(8/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 33 MB/s | 2.0 MB 00:00 2026-02-25T14:27:24.320 INFO:teuthology.orchestra.run.trial174.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 6.9 MB/s | 144 kB 00:00 2026-02-25T14:27:24.338 INFO:teuthology.orchestra.run.trial174.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 1.6 MB/s | 31 kB 00:00 2026-02-25T14:27:24.359 INFO:teuthology.orchestra.run.trial174.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 8.7 MB/s | 188 kB 00:00 2026-02-25T14:27:24.365 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:15 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:24.378 INFO:teuthology.orchestra.run.trial174.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 1.2 MB/s | 22 kB 00:00 2026-02-25T14:27:24.429 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:24.438 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:24.440 INFO:teuthology.orchestra.run.trial167.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-25T14:27:24.446 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-25T14:27:24.447 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:24.448 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:24.448 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:24.469 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-dashboard 2026-02-25T14:27:24.480 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-25T14:27:24.484 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-25T14:27:24.543 INFO:teuthology.orchestra.run.trial167.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-25T14:27:24.545 INFO:teuthology.orchestra.run.trial167.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-25T14:27:24.567 INFO:teuthology.orchestra.run.trial167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-25T14:27:24.604 INFO:teuthology.orchestra.run.trial174.stdout:(13/14): protobuf-compiler-3.14.0-17.el9.x86_64 780 kB/s | 862 kB 00:01 2026-02-25T14:27:24.778 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:15 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:24.862 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:24.862 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:24.862 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:27:24.862 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T14:27:24.863 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout:Install 14 Packages 2026-02-25T14:27:24.864 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:24.865 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 16 M 2026-02-25T14:27:24.865 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 158 M 2026-02-25T14:27:24.865 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:24.889 INFO:teuthology.orchestra.run.trial167.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-25T14:27:24.961 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-25T14:27:25.427 INFO:teuthology.orchestra.run.trial078.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 50 kB/s | 17 kB 00:00 2026-02-25T14:27:25.486 INFO:teuthology.orchestra.run.trial078.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 106 kB/s | 43 kB 00:00 2026-02-25T14:27:25.560 INFO:teuthology.orchestra.run.trial078.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 645 kB/s | 48 kB 00:00 2026-02-25T14:27:25.601 INFO:teuthology.orchestra.run.trial078.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2026-02-25T14:27:25.618 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-25T14:27:25.618 INFO:teuthology.orchestra.run.trial078.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 4.5 MB/s | 267 kB 00:00 2026-02-25T14:27:25.800 INFO:teuthology.orchestra.run.trial078.stdout:(6/14): protobuf-compiler-3.14.0-17.el9.x86_64. 4.2 MB/s | 862 kB 00:00 2026-02-25T14:27:25.825 INFO:teuthology.orchestra.run.trial078.stdout:(7/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.6 MB/s | 551 kB 00:00 2026-02-25T14:27:25.826 INFO:teuthology.orchestra.run.trial078.stdout:(8/14): grpc-data-1.46.7-10.el9.noarch.rpm 746 kB/s | 19 kB 00:00 2026-02-25T14:27:25.908 INFO:teuthology.orchestra.run.trial078.stdout:(9/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 25 MB/s | 2.0 MB 00:00 2026-02-25T14:27:25.909 INFO:teuthology.orchestra.run.trial078.stdout:(10/14): python3-grpcio-tools-1.46.7-10.el9.x86 1.7 MB/s | 144 kB 00:00 2026-02-25T14:27:25.933 INFO:teuthology.orchestra.run.trial078.stdout:(11/14): python3-repoze-lru-0.7-16.el9.noarch.r 1.2 MB/s | 31 kB 00:00 2026-02-25T14:27:25.934 INFO:teuthology.orchestra.run.trial078.stdout:(12/14): python3-routes-2.5.1-5.el9.noarch.rpm 7.2 MB/s | 188 kB 00:00 2026-02-25T14:27:25.957 INFO:teuthology.orchestra.run.trial078.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 907 kB/s | 22 kB 00:00 2026-02-25T14:27:26.070 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-25T14:27:26.071 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-25T14:27:26.369 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-25T14:27:26.369 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-25T14:27:26.369 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-25T14:27:26.370 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-25T14:27:26.370 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-25T14:27:26.370 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-25T14:27:26.370 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-25T14:27:26.370 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-25T14:27:26.370 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-25T14:27:26.370 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-25T14:27:26.371 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-25T14:27:26.371 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-25T14:27:26.431 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-25T14:27:26.431 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:26.431 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:26.431 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T14:27:26.432 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:26.433 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:26.468 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-mgr-rook 2026-02-25T14:27:26.785 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:20 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:26.868 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:26.869 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:26.869 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:27:26.869 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:26.869 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:26.869 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:26.870 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:26.871 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:26.871 INFO:teuthology.orchestra.run.trial167.stdout:Install 10 Packages 2026-02-25T14:27:26.871 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:26.871 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 2.0 M 2026-02-25T14:27:26.871 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 25 M 2026-02-25T14:27:26.871 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:27.369 INFO:teuthology.orchestra.run.trial155.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 2.1 MB/s | 11 MB 00:04 2026-02-25T14:27:27.371 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:27.372 INFO:teuthology.orchestra.run.trial155.stdout:Total 3.1 MB/s | 16 MB 00:05 2026-02-25T14:27:27.384 INFO:teuthology.orchestra.run.trial167.stdout:(1/10): python3-pyasn1-modules-0.4.8-7.el9.noar 2.8 MB/s | 277 kB 00:00 2026-02-25T14:27:27.390 INFO:teuthology.orchestra.run.trial167.stdout:(2/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.5 MB/s | 157 kB 00:00 2026-02-25T14:27:27.408 INFO:teuthology.orchestra.run.trial167.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 2.3 MB/s | 54 kB 00:00 2026-02-25T14:27:27.412 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:27.421 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:27.422 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:27.518 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:27.518 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:27.592 INFO:teuthology.orchestra.run.trial167.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 77 kB/s | 14 kB 00:00 2026-02-25T14:27:27.613 INFO:teuthology.orchestra.run.trial167.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 144 kB/s | 32 kB 00:00 2026-02-25T14:27:27.637 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:27.645 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-25T14:27:27.649 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-25T14:27:27.654 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-25T14:27:27.665 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-25T14:27:27.667 INFO:teuthology.orchestra.run.trial167.stdout:(6/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 132 kB/s | 50 kB 00:00 2026-02-25T14:27:27.667 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-25T14:27:27.697 INFO:teuthology.orchestra.run.trial155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-25T14:27:27.741 INFO:teuthology.orchestra.run.trial155.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-25T14:27:27.770 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-25T14:27:27.780 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-25T14:27:27.787 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-25T14:27:27.790 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-25T14:27:27.797 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-25T14:27:27.871 INFO:teuthology.orchestra.run.trial167.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 909 kB/s | 254 kB 00:00 2026-02-25T14:27:27.928 INFO:teuthology.orchestra.run.trial167.stdout:(8/10): python3-rsa-4.9-2.el9.noarch.rpm 226 kB/s | 59 kB 00:00 2026-02-25T14:27:27.948 INFO:teuthology.orchestra.run.trial167.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 1.1 MB/s | 90 kB 00:00 2026-02-25T14:27:27.999 INFO:teuthology.orchestra.run.trial167.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 2.6 MB/s | 1.0 MB 00:00 2026-02-25T14:27:28.000 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:28.000 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2026-02-25T14:27:28.024 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:28.033 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:28.033 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:28.073 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:28.074 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:28.149 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:28.179 INFO:teuthology.orchestra.run.trial078.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 3.4 MB/s | 11 MB 00:03 2026-02-25T14:27:28.181 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:28.181 INFO:teuthology.orchestra.run.trial078.stdout:Total 4.8 MB/s | 16 MB 00:03 2026-02-25T14:27:28.200 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-25T14:27:28.213 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-25T14:27:28.216 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:28.226 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:28.226 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:28.228 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-25T14:27:28.232 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-25T14:27:28.240 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-25T14:27:28.280 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-25T14:27:28.292 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-25T14:27:28.323 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:28.323 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:28.441 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:28.449 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-25T14:27:28.453 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-25T14:27:28.458 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-25T14:27:28.469 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-25T14:27:28.471 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-25T14:27:28.498 INFO:teuthology.orchestra.run.trial078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-25T14:27:28.542 INFO:teuthology.orchestra.run.trial078.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-25T14:27:28.570 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-25T14:27:28.580 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-25T14:27:28.587 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-25T14:27:28.590 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-25T14:27:28.597 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-25T14:27:28.612 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-25T14:27:28.626 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-25T14:27:28.627 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-25T14:27:28.742 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-25T14:27:28.743 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-25T14:27:28.805 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-25T14:27:28.805 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:28.805 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:28.805 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:28.805 INFO:teuthology.orchestra.run.trial167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:28.806 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:28.835 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-mgr-cephadm 2026-02-25T14:27:28.943 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-25T14:27:28.947 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-25T14:27:29.149 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:23 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:29.155 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-25T14:27:29.155 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-25T14:27:29.155 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-25T14:27:29.155 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-25T14:27:29.156 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-25T14:27:29.215 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-25T14:27:29.215 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:29.215 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:29.215 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T14:27:29.215 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:29.215 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T14:27:29.216 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T14:27:29.217 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T14:27:29.217 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:29.217 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:29.233 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:29.234 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:29.234 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:27:29.234 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:29.234 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:29.234 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-25T14:27:29.234 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:29.235 INFO:teuthology.orchestra.run.trial167.stdout:Install 7 Packages 2026-02-25T14:27:29.236 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:29.236 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 7.1 M 2026-02-25T14:27:29.236 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 33 M 2026-02-25T14:27:29.236 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:29.249 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-25T14:27:29.486 INFO:teuthology.orchestra.run.trial174.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 1.4 MB/s | 11 MB 00:07 2026-02-25T14:27:29.488 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:29.488 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.9 MB/s | 16 MB 00:08 2026-02-25T14:27:29.525 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:29.535 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:29.535 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:29.572 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:24 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:29.632 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:29.632 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:29.657 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:29.658 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-25T14:27:29.658 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:27:29.658 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-25T14:27:29.658 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:29.658 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-25T14:27:29.658 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T14:27:29.659 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:29.660 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:29.660 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-25T14:27:29.660 INFO:teuthology.orchestra.run.trial155.stdout:Install 12 Packages 2026-02-25T14:27:29.660 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:29.661 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 43 M 2026-02-25T14:27:29.661 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 234 M 2026-02-25T14:27:29.661 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:29.711 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-25T14:27:29.716 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-25T14:27:29.749 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:29.758 INFO:teuthology.orchestra.run.trial174.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-25T14:27:29.761 INFO:teuthology.orchestra.run.trial174.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-25T14:27:29.766 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-25T14:27:29.774 INFO:teuthology.orchestra.run.trial167.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.9 MB/s | 249 kB 00:00 2026-02-25T14:27:29.777 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-25T14:27:29.779 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-25T14:27:29.797 INFO:teuthology.orchestra.run.trial167.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 1.5 MB/s | 35 kB 00:00 2026-02-25T14:27:29.806 INFO:teuthology.orchestra.run.trial174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-25T14:27:29.838 INFO:teuthology.orchestra.run.trial167.stdout:(3/7): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2026-02-25T14:27:29.849 INFO:teuthology.orchestra.run.trial174.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-25T14:27:29.878 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-25T14:27:29.888 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-25T14:27:29.894 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-25T14:27:29.897 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-25T14:27:29.904 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-25T14:27:29.920 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:29.982 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:29.999 INFO:teuthology.orchestra.run.trial167.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 364 kB/s | 58 kB 00:00 2026-02-25T14:27:30.018 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-25T14:27:30.061 INFO:teuthology.orchestra.run.trial167.stdout:(5/7): python3-typing-extensions-4.15.0-1.el9.n 1.4 MB/s | 86 kB 00:00 2026-02-25T14:27:30.063 INFO:teuthology.orchestra.run.trial167.stdout:(6/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.0 MB/s | 548 kB 00:00 2026-02-25T14:27:30.215 INFO:teuthology.orchestra.run.trial155.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 838 kB/s | 184 kB 00:00 2026-02-25T14:27:30.241 INFO:teuthology.orchestra.run.trial155.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 1.1 MB/s | 30 kB 00:00 2026-02-25T14:27:30.252 INFO:teuthology.orchestra.run.trial167.stdout:(7/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 286 kB/s | 173 kB 00:00 2026-02-25T14:27:30.253 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:30.253 INFO:teuthology.orchestra.run.trial167.stdout:Total 6.9 MB/s | 7.1 MB 00:01 2026-02-25T14:27:30.279 INFO:teuthology.orchestra.run.trial155.stdout:(3/12): libgfortran-11.5.0-14.el9.x86_64.rpm 2.7 MB/s | 794 kB 00:00 2026-02-25T14:27:30.294 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:30.300 INFO:teuthology.orchestra.run.trial155.stdout:(4/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 51 MB/s | 3.0 MB 00:00 2026-02-25T14:27:30.301 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:30.301 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:30.303 INFO:teuthology.orchestra.run.trial155.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 613 kB/s | 15 kB 00:00 2026-02-25T14:27:30.310 INFO:teuthology.orchestra.run.trial155.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 4.5 MB/s | 42 kB 00:00 2026-02-25T14:27:30.321 INFO:teuthology.orchestra.run.trial155.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 22 MB/s | 244 kB 00:00 2026-02-25T14:27:30.335 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:21 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:30.353 INFO:teuthology.orchestra.run.trial155.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 194 MB/s | 6.1 MB 00:00 2026-02-25T14:27:30.365 INFO:teuthology.orchestra.run.trial155.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 35 MB/s | 442 kB 00:00 2026-02-25T14:27:30.373 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:30.374 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:30.376 INFO:teuthology.orchestra.run.trial155.stdout:(10/12): openblas-openmp-0.3.29-1.el9.x86_64.rp 73 MB/s | 5.3 MB 00:00 2026-02-25T14:27:30.419 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T14:27:30.420 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:30.421 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:30.422 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-25T14:27:30.422 INFO:teuthology.orchestra.run.trial078.stdout:Install 12 Packages 2026-02-25T14:27:30.422 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:30.422 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 43 M 2026-02-25T14:27:30.423 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 234 M 2026-02-25T14:27:30.423 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:30.458 INFO:teuthology.orchestra.run.trial155.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 209 MB/s | 19 MB 00:00 2026-02-25T14:27:30.465 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:30.514 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-25T14:27:30.524 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-25T14:27:30.529 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-25T14:27:30.751 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-25T14:27:30.775 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-25T14:27:30.798 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-25T14:27:30.800 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-25T14:27:30.914 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-25T14:27:30.915 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-25T14:27:30.915 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-25T14:27:30.915 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-25T14:27:30.915 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-25T14:27:30.915 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-25T14:27:30.915 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-25T14:27:30.977 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-25T14:27:30.977 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:30.978 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:31.007 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-fuse 2026-02-25T14:27:31.029 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-25T14:27:31.034 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-25T14:27:31.235 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-25T14:27:31.235 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-25T14:27:31.235 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-25T14:27:31.235 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-25T14:27:31.235 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-25T14:27:31.235 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-25T14:27:31.235 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-25T14:27:31.236 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-25T14:27:31.236 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-25T14:27:31.236 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-25T14:27:31.236 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-25T14:27:31.236 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-25T14:27:31.236 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-25T14:27:31.236 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-25T14:27:31.294 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T14:27:31.295 INFO:teuthology.orchestra.run.trial174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T14:27:31.296 INFO:teuthology.orchestra.run.trial174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T14:27:31.296 INFO:teuthology.orchestra.run.trial174.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T14:27:31.296 INFO:teuthology.orchestra.run.trial174.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T14:27:31.296 INFO:teuthology.orchestra.run.trial174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T14:27:31.296 INFO:teuthology.orchestra.run.trial174.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T14:27:31.296 INFO:teuthology.orchestra.run.trial174.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T14:27:31.296 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:31.296 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:31.326 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:25 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:31.328 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-25T14:27:31.329 INFO:teuthology.orchestra.run.trial078.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 235 kB/s | 184 kB 00:00 2026-02-25T14:27:31.397 INFO:teuthology.orchestra.run.trial078.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 435 kB/s | 30 kB 00:00 2026-02-25T14:27:31.410 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:31.411 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:31.411 INFO:teuthology.orchestra.run.trial167.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:31.411 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:31.411 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:31.411 INFO:teuthology.orchestra.run.trial167.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-25T14:27:31.411 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:31.412 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:31.412 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:31.412 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:27:31.412 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:31.412 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 942 k 2026-02-25T14:27:31.412 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 2.7 M 2026-02-25T14:27:31.412 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:31.546 INFO:teuthology.orchestra.run.trial078.stdout:(3/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 20 MB/s | 3.0 MB 00:00 2026-02-25T14:27:31.566 INFO:teuthology.orchestra.run.trial078.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 742 kB/s | 15 kB 00:00 2026-02-25T14:27:31.586 INFO:teuthology.orchestra.run.trial078.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 2.1 MB/s | 42 kB 00:00 2026-02-25T14:27:31.641 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:25 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:31.642 INFO:teuthology.orchestra.run.trial078.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 95 MB/s | 5.3 MB 00:00 2026-02-25T14:27:31.668 INFO:teuthology.orchestra.run.trial078.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 9.1 MB/s | 244 kB 00:00 2026-02-25T14:27:31.724 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:31.725 INFO:teuthology.orchestra.run.trial174.stdout:====================================================================================== 2026-02-25T14:27:31.725 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:27:31.725 INFO:teuthology.orchestra.run.trial174.stdout:====================================================================================== 2026-02-25T14:27:31.725 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:31.725 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-25T14:27:31.725 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:27:31.725 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:31.726 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:31.727 INFO:teuthology.orchestra.run.trial174.stdout:====================================================================================== 2026-02-25T14:27:31.727 INFO:teuthology.orchestra.run.trial174.stdout:Install 12 Packages 2026-02-25T14:27:31.727 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:31.727 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 43 M 2026-02-25T14:27:31.728 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 234 M 2026-02-25T14:27:31.728 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:31.749 INFO:teuthology.orchestra.run.trial078.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 75 MB/s | 6.1 MB 00:00 2026-02-25T14:27:31.775 INFO:teuthology.orchestra.run.trial078.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 17 MB/s | 442 kB 00:00 2026-02-25T14:27:31.967 INFO:teuthology.orchestra.run.trial078.stdout:(10/12): libgfortran-11.5.0-14.el9.x86_64.rpm 558 kB/s | 794 kB 00:01 2026-02-25T14:27:32.050 INFO:teuthology.orchestra.run.trial078.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 70 MB/s | 19 MB 00:00 2026-02-25T14:27:32.375 INFO:teuthology.orchestra.run.trial174.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 1.9 MB/s | 184 kB 00:00 2026-02-25T14:27:32.413 INFO:teuthology.orchestra.run.trial174.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 5.7 MB/s | 794 kB 00:00 2026-02-25T14:27:32.445 INFO:teuthology.orchestra.run.trial167.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 911 kB/s | 942 kB 00:01 2026-02-25T14:27:32.446 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:32.446 INFO:teuthology.orchestra.run.trial167.stdout:Total 910 kB/s | 942 kB 00:01 2026-02-25T14:27:32.446 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:32.451 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:32.451 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:32.484 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:32.484 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:32.573 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:32.590 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:32.814 INFO:teuthology.orchestra.run.trial174.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 67 kB/s | 30 kB 00:00 2026-02-25T14:27:32.850 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:32.914 INFO:teuthology.orchestra.run.trial174.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 150 kB/s | 15 kB 00:00 2026-02-25T14:27:32.914 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:32.914 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:32.914 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:32.914 INFO:teuthology.orchestra.run.trial167.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:32.915 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:32.915 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:32.926 INFO:teuthology.orchestra.run.trial155.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 2.5 MB/s | 7.4 MB 00:02 2026-02-25T14:27:32.927 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:32.927 INFO:teuthology.orchestra.run.trial155.stdout:Total 13 MB/s | 43 MB 00:03 2026-02-25T14:27:32.944 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-volume 2026-02-25T14:27:33.088 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:33.091 INFO:teuthology.orchestra.run.trial174.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 237 kB/s | 42 kB 00:00 2026-02-25T14:27:33.101 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:33.101 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:33.265 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:27 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:33.305 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:33.305 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:33.348 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:33.348 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:33.348 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repository Size 2026-02-25T14:27:33.348 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout:Install 2 Packages 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 648 k 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 2.2 M 2026-02-25T14:27:33.349 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:33.524 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:33.526 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-25T14:27:33.532 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-25T14:27:33.566 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-25T14:27:33.571 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-25T14:27:33.607 INFO:teuthology.orchestra.run.trial167.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 1.8 MB/s | 351 kB 00:00 2026-02-25T14:27:33.629 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-25T14:27:33.632 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-25T14:27:33.653 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-25T14:27:33.850 INFO:teuthology.orchestra.run.trial078.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 2.2 MB/s | 7.4 MB 00:03 2026-02-25T14:27:33.851 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:33.852 INFO:teuthology.orchestra.run.trial078.stdout:Total 12 MB/s | 43 MB 00:03 2026-02-25T14:27:33.874 INFO:teuthology.orchestra.run.trial167.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 644 kB/s | 297 kB 00:00 2026-02-25T14:27:33.876 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:33.876 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.2 MB/s | 648 kB 00:00 2026-02-25T14:27:33.886 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:33.892 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:33.892 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:33.936 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:33.936 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:33.978 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-25T14:27:34.011 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:34.018 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:34.024 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:34.025 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:34.051 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-25T14:27:34.081 INFO:teuthology.orchestra.run.trial167.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-25T14:27:34.083 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-25T14:27:34.098 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-25T14:27:34.098 INFO:teuthology.orchestra.run.trial167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:34.098 INFO:teuthology.orchestra.run.trial167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T14:27:34.098 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:34.226 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:34.226 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:34.323 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-25T14:27:34.385 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-25T14:27:34.385 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:34.386 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:34.386 INFO:teuthology.orchestra.run.trial167.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T14:27:34.386 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:34.386 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:34.413 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install librados-devel 2026-02-25T14:27:34.444 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:34.446 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-25T14:27:34.453 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-25T14:27:34.487 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-25T14:27:34.491 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-25T14:27:34.550 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-25T14:27:34.553 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-25T14:27:34.574 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-25T14:27:34.726 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-25T14:27:34.730 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:28 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:34.814 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 126 k 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 449 k 2026-02-25T14:27:34.815 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:34.897 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-25T14:27:34.969 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-25T14:27:35.185 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-25T14:27:35.186 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-25T14:27:35.226 INFO:teuthology.orchestra.run.trial167.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 306 kB/s | 126 kB 00:00 2026-02-25T14:27:35.227 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:35.227 INFO:teuthology.orchestra.run.trial167.stdout:Total 305 kB/s | 126 kB 00:00 2026-02-25T14:27:35.228 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:35.230 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:35.230 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:35.261 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:35.261 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:35.316 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:35.334 INFO:teuthology.orchestra.run.trial167.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:35.424 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:35.482 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-25T14:27:35.482 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-25T14:27:35.482 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-25T14:27:35.482 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-25T14:27:35.483 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-25T14:27:35.483 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-25T14:27:35.483 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-25T14:27:35.483 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-25T14:27:35.483 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-25T14:27:35.483 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-25T14:27:35.483 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-25T14:27:35.483 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-25T14:27:35.488 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:35.489 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:35.489 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:35.489 INFO:teuthology.orchestra.run.trial167.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:35.489 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:35.489 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:35.516 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install libcephfs2 2026-02-25T14:27:35.544 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T14:27:35.545 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T14:27:35.546 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T14:27:35.546 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T14:27:35.546 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T14:27:35.546 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:35.546 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:35.585 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-rook 2026-02-25T14:27:35.636 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-25T14:27:35.831 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:29 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:35.896 INFO:teuthology.orchestra.run.trial167.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:35.911 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:30 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:35.914 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:35.915 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:35.915 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:35.936 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install libcephfs-devel 2026-02-25T14:27:35.996 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:35.997 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:35.997 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:27:35.997 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:35.997 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:35.997 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-25T14:27:35.997 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:27:35.997 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout:Install 10 Packages 2026-02-25T14:27:35.998 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:35.999 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 2.0 M 2026-02-25T14:27:35.999 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 25 M 2026-02-25T14:27:35.999 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:36.091 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-25T14:27:36.092 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-25T14:27:36.249 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:30 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:36.301 INFO:teuthology.orchestra.run.trial174.stdout:(6/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 787 kB/s | 3.0 MB 00:03 2026-02-25T14:27:36.332 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:Installing dependencies: 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:Install 2 Packages 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 58 k 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 207 k 2026-02-25T14:27:36.333 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:36.341 INFO:teuthology.orchestra.run.trial155.stdout:(1/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.4 MB/s | 157 kB 00:00 2026-02-25T14:27:36.359 INFO:teuthology.orchestra.run.trial155.stdout:(2/10): python3-pyasn1-modules-0.4.8-7.el9.noar 2.1 MB/s | 277 kB 00:00 2026-02-25T14:27:36.365 INFO:teuthology.orchestra.run.trial155.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 2.2 MB/s | 54 kB 00:00 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-25T14:27:36.394 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-25T14:27:36.458 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-25T14:27:36.458 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:36.458 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:36.458 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:36.458 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T14:27:36.458 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:36.459 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:36.494 INFO:teuthology.orchestra.run.trial155.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 109 kB/s | 14 kB 00:00 2026-02-25T14:27:36.497 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-rook 2026-02-25T14:27:36.532 INFO:teuthology.orchestra.run.trial155.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 186 kB/s | 32 kB 00:00 2026-02-25T14:27:36.536 INFO:teuthology.orchestra.run.trial155.stdout:(6/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 165 kB/s | 50 kB 00:00 2026-02-25T14:27:36.624 INFO:teuthology.orchestra.run.trial167.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 118 kB/s | 34 kB 00:00 2026-02-25T14:27:36.636 INFO:teuthology.orchestra.run.trial174.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 729 kB/s | 244 kB 00:00 2026-02-25T14:27:36.657 INFO:teuthology.orchestra.run.trial155.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 1.5 MB/s | 254 kB 00:00 2026-02-25T14:27:36.670 INFO:teuthology.orchestra.run.trial167.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 72 kB/s | 24 kB 00:00 2026-02-25T14:27:36.673 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:36.673 INFO:teuthology.orchestra.run.trial167.stdout:Total 172 kB/s | 58 kB 00:00 2026-02-25T14:27:36.673 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:36.677 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:36.677 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:36.703 INFO:teuthology.orchestra.run.trial155.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 1.9 MB/s | 90 kB 00:00 2026-02-25T14:27:36.708 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:36.708 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:36.733 INFO:teuthology.orchestra.run.trial155.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 300 kB/s | 59 kB 00:00 2026-02-25T14:27:36.757 INFO:teuthology.orchestra.run.trial155.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 4.5 MB/s | 1.0 MB 00:00 2026-02-25T14:27:36.758 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:36.758 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:36.759 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:36.759 INFO:teuthology.orchestra.run.trial155.stdout:Total 2.6 MB/s | 2.0 MB 00:00 2026-02-25T14:27:36.774 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:36.784 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:36.791 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:36.792 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:36.792 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:36.809 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:27 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:36.833 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:36.833 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:36.850 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:36.850 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:36.893 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:36.893 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:36.893 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:27:36.893 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:36.893 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:36.893 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout:Install 10 Packages 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 2.0 M 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 25 M 2026-02-25T14:27:36.894 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:36.908 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:36.912 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:36.912 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:36.912 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:36.912 INFO:teuthology.orchestra.run.trial167.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:36.912 INFO:teuthology.orchestra.run.trial167.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:36.912 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:36.912 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:36.938 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install librados2 2026-02-25T14:27:36.960 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-25T14:27:36.973 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-25T14:27:36.988 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-25T14:27:36.992 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-25T14:27:37.000 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-25T14:27:37.040 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-25T14:27:37.052 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-25T14:27:37.254 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:31 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:37.277 INFO:teuthology.orchestra.run.trial078.stdout:(1/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 208 kB/s | 50 kB 00:00 2026-02-25T14:27:37.319 INFO:teuthology.orchestra.run.trial167.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:37.337 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:37.338 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:37.338 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:37.359 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install librbd1 2026-02-25T14:27:37.369 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-25T14:27:37.384 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-25T14:27:37.384 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-25T14:27:37.500 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-25T14:27:37.500 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-25T14:27:37.501 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-25T14:27:37.501 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-25T14:27:37.501 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-25T14:27:37.501 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-25T14:27:37.501 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-25T14:27:37.501 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-25T14:27:37.501 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-25T14:27:37.501 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-25T14:27:37.562 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-25T14:27:37.562 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:37.562 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:37.562 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:37.562 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T14:27:37.562 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:37.563 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:37.593 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-cephadm 2026-02-25T14:27:37.674 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:31 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:37.739 INFO:teuthology.orchestra.run.trial167.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:37.758 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:37.758 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:37.758 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:37.780 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install python3-rados 2026-02-25T14:27:37.810 INFO:teuthology.orchestra.run.trial078.stdout:(2/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 203 kB/s | 157 kB 00:00 2026-02-25T14:27:37.873 INFO:teuthology.orchestra.run.trial078.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 90 kB/s | 54 kB 00:00 2026-02-25T14:27:37.876 INFO:teuthology.orchestra.run.trial078.stdout:(4/10): python3-pyasn1-modules-0.4.8-7.el9.noar 330 kB/s | 277 kB 00:00 2026-02-25T14:27:37.915 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:38.001 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:38.002 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:38.002 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:27:38.002 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:38.003 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:38.003 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-25T14:27:38.003 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:27:38.003 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T14:27:38.003 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T14:27:38.003 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T14:27:38.003 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T14:27:38.004 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T14:27:38.004 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T14:27:38.004 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:38.004 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:38.004 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:38.004 INFO:teuthology.orchestra.run.trial155.stdout:Install 7 Packages 2026-02-25T14:27:38.004 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:38.004 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 7.1 M 2026-02-25T14:27:38.005 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 33 M 2026-02-25T14:27:38.005 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:38.025 INFO:teuthology.orchestra.run.trial078.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 150 kB/s | 32 kB 00:00 2026-02-25T14:27:38.056 INFO:teuthology.orchestra.run.trial078.stdout:(6/10): python3-certifi-2023.05.07-4.el9.noarch 77 kB/s | 14 kB 00:00 2026-02-25T14:27:38.070 INFO:teuthology.orchestra.run.trial174.stdout:(8/12): ceph-mgr-diskprediction-local-20.2.0-68 1.3 MB/s | 7.4 MB 00:05 2026-02-25T14:27:38.092 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:38.157 INFO:teuthology.orchestra.run.trial167.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:38.175 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:38.176 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:38.176 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:38.197 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install python3-rgw 2026-02-25T14:27:38.219 INFO:teuthology.orchestra.run.trial078.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 364 kB/s | 59 kB 00:00 2026-02-25T14:27:38.276 INFO:teuthology.orchestra.run.trial078.stdout:(8/10): python3-google-auth-2.45.0-1.el9.noarch 637 kB/s | 254 kB 00:00 2026-02-25T14:27:38.344 INFO:teuthology.orchestra.run.trial078.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 716 kB/s | 90 kB 00:00 2026-02-25T14:27:38.398 INFO:teuthology.orchestra.run.trial078.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 2.7 MB/s | 1.0 MB 00:00 2026-02-25T14:27:38.398 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:38.399 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2026-02-25T14:27:38.424 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:38.432 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:38.432 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:38.472 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:38.472 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:38.473 INFO:teuthology.orchestra.run.trial155.stdout:(1/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 596 kB/s | 173 kB 00:00 2026-02-25T14:27:38.516 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:38.548 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:38.582 INFO:teuthology.orchestra.run.trial167.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:38.599 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-25T14:27:38.600 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:38.601 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:38.601 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:38.611 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-25T14:27:38.622 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install python3-cephfs 2026-02-25T14:27:38.626 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-25T14:27:38.631 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-25T14:27:38.639 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-25T14:27:38.678 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-25T14:27:38.690 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-25T14:27:38.892 INFO:teuthology.orchestra.run.trial155.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 83 kB/s | 35 kB 00:00 2026-02-25T14:27:38.943 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:39.007 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-25T14:27:39.011 INFO:teuthology.orchestra.run.trial167.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:39.022 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-25T14:27:39.023 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-25T14:27:39.028 INFO:teuthology.orchestra.run.trial155.stdout:(3/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 294 kB/s | 249 kB 00:00 2026-02-25T14:27:39.029 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:39.030 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:39.030 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:39.038 INFO:teuthology.orchestra.run.trial174.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 457 kB/s | 442 kB 00:00 2026-02-25T14:27:39.052 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install python3-rbd 2026-02-25T14:27:39.124 INFO:teuthology.orchestra.run.trial155.stdout:(4/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.3 MB/s | 548 kB 00:00 2026-02-25T14:27:39.140 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-25T14:27:39.140 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-25T14:27:39.141 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-25T14:27:39.141 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-25T14:27:39.141 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-25T14:27:39.141 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-25T14:27:39.141 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-25T14:27:39.141 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-25T14:27:39.141 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-25T14:27:39.141 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-25T14:27:39.156 INFO:teuthology.orchestra.run.trial155.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 453 kB/s | 58 kB 00:00 2026-02-25T14:27:39.157 INFO:teuthology.orchestra.run.trial155.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 2.5 MB/s | 86 kB 00:00 2026-02-25T14:27:39.201 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T14:27:39.202 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T14:27:39.203 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T14:27:39.203 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:39.203 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:39.233 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-cephadm 2026-02-25T14:27:39.256 INFO:teuthology.orchestra.run.trial174.stdout:(10/12): openblas-openmp-0.3.29-1.el9.x86_64.rp 878 kB/s | 5.3 MB 00:06 2026-02-25T14:27:39.369 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:33 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:39.434 INFO:teuthology.orchestra.run.trial167.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:39.453 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:39.454 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:27:39.454 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:39.475 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install rbd-fuse 2026-02-25T14:27:39.550 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:30 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:39.635 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:39.636 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:39.636 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:27:39.636 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:39.636 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:39.636 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-25T14:27:39.636 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:27:39.636 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T14:27:39.636 INFO:teuthology.orchestra.run.trial078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout:Install 7 Packages 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 7.1 M 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 33 M 2026-02-25T14:27:39.637 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:39.791 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:33 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:39.867 INFO:teuthology.orchestra.run.trial078.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 4.4 MB/s | 249 kB 00:00 2026-02-25T14:27:39.875 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:39.876 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:39.876 INFO:teuthology.orchestra.run.trial167.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:39.876 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:39.876 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:39.876 INFO:teuthology.orchestra.run.trial167.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-25T14:27:39.876 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:39.877 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:39.877 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:39.877 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:27:39.877 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:39.877 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 91 k 2026-02-25T14:27:39.877 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 238 k 2026-02-25T14:27:39.877 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:39.878 INFO:teuthology.orchestra.run.trial078.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 3.4 MB/s | 35 kB 00:00 2026-02-25T14:27:39.909 INFO:teuthology.orchestra.run.trial078.stdout:(3/7): python3-babel-2.9.1-2.el9.noarch.rpm 61 MB/s | 6.0 MB 00:00 2026-02-25T14:27:39.989 INFO:teuthology.orchestra.run.trial078.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 716 kB/s | 58 kB 00:00 2026-02-25T14:27:40.028 INFO:teuthology.orchestra.run.trial078.stdout:(5/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.5 MB/s | 548 kB 00:00 2026-02-25T14:27:40.031 INFO:teuthology.orchestra.run.trial078.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 2.0 MB/s | 86 kB 00:00 2026-02-25T14:27:40.184 INFO:teuthology.orchestra.run.trial078.stdout:(7/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 464 kB/s | 173 kB 00:00 2026-02-25T14:27:40.184 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:40.185 INFO:teuthology.orchestra.run.trial078.stdout:Total 13 MB/s | 7.1 MB 00:00 2026-02-25T14:27:40.207 INFO:teuthology.orchestra.run.trial167.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 276 kB/s | 91 kB 00:00 2026-02-25T14:27:40.208 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:40.208 INFO:teuthology.orchestra.run.trial167.stdout:Total 275 kB/s | 91 kB 00:00 2026-02-25T14:27:40.208 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:40.212 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:40.212 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:40.225 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:40.231 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:40.231 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:40.242 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:40.242 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:40.295 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:40.302 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:40.302 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:40.313 INFO:teuthology.orchestra.run.trial167.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:40.392 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:40.395 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:40.441 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-25T14:27:40.451 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-25T14:27:40.456 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-25T14:27:40.458 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:40.458 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:40.458 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:40.458 INFO:teuthology.orchestra.run.trial167.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:40.458 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:40.459 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:40.487 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install rbd-mirror 2026-02-25T14:27:40.676 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-25T14:27:40.699 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-25T14:27:40.723 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-25T14:27:40.724 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-25T14:27:40.809 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:34 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:40.836 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-25T14:27:40.836 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-25T14:27:40.836 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-25T14:27:40.837 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-25T14:27:40.837 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-25T14:27:40.837 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-25T14:27:40.837 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-25T14:27:40.894 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:40.894 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:40.894 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:27:40.894 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:40.894 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:40.894 INFO:teuthology.orchestra.run.trial167.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-25T14:27:40.894 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:40.895 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:40.895 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:40.895 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:27:40.895 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:40.895 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 2.9 M 2026-02-25T14:27:40.895 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 11 M 2026-02-25T14:27:40.895 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:40.897 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-25T14:27:40.897 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:40.897 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:40.897 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:40.897 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T14:27:40.897 INFO:teuthology.orchestra.run.trial078.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T14:27:40.897 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T14:27:40.897 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T14:27:40.898 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T14:27:40.898 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T14:27:40.898 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:40.898 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:40.929 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-fuse 2026-02-25T14:27:41.246 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:41.332 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:41.332 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:41.332 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:41.332 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:41.332 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:41.332 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-25T14:27:41.333 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:41.333 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:41.333 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:41.333 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:27:41.333 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:41.333 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 942 k 2026-02-25T14:27:41.333 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 2.7 M 2026-02-25T14:27:41.333 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:41.488 INFO:teuthology.orchestra.run.trial167.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 4.9 MB/s | 2.9 MB 00:00 2026-02-25T14:27:41.489 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:41.489 INFO:teuthology.orchestra.run.trial167.stdout:Total 4.9 MB/s | 2.9 MB 00:00 2026-02-25T14:27:41.490 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:41.495 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:41.495 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:41.534 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:41.534 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:41.713 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:41.715 INFO:teuthology.orchestra.run.trial167.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:41.737 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:41.738 INFO:teuthology.orchestra.run.trial167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:41.738 INFO:teuthology.orchestra.run.trial167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T14:27:41.738 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:27:41.738 INFO:teuthology.orchestra.run.trial167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:27:41.738 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:41.814 INFO:teuthology.orchestra.run.trial078.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.9 MB/s | 942 kB 00:00 2026-02-25T14:27:41.814 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:41.814 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.9 MB/s | 942 kB 00:00 2026-02-25T14:27:41.815 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:41.819 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:41.820 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:41.852 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:41.852 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:41.941 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:41.945 INFO:teuthology.orchestra.run.trial155.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 1.6 MB/s | 6.0 MB 00:03 2026-02-25T14:27:41.947 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:41.947 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.8 MB/s | 7.1 MB 00:03 2026-02-25T14:27:41.958 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:41.986 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:41.993 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:41.993 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:42.046 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:42.047 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:42.047 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:42.047 INFO:teuthology.orchestra.run.trial167.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:42.047 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:42.047 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:42.065 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:42.065 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:42.075 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install rbd-nbd 2026-02-25T14:27:42.156 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:42.200 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:42.206 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-25T14:27:42.216 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-25T14:27:42.222 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-25T14:27:42.261 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:42.262 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:42.262 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:42.262 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:42.262 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:42.262 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:42.291 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-volume 2026-02-25T14:27:42.399 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:36 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:42.448 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-25T14:27:42.472 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-25T14:27:42.483 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:42.483 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:27:42.484 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:42.485 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 180 k 2026-02-25T14:27:42.485 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 498 k 2026-02-25T14:27:42.485 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:42.495 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-25T14:27:42.497 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-25T14:27:42.607 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:33 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:42.612 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-25T14:27:42.612 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-25T14:27:42.613 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-25T14:27:42.613 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-25T14:27:42.613 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-25T14:27:42.613 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-25T14:27:42.613 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-25T14:27:42.624 INFO:teuthology.orchestra.run.trial174.stdout:(11/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 1.0 MB/s | 6.1 MB 00:05 2026-02-25T14:27:42.675 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:42.676 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:42.693 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:42.693 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout:Install 2 Packages 2026-02-25T14:27:42.694 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:42.695 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 648 k 2026-02-25T14:27:42.695 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 2.2 M 2026-02-25T14:27:42.695 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:42.709 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-fuse 2026-02-25T14:27:42.830 INFO:teuthology.orchestra.run.trial167.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 519 kB/s | 180 kB 00:00 2026-02-25T14:27:42.832 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:42.832 INFO:teuthology.orchestra.run.trial167.stdout:Total 515 kB/s | 180 kB 00:00 2026-02-25T14:27:42.832 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:42.837 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:42.837 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:42.868 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:42.868 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:42.913 INFO:teuthology.orchestra.run.trial078.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 2.6 MB/s | 351 kB 00:00 2026-02-25T14:27:42.924 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:27:42.941 INFO:teuthology.orchestra.run.trial167.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:43.029 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:38 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:43.035 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:43.098 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:43.099 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:43.099 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:27:43.099 INFO:teuthology.orchestra.run.trial167.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:43.099 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:43.099 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:27:43.113 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:43.114 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:43.114 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:43.114 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 942 k 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 2.7 M 2026-02-25T14:27:43.115 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:43.127 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:27:43.180 INFO:teuthology.orchestra.run.trial078.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 744 kB/s | 297 kB 00:00 2026-02-25T14:27:43.181 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:43.181 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.3 MB/s | 648 kB 00:00 2026-02-25T14:27:43.191 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:43.197 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:43.197 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:43.240 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:43.241 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:43.322 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:43.385 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-25T14:27:43.387 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-25T14:27:43.403 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-25T14:27:43.403 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:43.403 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T14:27:43.403 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:43.447 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:37 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:43.532 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:27:43.532 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:43.532 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:27:43.532 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 107 M 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 664 M 2026-02-25T14:27:43.533 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:27:43.637 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-25T14:27:43.643 INFO:teuthology.orchestra.run.trial155.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.7 MB/s | 942 kB 00:00 2026-02-25T14:27:43.643 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:43.643 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.7 MB/s | 942 kB 00:00 2026-02-25T14:27:43.644 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:43.649 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:43.649 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:43.681 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:43.681 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:43.699 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-25T14:27:43.699 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:43.699 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:43.699 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T14:27:43.699 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:43.699 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:43.727 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librados-devel 2026-02-25T14:27:43.773 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:43.791 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:44.017 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:44.040 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:35 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:44.080 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:44.080 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:44.080 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:44.080 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:44.080 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:44.080 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:44.108 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-volume 2026-02-25T14:27:44.125 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:44.126 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:44.126 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:27:44.126 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:44.126 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 126 k 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 449 k 2026-02-25T14:27:44.127 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:44.431 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:39 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:44.515 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:44.516 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:44.516 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-25T14:27:44.516 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:44.516 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:44.516 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-25T14:27:44.516 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:27:44.516 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T14:27:44.516 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:44.517 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:44.517 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:44.517 INFO:teuthology.orchestra.run.trial155.stdout:Install 2 Packages 2026-02-25T14:27:44.517 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:44.517 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 648 k 2026-02-25T14:27:44.517 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 2.2 M 2026-02-25T14:27:44.517 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:44.586 INFO:teuthology.orchestra.run.trial078.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 273 kB/s | 126 kB 00:00 2026-02-25T14:27:44.587 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:44.587 INFO:teuthology.orchestra.run.trial078.stdout:Total 273 kB/s | 126 kB 00:00 2026-02-25T14:27:44.587 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:44.590 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:44.590 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:44.620 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:44.621 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:44.675 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:44.692 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:44.772 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:44.835 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:44.836 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:44.836 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:44.836 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:44.836 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:44.836 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:44.864 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install libcephfs2 2026-02-25T14:27:45.076 INFO:teuthology.orchestra.run.trial155.stdout:(1/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 623 kB/s | 297 kB 00:00 2026-02-25T14:27:45.180 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:36 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:45.244 INFO:teuthology.orchestra.run.trial078.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:45.263 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:45.263 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:45.263 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:45.285 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install libcephfs-devel 2026-02-25T14:27:45.541 INFO:teuthology.orchestra.run.trial155.stdout:(2/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 372 kB/s | 351 kB 00:00 2026-02-25T14:27:45.542 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:45.542 INFO:teuthology.orchestra.run.trial155.stdout:Total 632 kB/s | 648 kB 00:01 2026-02-25T14:27:45.552 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:45.558 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:45.558 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:45.600 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:36 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:45.601 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:45.602 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:45.683 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:45.685 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:45.686 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:45.686 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout:Install 2 Packages 2026-02-25T14:27:45.687 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:45.688 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 58 k 2026-02-25T14:27:45.688 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 207 k 2026-02-25T14:27:45.688 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:45.747 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-25T14:27:45.749 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-25T14:27:45.754 INFO:teuthology.orchestra.run.trial174.stdout:(12/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 2.9 MB/s | 19 MB 00:06 2026-02-25T14:27:45.757 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:45.757 INFO:teuthology.orchestra.run.trial174.stdout:Total 3.0 MB/s | 43 MB 00:14 2026-02-25T14:27:45.764 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-25T14:27:45.764 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:45.764 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T14:27:45.764 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:45.914 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:45.927 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:45.927 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:46.007 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-25T14:27:46.019 INFO:teuthology.orchestra.run.trial078.stdout:(1/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 73 kB/s | 24 kB 00:00 2026-02-25T14:27:46.023 INFO:teuthology.orchestra.run.trial078.stdout:(2/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 102 kB/s | 34 kB 00:00 2026-02-25T14:27:46.023 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:46.024 INFO:teuthology.orchestra.run.trial078.stdout:Total 173 kB/s | 58 kB 00:00 2026-02-25T14:27:46.024 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:46.027 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:46.027 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:46.058 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:46.058 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:46.069 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-25T14:27:46.069 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:46.070 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:46.070 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T14:27:46.070 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:46.070 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:46.098 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados-devel 2026-02-25T14:27:46.107 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:46.108 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:46.122 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:46.129 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:46.130 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:46.139 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:46.204 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:46.204 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:46.265 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:46.265 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:46.266 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:46.266 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:46.266 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:46.266 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:46.266 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:46.293 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librados2 2026-02-25T14:27:46.349 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:46.351 INFO:teuthology.orchestra.run.trial174.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-25T14:27:46.357 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-25T14:27:46.391 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-25T14:27:46.396 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-25T14:27:46.421 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:41 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:46.456 INFO:teuthology.orchestra.run.trial174.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-25T14:27:46.458 INFO:teuthology.orchestra.run.trial174.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-25T14:27:46.479 INFO:teuthology.orchestra.run.trial174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-25T14:27:46.506 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:46.507 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:46.507 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:27:46.507 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 126 k 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 449 k 2026-02-25T14:27:46.508 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:46.613 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:37 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:46.678 INFO:teuthology.orchestra.run.trial078.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:46.696 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:46.697 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:46.697 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:46.718 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librbd1 2026-02-25T14:27:46.804 INFO:teuthology.orchestra.run.trial174.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-25T14:27:46.876 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-25T14:27:46.999 INFO:teuthology.orchestra.run.trial155.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 256 kB/s | 126 kB 00:00 2026-02-25T14:27:46.999 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:47.000 INFO:teuthology.orchestra.run.trial155.stdout:Total 255 kB/s | 126 kB 00:00 2026-02-25T14:27:47.000 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:47.002 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:47.002 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:47.034 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:47.034 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:47.038 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:38 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:47.089 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:47.104 INFO:teuthology.orchestra.run.trial078.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:47.106 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:47.123 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:47.124 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:47.124 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:47.146 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rados 2026-02-25T14:27:47.189 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:47.251 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:47.252 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:47.252 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:47.252 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:47.252 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:47.252 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:47.280 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs2 2026-02-25T14:27:47.465 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:38 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:47.533 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:47.545 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-25T14:27:47.551 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:47.552 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:47.552 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:47.574 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rgw 2026-02-25T14:27:47.603 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:42 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:47.668 INFO:teuthology.orchestra.run.trial155.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:47.686 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:47.687 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:47.687 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:47.709 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs-devel 2026-02-25T14:27:47.888 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:38 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:47.954 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:47.972 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:47.973 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:47.973 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:47.994 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-cephfs 2026-02-25T14:27:47.999 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-25T14:27:48.000 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-25T14:27:48.026 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:43 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:48.113 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:48.114 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:48.114 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:48.115 INFO:teuthology.orchestra.run.trial155.stdout:Install 2 Packages 2026-02-25T14:27:48.116 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:48.116 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 58 k 2026-02-25T14:27:48.116 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 207 k 2026-02-25T14:27:48.116 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:48.306 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-25T14:27:48.306 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-25T14:27:48.307 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-25T14:27:48.311 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:39 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:48.370 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-25T14:27:48.370 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:48.370 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:48.370 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:48.370 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T14:27:48.370 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T14:27:48.370 INFO:teuthology.orchestra.run.trial174.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:48.371 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:48.377 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:48.395 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:48.396 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:48.396 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:48.409 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-rook 2026-02-25T14:27:48.417 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rbd 2026-02-25T14:27:48.450 INFO:teuthology.orchestra.run.trial155.stdout:(1/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 72 kB/s | 24 kB 00:00 2026-02-25T14:27:48.453 INFO:teuthology.orchestra.run.trial155.stdout:(2/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 101 kB/s | 34 kB 00:00 2026-02-25T14:27:48.456 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:48.457 INFO:teuthology.orchestra.run.trial155.stdout:Total 171 kB/s | 58 kB 00:00 2026-02-25T14:27:48.457 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:48.459 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:48.459 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:48.491 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:48.491 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:48.540 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:48.541 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:48.557 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:48.576 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:48.639 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:48.639 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:48.701 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:48.701 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:48.701 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:48.701 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:48.701 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:48.702 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:48.702 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:48.730 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados2 2026-02-25T14:27:48.731 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:39 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:48.731 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:42 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:48.796 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:48.814 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:48.815 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:48.815 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:27:48.815 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:48.815 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:48.815 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T14:27:48.816 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:48.817 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:48.817 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:48.817 INFO:teuthology.orchestra.run.trial174.stdout:Install 10 Packages 2026-02-25T14:27:48.817 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:48.818 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:48.818 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:27:48.818 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:48.818 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 2.0 M 2026-02-25T14:27:48.818 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 25 M 2026-02-25T14:27:48.819 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:48.836 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-fuse 2026-02-25T14:27:49.050 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:44 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:49.117 INFO:teuthology.orchestra.run.trial155.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:49.135 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:49.136 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:49.136 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:49.153 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:40 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:49.158 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librbd1 2026-02-25T14:27:49.238 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:49.239 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:49.239 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:49.239 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:49.239 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:49.239 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-25T14:27:49.240 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:49.240 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:49.240 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:49.240 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:27:49.240 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:49.240 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 91 k 2026-02-25T14:27:49.240 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 238 k 2026-02-25T14:27:49.240 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:49.400 INFO:teuthology.orchestra.run.trial174.stdout:(1/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 121 kB/s | 50 kB 00:00 2026-02-25T14:27:49.478 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:44 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:49.544 INFO:teuthology.orchestra.run.trial155.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:49.563 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:49.564 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:49.564 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:49.585 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rados 2026-02-25T14:27:49.659 INFO:teuthology.orchestra.run.trial078.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 217 kB/s | 91 kB 00:00 2026-02-25T14:27:49.660 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:49.660 INFO:teuthology.orchestra.run.trial078.stdout:Total 217 kB/s | 91 kB 00:00 2026-02-25T14:27:49.660 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:49.660 INFO:teuthology.orchestra.run.trial174.stdout:(2/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 234 kB/s | 157 kB 00:00 2026-02-25T14:27:49.663 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:49.664 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:49.693 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:49.694 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:49.742 INFO:teuthology.orchestra.run.trial174.stdout:(3/10): python3-pyasn1-modules-0.4.8-7.el9.noar 367 kB/s | 277 kB 00:00 2026-02-25T14:27:49.745 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:49.762 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:49.782 INFO:teuthology.orchestra.run.trial174.stdout:(4/10): python3-cachetools-4.2.4-1.el9.noarch.r 262 kB/s | 32 kB 00:00 2026-02-25T14:27:49.839 INFO:teuthology.orchestra.run.trial174.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 145 kB/s | 14 kB 00:00 2026-02-25T14:27:49.847 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:49.900 INFO:teuthology.orchestra.run.trial174.stdout:(6/10): python3-requests-oauthlib-1.3.0-12.el9. 107 kB/s | 54 kB 00:00 2026-02-25T14:27:49.901 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:44 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:49.909 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:49.910 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:49.910 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:49.910 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:49.910 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:49.910 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:49.921 INFO:teuthology.orchestra.run.trial174.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 1.8 MB/s | 254 kB 00:00 2026-02-25T14:27:49.937 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-mirror 2026-02-25T14:27:49.961 INFO:teuthology.orchestra.run.trial174.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 2.2 MB/s | 90 kB 00:00 2026-02-25T14:27:49.966 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:49.985 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:49.985 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:49.986 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:50.006 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rgw 2026-02-25T14:27:50.039 INFO:teuthology.orchestra.run.trial174.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 426 kB/s | 59 kB 00:00 2026-02-25T14:27:50.052 INFO:teuthology.orchestra.run.trial174.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 4.8 MB/s | 1.0 MB 00:00 2026-02-25T14:27:50.053 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:50.054 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.6 MB/s | 2.0 MB 00:01 2026-02-25T14:27:50.079 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:50.086 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:50.087 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:50.127 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:50.127 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:50.206 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:50.254 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:41 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:50.257 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-25T14:27:50.269 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-25T14:27:50.284 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-25T14:27:50.288 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-25T14:27:50.296 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-25T14:27:50.325 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:45 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:50.335 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-25T14:27:50.337 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:50.338 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:50.338 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:27:50.339 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:50.339 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:50.339 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-25T14:27:50.339 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:50.339 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:50.339 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:50.339 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:27:50.339 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:50.340 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 2.9 M 2026-02-25T14:27:50.340 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 11 M 2026-02-25T14:27:50.340 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:50.348 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-25T14:27:50.392 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:50.411 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:50.412 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:50.412 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:50.432 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-cephfs 2026-02-25T14:27:50.664 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-25T14:27:50.679 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-25T14:27:50.679 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-25T14:27:50.755 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:45 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:50.796 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-25T14:27:50.797 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-25T14:27:50.822 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:50.841 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:50.841 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:50.841 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:50.859 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-25T14:27:50.859 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:50.859 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:50.859 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:50.859 INFO:teuthology.orchestra.run.trial174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T14:27:50.859 INFO:teuthology.orchestra.run.trial174.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T14:27:50.859 INFO:teuthology.orchestra.run.trial174.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T14:27:50.859 INFO:teuthology.orchestra.run.trial174.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T14:27:50.860 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T14:27:50.860 INFO:teuthology.orchestra.run.trial174.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T14:27:50.860 INFO:teuthology.orchestra.run.trial174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T14:27:50.860 INFO:teuthology.orchestra.run.trial174.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T14:27:50.860 INFO:teuthology.orchestra.run.trial174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T14:27:50.860 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:50.860 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:50.863 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rbd 2026-02-25T14:27:50.890 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-cephadm 2026-02-25T14:27:51.175 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:46 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:51.204 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:45 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:51.239 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:51.258 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:51.259 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T14:27:51.259 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:51.278 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-fuse 2026-02-25T14:27:51.287 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout:Install 7 Packages 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:51.288 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 7.1 M 2026-02-25T14:27:51.289 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 33 M 2026-02-25T14:27:51.289 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:51.598 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:46 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:51.685 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:51.686 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 91 k 2026-02-25T14:27:51.687 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 238 k 2026-02-25T14:27:51.687 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:51.904 INFO:teuthology.orchestra.run.trial174.stdout:(1/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 384 kB/s | 173 kB 00:00 2026-02-25T14:27:51.962 INFO:teuthology.orchestra.run.trial174.stdout:(2/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 489 kB/s | 249 kB 00:00 2026-02-25T14:27:52.010 INFO:teuthology.orchestra.run.trial078.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.7 MB/s | 2.9 MB 00:01 2026-02-25T14:27:52.010 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:52.011 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.7 MB/s | 2.9 MB 00:01 2026-02-25T14:27:52.011 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:52.016 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:52.016 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:52.054 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:52.055 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:52.084 INFO:teuthology.orchestra.run.trial155.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 229 kB/s | 91 kB 00:00 2026-02-25T14:27:52.085 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:52.085 INFO:teuthology.orchestra.run.trial155.stdout:Total 228 kB/s | 91 kB 00:00 2026-02-25T14:27:52.085 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:52.091 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:52.091 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:52.121 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:52.122 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:52.130 INFO:teuthology.orchestra.run.trial174.stdout:(3/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.2 MB/s | 548 kB 00:00 2026-02-25T14:27:52.150 INFO:teuthology.orchestra.run.trial174.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 2.8 MB/s | 58 kB 00:00 2026-02-25T14:27:52.171 INFO:teuthology.orchestra.run.trial174.stdout:(5/7): python3-typing-extensions-4.15.0-1.el9.n 4.0 MB/s | 86 kB 00:00 2026-02-25T14:27:52.171 INFO:teuthology.orchestra.run.trial174.stdout:(6/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 130 kB/s | 35 kB 00:00 2026-02-25T14:27:52.172 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:52.190 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:52.236 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:52.238 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:52.260 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:52.260 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:52.260 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T14:27:52.260 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:27:52.260 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:27:52.260 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:52.271 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:52.321 INFO:teuthology.orchestra.run.trial174.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 6.9 MB/s | 6.0 MB 00:00 2026-02-25T14:27:52.322 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:52.322 INFO:teuthology.orchestra.run.trial174.stdout:Total 6.9 MB/s | 7.1 MB 00:01 2026-02-25T14:27:52.333 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:52.333 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:52.333 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:52.333 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:52.333 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:52.334 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:52.359 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:52.361 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-mirror 2026-02-25T14:27:52.366 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:52.366 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:52.438 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:52.438 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:52.529 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:52.579 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-25T14:27:52.589 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-25T14:27:52.594 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-25T14:27:52.596 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:52.596 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:52.596 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:52.596 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:52.596 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:52.597 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:52.625 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-nbd 2026-02-25T14:27:52.676 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:47 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:52.760 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:52.761 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 2.9 M 2026-02-25T14:27:52.762 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 11 M 2026-02-25T14:27:52.762 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:52.816 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-25T14:27:52.839 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-25T14:27:52.863 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-25T14:27:52.864 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-25T14:27:52.946 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:43 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:52.979 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-25T14:27:52.979 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-25T14:27:52.979 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-25T14:27:52.979 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-25T14:27:52.979 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-25T14:27:52.979 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-25T14:27:52.979 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-25T14:27:53.030 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:53.031 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:53.031 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:53.031 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:53.031 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:53.031 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-25T14:27:53.032 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:53.032 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:53.032 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:53.032 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:27:53.032 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:53.032 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 180 k 2026-02-25T14:27:53.032 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 498 k 2026-02-25T14:27:53.032 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:53.042 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-25T14:27:53.042 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:53.042 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:53.042 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-25T14:27:53.042 INFO:teuthology.orchestra.run.trial174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T14:27:53.042 INFO:teuthology.orchestra.run.trial174.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T14:27:53.043 INFO:teuthology.orchestra.run.trial174.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T14:27:53.043 INFO:teuthology.orchestra.run.trial174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T14:27:53.043 INFO:teuthology.orchestra.run.trial174.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T14:27:53.043 INFO:teuthology.orchestra.run.trial174.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T14:27:53.043 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:53.043 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:53.072 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-fuse 2026-02-25T14:27:53.389 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:47 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:53.473 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:53.474 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:53.474 INFO:teuthology.orchestra.run.trial174.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:53.474 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:53.474 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:53.474 INFO:teuthology.orchestra.run.trial174.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-25T14:27:53.475 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:53.475 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:53.475 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:53.475 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:27:53.475 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:53.475 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 942 k 2026-02-25T14:27:53.475 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 2.7 M 2026-02-25T14:27:53.475 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:53.498 INFO:teuthology.orchestra.run.trial078.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 384 kB/s | 180 kB 00:00 2026-02-25T14:27:53.499 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:53.499 INFO:teuthology.orchestra.run.trial078.stdout:Total 384 kB/s | 180 kB 00:00 2026-02-25T14:27:53.499 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:27:53.504 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:27:53.504 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:27:53.534 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:27:53.534 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:27:53.591 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:27:53.608 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:53.695 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:53.758 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:53.758 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:53.758 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:27:53.759 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:53.759 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:53.759 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:27:53.789 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:27:54.111 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:01:45 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:27:54.195 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:27:54.195 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:54.195 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:27:54.195 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:54.195 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 107 M 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 664 M 2026-02-25T14:27:54.196 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:27:54.360 INFO:teuthology.orchestra.run.trial155.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.8 MB/s | 2.9 MB 00:01 2026-02-25T14:27:54.360 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:54.360 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.8 MB/s | 2.9 MB 00:01 2026-02-25T14:27:54.361 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:54.366 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:54.366 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:54.405 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:54.405 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:54.588 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:54.589 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:54.613 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:54.613 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:54.613 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T14:27:54.613 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:27:54.613 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:27:54.613 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:54.716 INFO:teuthology.orchestra.run.trial174.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 759 kB/s | 942 kB 00:01 2026-02-25T14:27:54.717 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:54.717 INFO:teuthology.orchestra.run.trial174.stdout:Total 758 kB/s | 942 kB 00:01 2026-02-25T14:27:54.717 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:54.722 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:54.722 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:54.754 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:54.754 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:54.850 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:54.875 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:54.916 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:54.916 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:54.916 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:54.916 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:54.916 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:54.916 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:54.944 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-nbd 2026-02-25T14:27:55.135 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:55.196 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:55.196 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:55.196 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:55.197 INFO:teuthology.orchestra.run.trial174.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:55.197 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:55.197 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:55.225 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-volume 2026-02-25T14:27:55.264 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:50 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:55.348 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:55.349 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:55.349 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-25T14:27:55.349 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:55.349 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:55.349 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-25T14:27:55.349 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:55.350 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:55.350 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:55.350 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:27:55.350 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:55.350 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 180 k 2026-02-25T14:27:55.350 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 498 k 2026-02-25T14:27:55.350 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:55.543 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:49 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:55.626 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:55.627 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:55.627 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repository Size 2026-02-25T14:27:55.627 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:55.627 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:55.627 INFO:teuthology.orchestra.run.trial174.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-25T14:27:55.627 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:27:55.627 INFO:teuthology.orchestra.run.trial174.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T14:27:55.628 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:55.628 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:55.628 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:55.628 INFO:teuthology.orchestra.run.trial174.stdout:Install 2 Packages 2026-02-25T14:27:55.628 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:55.628 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 648 k 2026-02-25T14:27:55.628 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 2.2 M 2026-02-25T14:27:55.628 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:55.850 INFO:teuthology.orchestra.run.trial155.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 359 kB/s | 180 kB 00:00 2026-02-25T14:27:55.850 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:55.851 INFO:teuthology.orchestra.run.trial155.stdout:Total 358 kB/s | 180 kB 00:00 2026-02-25T14:27:55.851 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:27:55.855 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:27:55.855 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:27:55.886 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:27:55.886 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:27:55.942 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:27:55.959 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:56.050 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:56.060 INFO:teuthology.orchestra.run.trial174.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 4.9 MB/s | 351 kB 00:00 2026-02-25T14:27:56.113 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:56.113 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:56.113 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:27:56.113 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:56.113 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:56.113 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:27:56.143 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:27:56.463 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:01:51 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:27:56.548 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:27:56.549 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:56.549 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:27:56.550 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 107 M 2026-02-25T14:27:56.551 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 664 M 2026-02-25T14:27:56.551 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:27:56.585 INFO:teuthology.orchestra.run.trial174.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 500 kB/s | 297 kB 00:00 2026-02-25T14:27:56.586 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:56.586 INFO:teuthology.orchestra.run.trial174.stdout:Total 676 kB/s | 648 kB 00:00 2026-02-25T14:27:56.595 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:56.601 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:56.602 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:56.645 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:56.645 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:56.727 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:56.790 INFO:teuthology.orchestra.run.trial174.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-25T14:27:56.792 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-25T14:27:56.806 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-25T14:27:56.807 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:27:56.807 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T14:27:56.807 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:57.036 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-25T14:27:57.099 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-25T14:27:57.099 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:57.099 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:57.100 INFO:teuthology.orchestra.run.trial174.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T14:27:57.100 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:57.100 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:57.127 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librados-devel 2026-02-25T14:27:57.448 INFO:teuthology.orchestra.run.trial167.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 7.7 MB/s | 107 MB 00:13 2026-02-25T14:27:57.448 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:57.448 INFO:teuthology.orchestra.run.trial167.stdout:Total 7.7 MB/s | 107 MB 00:13 2026-02-25T14:27:57.449 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:27:57.450 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:51 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:57.451 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:27:57.451 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 126 k 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 449 k 2026-02-25T14:27:57.534 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:57.787 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:27:57.787 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:27:57.976 INFO:teuthology.orchestra.run.trial174.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 285 kB/s | 126 kB 00:00 2026-02-25T14:27:57.976 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:57.976 INFO:teuthology.orchestra.run.trial174.stdout:Total 284 kB/s | 126 kB 00:00 2026-02-25T14:27:57.976 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:57.979 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:57.980 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:58.011 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:58.011 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:58.066 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:58.083 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:58.165 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:58.228 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:27:58.228 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:58.229 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:58.229 INFO:teuthology.orchestra.run.trial174.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:58.229 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:58.229 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:58.255 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install libcephfs2 2026-02-25T14:27:58.572 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:52 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:58.636 INFO:teuthology.orchestra.run.trial174.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:27:58.655 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:58.655 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:27:58.655 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:58.676 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install libcephfs-devel 2026-02-25T14:27:58.994 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:52 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:27:59.077 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:27:59.078 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:59.078 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout:Installing dependencies: 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:27:59.079 INFO:teuthology.orchestra.run.trial174.stdout:Install 2 Packages 2026-02-25T14:27:59.080 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:59.080 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 58 k 2026-02-25T14:27:59.080 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 207 k 2026-02-25T14:27:59.080 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:27:59.435 INFO:teuthology.orchestra.run.trial174.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 96 kB/s | 34 kB 00:00 2026-02-25T14:27:59.439 INFO:teuthology.orchestra.run.trial174.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 67 kB/s | 24 kB 00:00 2026-02-25T14:27:59.441 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:59.441 INFO:teuthology.orchestra.run.trial174.stdout:Total 161 kB/s | 58 kB 00:00 2026-02-25T14:27:59.441 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:27:59.444 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:27:59.444 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:27:59.476 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:27:59.476 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:27:59.526 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:27:59.527 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:59.541 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:59.558 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:59.623 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:59.623 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-25T14:27:59.686 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-25T14:27:59.686 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:59.686 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:27:59.686 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:59.686 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:27:59.686 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:27:59.686 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:27:59.712 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librados2 2026-02-25T14:28:00.032 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:54 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:00.099 INFO:teuthology.orchestra.run.trial174.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:28:00.117 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:00.118 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:28:00.118 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:00.139 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librbd1 2026-02-25T14:28:00.458 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:54 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:00.522 INFO:teuthology.orchestra.run.trial174.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:28:00.541 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:00.542 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:28:00.542 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:00.563 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rados 2026-02-25T14:28:00.882 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:54 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:00.947 INFO:teuthology.orchestra.run.trial174.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:28:00.965 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:00.966 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:28:00.966 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:00.988 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rgw 2026-02-25T14:28:01.309 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:55 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:01.374 INFO:teuthology.orchestra.run.trial174.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:28:01.393 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:01.393 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:28:01.393 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:01.415 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-cephfs 2026-02-25T14:28:01.734 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:55 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:01.799 INFO:teuthology.orchestra.run.trial174.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:28:01.818 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:01.818 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:28:01.818 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:01.840 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rbd 2026-02-25T14:28:02.155 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:56 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:02.221 INFO:teuthology.orchestra.run.trial174.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:28:02.239 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:02.240 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:28:02.240 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:02.261 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-fuse 2026-02-25T14:28:02.584 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:56 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:02.670 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:02.670 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout: Package Architecture Version Repository Size 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:28:02.671 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:02.672 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 91 k 2026-02-25T14:28:02.672 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 238 k 2026-02-25T14:28:02.672 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:28:03.093 INFO:teuthology.orchestra.run.trial174.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 216 kB/s | 91 kB 00:00 2026-02-25T14:28:03.093 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:28:03.094 INFO:teuthology.orchestra.run.trial174.stdout:Total 216 kB/s | 91 kB 00:00 2026-02-25T14:28:03.094 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:28:03.098 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:28:03.098 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:28:03.129 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:28:03.129 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:28:03.180 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:28:03.197 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:03.286 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:03.349 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:03.349 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:03.349 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:28:03.349 INFO:teuthology.orchestra.run.trial174.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:28:03.350 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:03.350 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:03.378 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-mirror 2026-02-25T14:28:03.694 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:57 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:03.754 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:28:03.773 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:03.777 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:03.777 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:03.777 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:28:03.777 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:03.777 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 2.9 M 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 11 M 2026-02-25T14:28:03.778 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:28:04.310 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:04.372 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:04.372 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:28:04.372 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:28:04.372 INFO:teuthology.orchestra.run.trial167.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:28:04.372 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:28:04.372 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:28:04.412 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-common-debuginfo 2026-02-25T14:28:04.731 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:01:58 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:04.817 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:28:04.817 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:28:04.818 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:28:04.819 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 586 M 2026-02-25T14:28:04.819 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 3.4 G 2026-02-25T14:28:04.819 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:28:05.079 INFO:teuthology.orchestra.run.trial174.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 2.2 MB/s | 2.9 MB 00:01 2026-02-25T14:28:05.080 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:28:05.080 INFO:teuthology.orchestra.run.trial174.stdout:Total 2.2 MB/s | 2.9 MB 00:01 2026-02-25T14:28:05.080 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:28:05.085 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:28:05.085 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:28:05.124 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:28:05.125 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:28:05.311 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:28:05.312 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:05.336 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:05.336 INFO:teuthology.orchestra.run.trial174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:28:05.336 INFO:teuthology.orchestra.run.trial174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T14:28:05.337 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:28:05.337 INFO:teuthology.orchestra.run.trial174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:28:05.337 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:05.640 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:05.640 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:05.640 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:28:05.640 INFO:teuthology.orchestra.run.trial174.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:28:05.641 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:05.641 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:05.668 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-nbd 2026-02-25T14:28:05.992 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:01:59 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:06.076 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:06.076 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:06.076 INFO:teuthology.orchestra.run.trial174.stdout: Package Architecture Version Repository Size 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 180 k 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 498 k 2026-02-25T14:28:06.077 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:28:06.541 INFO:teuthology.orchestra.run.trial174.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 387 kB/s | 180 kB 00:00 2026-02-25T14:28:06.541 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:28:06.542 INFO:teuthology.orchestra.run.trial174.stdout:Total 386 kB/s | 180 kB 00:00 2026-02-25T14:28:06.542 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:28:06.546 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:28:06.547 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:28:06.577 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:28:06.577 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:28:06.633 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:28:06.651 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:06.736 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:06.799 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:28:06.799 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:06.800 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:28:06.800 INFO:teuthology.orchestra.run.trial174.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:28:06.800 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:06.800 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:06.828 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:28:07.155 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:02:01 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:07.239 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:07.240 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:07.240 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:28:07.240 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 107 M 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 664 M 2026-02-25T14:28:07.241 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:28:17.926 INFO:teuthology.orchestra.run.trial155.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 5.0 MB/s | 107 MB 00:21 2026-02-25T14:28:17.927 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:28:17.927 INFO:teuthology.orchestra.run.trial155.stdout:Total 5.0 MB/s | 107 MB 00:21 2026-02-25T14:28:17.927 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:28:17.929 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:28:17.930 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:28:18.267 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:28:18.267 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:28:24.268 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:28:24.287 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:24.806 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:24.868 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:24.868 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:28:24.868 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:28:24.869 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:28:24.869 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:28:24.869 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:28:24.906 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-common-debuginfo 2026-02-25T14:28:25.231 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:02:20 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:28:25.317 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:28:25.318 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:28:25.319 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 586 M 2026-02-25T14:28:25.319 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 3.4 G 2026-02-25T14:28:25.319 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:28:35.548 INFO:teuthology.orchestra.run.trial078.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 2.6 MB/s | 107 MB 00:41 2026-02-25T14:28:35.548 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:28:35.548 INFO:teuthology.orchestra.run.trial078.stdout:Total 2.6 MB/s | 107 MB 00:41 2026-02-25T14:28:35.548 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:28:35.551 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:28:35.551 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:28:35.887 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:28:35.888 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:28:41.600 INFO:teuthology.orchestra.run.trial174.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 3.1 MB/s | 107 MB 00:34 2026-02-25T14:28:41.601 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:28:41.601 INFO:teuthology.orchestra.run.trial174.stdout:Total 3.1 MB/s | 107 MB 00:34 2026-02-25T14:28:41.601 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:28:41.603 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:28:41.603 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:28:41.931 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:28:41.940 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:28:41.941 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:28:41.950 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:42.446 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:42.508 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:42.508 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:28:42.508 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:28:42.508 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:28:42.508 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:28:42.508 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:28:42.546 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-common-debuginfo 2026-02-25T14:28:42.859 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:02:33 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:28:42.943 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 586 M 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 3.4 G 2026-02-25T14:28:42.944 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:28:47.825 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:28:47.844 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:48.345 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:48.407 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:28:48.408 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:48.408 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:28:48.408 INFO:teuthology.orchestra.run.trial174.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:28:48.408 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:48.408 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:28:48.446 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-common-debuginfo 2026-02-25T14:28:48.769 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:02:42 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:28:48.854 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:28:48.855 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 586 M 2026-02-25T14:28:48.855 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 3.4 G 2026-02-25T14:28:48.855 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:29:22.996 INFO:teuthology.orchestra.run.trial167.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 7.5 MB/s | 586 MB 01:18 2026-02-25T14:29:22.997 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:29:22.997 INFO:teuthology.orchestra.run.trial167.stdout:Total 7.5 MB/s | 586 MB 01:18 2026-02-25T14:29:22.997 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:29:22.999 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:29:22.999 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:29:24.742 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:29:24.742 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:29:57.738 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:29:57.757 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:30:00.211 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:30:00.272 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:30:00.272 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:30:00.272 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:30:00.273 INFO:teuthology.orchestra.run.trial167.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:30:00.273 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:30:00.273 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:30:00.358 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-25T14:30:00.677 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:03:54 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:30:00.762 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:30:00.762 INFO:teuthology.orchestra.run.trial167.stdout:======================================================================================= 2026-02-25T14:30:00.762 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:30:00.762 INFO:teuthology.orchestra.run.trial167.stdout:======================================================================================= 2026-02-25T14:30:00.762 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout:======================================================================================= 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 3.0 M 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 15 M 2026-02-25T14:30:00.763 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:30:02.620 INFO:teuthology.orchestra.run.trial167.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.6 MB/s | 3.0 MB 00:01 2026-02-25T14:30:02.620 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:30:02.620 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.6 MB/s | 3.0 MB 00:01 2026-02-25T14:30:02.620 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:30:02.622 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:30:02.623 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:30:02.648 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:30:02.649 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:30:02.836 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:30:02.854 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:30:02.923 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:30:02.984 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:30:02.985 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:30:02.985 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:30:02.985 INFO:teuthology.orchestra.run.trial167.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:30:02.985 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:30:02.985 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:30:03.012 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-25T14:30:03.334 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:03:57 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:30:03.420 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:30:03.420 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:30:03.420 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:30:03.420 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:30:03.420 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:30:03.420 INFO:teuthology.orchestra.run.trial167.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-25T14:30:03.421 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:30:03.421 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:30:03.421 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:30:03.421 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:30:03.421 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:30:03.421 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 543 M 2026-02-25T14:30:03.421 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 0 2026-02-25T14:30:03.421 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:31:25.141 INFO:teuthology.orchestra.run.trial174.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 3.7 MB/s | 586 MB 02:36 2026-02-25T14:31:25.142 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:31:25.142 INFO:teuthology.orchestra.run.trial174.stdout:Total 3.7 MB/s | 586 MB 02:36 2026-02-25T14:31:25.142 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:31:25.145 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:31:25.145 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:31:26.879 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:31:26.880 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:31:31.907 INFO:teuthology.orchestra.run.trial167.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 6.1 MB/s | 543 MB 01:28 2026-02-25T14:31:31.908 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:31:31.908 INFO:teuthology.orchestra.run.trial167.stdout:Total 6.1 MB/s | 543 MB 01:28 2026-02-25T14:31:31.908 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:31:31.910 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:31:31.910 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:31:33.521 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:31:33.521 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:31:58.711 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:31:58.730 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:31:59.753 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:31:59.816 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:31:59.816 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:31:59.816 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:31:59.816 INFO:teuthology.orchestra.run.trial174.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:31:59.816 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:31:59.816 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:31:59.896 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-25T14:32:00.220 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:05:54 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:32:00.304 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout:======================================================================================= 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout:======================================================================================= 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout:======================================================================================= 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:32:00.305 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:32:00.306 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 3.0 M 2026-02-25T14:32:00.306 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 15 M 2026-02-25T14:32:00.306 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:32:03.042 INFO:teuthology.orchestra.run.trial174.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.1 MB/s | 3.0 MB 00:02 2026-02-25T14:32:03.043 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:32:03.043 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.1 MB/s | 3.0 MB 00:02 2026-02-25T14:32:03.043 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:32:03.045 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:32:03.045 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:32:03.070 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:32:03.071 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:32:03.268 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:32:03.285 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:32:03.355 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:32:03.418 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:32:03.418 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:32:03.418 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:32:03.419 INFO:teuthology.orchestra.run.trial174.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:32:03.419 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:32:03.419 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:32:03.446 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-25T14:32:03.772 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:05:57 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:32:03.857 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:32:03.858 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:32:03.859 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:32:03.859 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 543 M 2026-02-25T14:32:03.859 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 0 2026-02-25T14:32:03.859 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:32:06.109 INFO:teuthology.orchestra.run.trial155.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 2.7 MB/s | 586 MB 03:40 2026-02-25T14:32:06.110 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:32:06.111 INFO:teuthology.orchestra.run.trial155.stdout:Total 2.7 MB/s | 586 MB 03:40 2026-02-25T14:32:06.111 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:32:06.113 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:32:06.113 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:32:06.407 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:32:06.529 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:32:07.857 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:32:07.857 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:32:08.688 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:32:08.750 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:32:08.750 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:32:08.750 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:32:08.750 INFO:teuthology.orchestra.run.trial167.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:32:08.751 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:32:08.751 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:32:08.825 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-test-debuginfo 2026-02-25T14:32:09.144 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:06:03 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:32:09.230 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:32:09.231 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:32:09.231 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:32:09.231 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:32:09.231 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:32:09.231 INFO:teuthology.orchestra.run.trial167.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-25T14:32:09.231 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:32:09.231 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:32:09.231 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:32:09.232 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:32:09.232 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:32:09.232 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 1.7 G 2026-02-25T14:32:09.232 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 0 2026-02-25T14:32:09.232 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:32:39.526 INFO:teuthology.orchestra.run.trial078.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 2.5 MB/s | 586 MB 03:56 2026-02-25T14:32:39.527 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:32:39.527 INFO:teuthology.orchestra.run.trial078.stdout:Total 2.5 MB/s | 586 MB 03:56 2026-02-25T14:32:39.527 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:32:39.529 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:32:39.530 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:32:40.243 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:32:40.261 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:32:41.061 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:32:41.122 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:32:41.122 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:32:41.123 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:32:41.123 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:32:41.123 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:32:41.123 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:32:41.207 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-25T14:32:41.266 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:32:41.267 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:32:41.530 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:06:36 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:32:41.618 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout:======================================================================================= 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout:======================================================================================= 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout:======================================================================================= 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:32:41.619 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:32:41.620 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 3.0 M 2026-02-25T14:32:41.620 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 15 M 2026-02-25T14:32:41.620 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:32:43.067 INFO:teuthology.orchestra.run.trial155.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 2.1 MB/s | 3.0 MB 00:01 2026-02-25T14:32:43.067 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:32:43.067 INFO:teuthology.orchestra.run.trial155.stdout:Total 2.1 MB/s | 3.0 MB 00:01 2026-02-25T14:32:43.067 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:32:43.069 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:32:43.069 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:32:43.096 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:32:43.096 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:32:43.291 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:32:43.309 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:32:43.379 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:32:43.442 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:32:43.443 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:32:43.443 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:32:43.443 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:32:43.443 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:32:43.443 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:32:43.471 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-25T14:32:43.790 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:06:38 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:32:43.876 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:32:43.876 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:32:43.877 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:32:43.877 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:32:43.877 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:32:43.877 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-25T14:32:43.877 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:32:43.877 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:32:43.877 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:32:43.878 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:32:43.878 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:32:43.878 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 543 M 2026-02-25T14:32:43.878 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 0 2026-02-25T14:32:43.878 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:33:13.125 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:33:13.143 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:33:14.417 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:33:14.479 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T14:33:14.479 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:33:14.479 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:33:14.479 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:33:14.479 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:33:14.479 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:33:14.563 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-25T14:33:14.889 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:07:05 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:33:14.975 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:33:14.975 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================= 2026-02-25T14:33:14.975 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================= 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================= 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 3.0 M 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 15 M 2026-02-25T14:33:14.976 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:33:20.278 INFO:teuthology.orchestra.run.trial078.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 586 kB/s | 3.0 MB 00:05 2026-02-25T14:33:20.278 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:33:20.279 INFO:teuthology.orchestra.run.trial078.stdout:Total 586 kB/s | 3.0 MB 00:05 2026-02-25T14:33:20.279 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:33:20.281 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:33:20.281 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:33:20.306 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:33:20.306 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:33:20.501 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:33:20.518 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:33:20.591 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:33:20.653 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-25T14:33:20.654 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:33:20.654 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:33:20.654 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:33:20.654 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:33:20.654 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:33:20.682 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-25T14:33:21.003 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:07:12 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:33:21.090 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:33:21.090 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:33:21.090 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:33:21.090 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:33:21.091 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:33:21.091 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-25T14:33:21.091 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:33:21.091 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:33:21.091 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:33:21.091 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:33:21.092 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:33:21.092 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 543 M 2026-02-25T14:33:21.092 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 0 2026-02-25T14:33:21.092 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:35:27.341 INFO:teuthology.orchestra.run.trial174.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 2.7 MB/s | 543 MB 03:23 2026-02-25T14:35:27.342 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:35:27.343 INFO:teuthology.orchestra.run.trial174.stdout:Total 2.7 MB/s | 543 MB 03:23 2026-02-25T14:35:27.343 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:35:27.344 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:35:27.344 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:35:28.958 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:35:28.958 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:36:02.682 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:36:02.700 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:36:03.478 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:36:03.541 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:36:03.541 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:36:03.541 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:36:03.541 INFO:teuthology.orchestra.run.trial174.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:36:03.541 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:36:03.541 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:36:03.618 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-test-debuginfo 2026-02-25T14:36:03.934 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:09:57 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:36:04.019 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:36:04.020 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:36:04.021 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:36:04.021 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 1.7 G 2026-02-25T14:36:04.021 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 0 2026-02-25T14:36:04.021 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:38:22.079 INFO:teuthology.orchestra.run.trial155.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 1.6 MB/s | 543 MB 05:38 2026-02-25T14:38:22.080 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:38:22.081 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.6 MB/s | 543 MB 05:38 2026-02-25T14:38:22.081 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T14:38:22.083 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T14:38:22.083 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T14:38:23.695 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T14:38:23.696 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T14:38:55.979 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T14:38:55.997 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:38:57.469 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:38:57.531 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:38:57.532 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:38:57.532 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T14:38:57.532 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:38:57.532 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:38:57.532 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T14:38:57.615 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-test-debuginfo 2026-02-25T14:38:57.939 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:12:52 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T14:38:58.024 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T14:38:58.025 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:38:58.025 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T14:38:58.025 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:38:58.025 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 1.7 G 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 0 2026-02-25T14:38:58.026 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T14:39:26.117 INFO:teuthology.orchestra.run.trial078.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 1.5 MB/s | 543 MB 06:05 2026-02-25T14:39:26.118 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:39:26.118 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.5 MB/s | 543 MB 06:05 2026-02-25T14:39:26.118 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:39:26.120 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:39:26.120 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:39:27.737 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:39:27.737 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:40:00.033 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:40:00.050 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:40:01.555 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:40:01.616 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-25T14:40:01.616 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:40:01.616 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:40:01.616 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:40:01.617 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:40:01.617 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:40:01.692 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-test-debuginfo 2026-02-25T14:40:02.003 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:13:53 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:40:02.087 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:40:02.087 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:40:02.087 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 1.7 G 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 0 2026-02-25T14:40:02.088 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:50:50.419 INFO:teuthology.orchestra.run.trial174.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 2.0 MB/s | 1.7 GB 14:46 2026-02-25T14:50:50.427 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:50.427 INFO:teuthology.orchestra.run.trial174.stdout:Total 2.0 MB/s | 1.7 GB 14:46 2026-02-25T14:50:50.427 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:50:50.427 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:50:50.428 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:50:55.614 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:50:55.615 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:52:37.443 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:52:37.462 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:52:40.630 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:52:40.693 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:52:40.693 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:52:40.693 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:52:40.693 INFO:teuthology.orchestra.run.trial174.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:52:40.693 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:52:40.694 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:52:40.894 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:52:41.218 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:26:35 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:52:41.285 INFO:teuthology.orchestra.run.trial174.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:52:41.304 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:52:41.305 INFO:teuthology.orchestra.run.trial174.stdout:Nothing to do. 2026-02-25T14:52:41.305 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:52:41.326 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mgr-debuginfo 2026-02-25T14:52:41.647 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:26:35 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:52:41.731 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:52:41.731 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:52:41.732 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 22 M 2026-02-25T14:52:41.733 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 146 M 2026-02-25T14:52:41.733 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:52:44.511 INFO:teuthology.orchestra.run.trial167.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.4 MB/s | 1.7 GB 20:35 2026-02-25T14:52:44.512 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:52:44.512 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.4 MB/s | 1.7 GB 20:35 2026-02-25T14:52:44.512 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:52:44.515 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:52:44.515 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:52:49.696 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:52:49.697 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:53:02.815 INFO:teuthology.orchestra.run.trial174.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.0 MB/s | 22 MB 00:21 2026-02-25T14:53:02.816 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:53:02.816 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.0 MB/s | 22 MB 00:21 2026-02-25T14:53:02.816 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:53:02.817 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:53:02.818 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:53:02.899 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:53:02.900 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:53:04.160 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:53:04.177 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:53:04.344 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:53:04.406 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:53:04.406 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:53:04.406 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:53:04.406 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:53:04.406 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:53:04.407 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:53:04.434 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mds-debuginfo 2026-02-25T14:53:04.755 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:26:58 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:53:04.839 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:53:04.840 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:53:04.840 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:53:04.840 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:53:04.840 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:53:04.840 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-25T14:53:04.840 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:53:04.840 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:53:04.841 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:53:04.841 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:53:04.841 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:53:04.841 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 54 M 2026-02-25T14:53:04.841 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 221 M 2026-02-25T14:53:04.841 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:53:33.750 INFO:teuthology.orchestra.run.trial174.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.9 MB/s | 54 MB 00:28 2026-02-25T14:53:33.751 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:53:33.751 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.9 MB/s | 54 MB 00:28 2026-02-25T14:53:33.751 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:53:33.753 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:53:33.753 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:53:33.929 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:53:33.930 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:53:36.711 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:53:36.728 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:53:36.955 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:53:37.018 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:53:37.018 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:53:37.018 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:53:37.018 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:53:37.018 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:53:37.018 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:53:37.048 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-mon-debuginfo 2026-02-25T14:53:37.370 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:27:31 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:53:37.453 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:53:37.454 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:53:37.454 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:53:37.454 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 130 M 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 643 M 2026-02-25T14:53:37.455 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:53:50.762 INFO:teuthology.orchestra.run.trial078.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 2.1 MB/s | 1.7 GB 13:48 2026-02-25T14:53:50.763 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:53:50.763 INFO:teuthology.orchestra.run.trial078.stdout:Total 2.1 MB/s | 1.7 GB 13:48 2026-02-25T14:53:50.763 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:53:50.766 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:53:50.766 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:53:55.972 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:53:55.973 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:54:29.766 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:54:29.786 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:54:33.011 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:54:33.073 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:54:33.073 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:54:33.073 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:54:33.073 INFO:teuthology.orchestra.run.trial167.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:54:33.073 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:54:33.074 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:54:33.278 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:54:33.599 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:28:27 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:54:33.666 INFO:teuthology.orchestra.run.trial167.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:54:33.685 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:54:33.685 INFO:teuthology.orchestra.run.trial167.stdout:Nothing to do. 2026-02-25T14:54:33.685 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:54:33.707 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-mgr-debuginfo 2026-02-25T14:54:33.840 INFO:teuthology.orchestra.run.trial174.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.3 MB/s | 130 MB 00:56 2026-02-25T14:54:33.840 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:33.841 INFO:teuthology.orchestra.run.trial174.stdout:Total 2.3 MB/s | 130 MB 00:56 2026-02-25T14:54:33.841 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:54:33.842 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:54:33.843 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:54:34.031 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:28:28 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:54:34.115 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:54:34.116 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:54:34.116 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:54:34.116 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:54:34.116 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:54:34.116 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-25T14:54:34.116 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:54:34.117 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:54:34.117 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:54:34.117 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:54:34.117 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:54:34.117 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 22 M 2026-02-25T14:54:34.117 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 146 M 2026-02-25T14:54:34.117 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:54:34.242 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:54:34.243 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:54:40.910 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:54:40.927 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:54:41.463 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:54:41.526 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:54:41.526 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:54:41.526 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T14:54:41.527 INFO:teuthology.orchestra.run.trial174.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:54:41.527 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:54:41.527 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T14:54:41.563 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-osd-debuginfo 2026-02-25T14:54:41.642 INFO:teuthology.orchestra.run.trial167.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.9 MB/s | 22 MB 00:07 2026-02-25T14:54:41.642 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:41.643 INFO:teuthology.orchestra.run.trial167.stdout:Total 2.9 MB/s | 22 MB 00:07 2026-02-25T14:54:41.643 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:54:41.644 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:54:41.644 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:54:41.725 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:54:41.726 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:54:41.880 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:28:35 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:54:41.965 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T14:54:41.966 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:54:41.966 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T14:54:41.966 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:54:41.966 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 343 M 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 1.6 G 2026-02-25T14:54:41.967 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T14:54:42.976 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:54:42.996 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:54:43.165 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:54:43.227 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:54:43.227 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:54:43.227 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:54:43.227 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:54:43.227 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:54:43.227 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:54:43.255 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-mds-debuginfo 2026-02-25T14:54:43.570 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:28:37 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:54:43.655 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:54:43.656 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:54:43.657 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:54:43.657 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 54 M 2026-02-25T14:54:43.657 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 221 M 2026-02-25T14:54:43.657 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:55:19.371 INFO:teuthology.orchestra.run.trial167.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.5 MB/s | 54 MB 00:35 2026-02-25T14:55:19.371 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:19.372 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.5 MB/s | 54 MB 00:35 2026-02-25T14:55:19.372 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:55:19.373 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:55:19.373 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:55:19.550 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:55:19.551 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:55:22.205 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:55:22.223 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:55:22.440 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:55:22.503 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:55:22.503 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:55:22.503 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:55:22.503 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:55:22.503 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:55:22.504 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:55:22.535 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-mon-debuginfo 2026-02-25T14:55:22.856 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:29:16 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:55:22.941 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:55:22.942 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:55:22.942 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:55:22.942 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:55:22.942 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:55:22.942 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-25T14:55:22.942 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:55:22.942 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:55:22.942 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:55:22.943 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:55:22.943 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:55:22.943 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 130 M 2026-02-25T14:55:22.943 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 643 M 2026-02-25T14:55:22.943 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:55:36.255 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:55:36.275 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:55:38.646 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:55:38.709 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T14:55:38.709 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:55:38.709 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:55:38.709 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:55:38.709 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:55:38.709 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:55:38.915 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:55:39.241 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:29:30 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:55:39.306 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T14:55:39.325 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:55:39.326 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-25T14:55:39.326 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:55:39.349 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-debuginfo 2026-02-25T14:55:39.668 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:29:30 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:55:39.752 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:55:39.753 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:55:39.754 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:55:39.754 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 22 M 2026-02-25T14:55:39.754 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 146 M 2026-02-25T14:55:39.754 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:55:47.391 INFO:teuthology.orchestra.run.trial078.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.9 MB/s | 22 MB 00:07 2026-02-25T14:55:47.391 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:47.392 INFO:teuthology.orchestra.run.trial078.stdout:Total 2.9 MB/s | 22 MB 00:07 2026-02-25T14:55:47.392 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:55:47.393 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:55:47.393 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:55:47.475 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:55:47.476 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:55:48.768 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:55:48.786 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:55:48.954 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:55:49.015 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:55:49.015 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:55:49.015 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:55:49.016 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:55:49.016 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:55:49.016 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:55:49.043 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mds-debuginfo 2026-02-25T14:55:49.361 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:29:40 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:55:49.446 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:55:49.446 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:55:49.446 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:55:49.446 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:55:49.446 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:55:49.446 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-25T14:55:49.446 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:55:49.447 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:55:49.447 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:55:49.447 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:55:49.447 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:55:49.447 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 54 M 2026-02-25T14:55:49.447 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 221 M 2026-02-25T14:55:49.447 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:56:33.041 INFO:teuthology.orchestra.run.trial078.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.2 MB/s | 54 MB 00:43 2026-02-25T14:56:33.041 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:56:33.042 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.2 MB/s | 54 MB 00:43 2026-02-25T14:56:33.042 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:56:33.044 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:56:33.044 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:56:33.221 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:56:33.221 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:56:36.027 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:56:36.044 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:56:36.247 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:56:36.308 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:56:36.309 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:56:36.309 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:56:36.309 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:56:36.309 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:56:36.309 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:56:36.338 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mon-debuginfo 2026-02-25T14:56:36.661 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:30:27 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:56:36.745 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:56:36.746 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:56:36.746 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:56:36.746 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:56:36.746 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 130 M 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 643 M 2026-02-25T14:56:36.747 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:57:01.615 INFO:teuthology.orchestra.run.trial167.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.3 MB/s | 130 MB 01:38 2026-02-25T14:57:01.616 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:57:01.616 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.3 MB/s | 130 MB 01:38 2026-02-25T14:57:01.616 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T14:57:01.619 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T14:57:01.619 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T14:57:02.019 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T14:57:02.019 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T14:57:08.919 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T14:57:08.937 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:57:09.470 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:57:09.532 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:57:09.532 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:57:09.532 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T14:57:09.532 INFO:teuthology.orchestra.run.trial167.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:57:09.533 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:57:09.533 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T14:57:09.569 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-osd-debuginfo 2026-02-25T14:57:09.893 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:31:03 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T14:57:09.977 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T14:57:09.978 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:57:09.978 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T14:57:09.978 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 343 M 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 1.6 G 2026-02-25T14:57:09.979 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T14:57:39.541 INFO:teuthology.orchestra.run.trial078.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.1 MB/s | 130 MB 01:02 2026-02-25T14:57:39.542 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:57:39.542 INFO:teuthology.orchestra.run.trial078.stdout:Total 2.1 MB/s | 130 MB 01:02 2026-02-25T14:57:39.542 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T14:57:39.544 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T14:57:39.544 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T14:57:39.947 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T14:57:39.947 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T14:57:46.768 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T14:57:46.785 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:57:47.302 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:57:47.365 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T14:57:47.365 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:57:47.365 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T14:57:47.365 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T14:57:47.365 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:57:47.365 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T14:57:47.407 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-osd-debuginfo 2026-02-25T14:57:47.729 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:31:38 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T14:57:47.815 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T14:57:47.816 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:57:47.816 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T14:57:47.816 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:57:47.816 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T14:57:47.816 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-25T14:57:47.816 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:57:47.817 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T14:57:47.817 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T14:57:47.817 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T14:57:47.817 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T14:57:47.817 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 343 M 2026-02-25T14:57:47.817 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 1.6 G 2026-02-25T14:57:47.817 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T14:59:41.257 INFO:teuthology.orchestra.run.trial174.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.1 MB/s | 343 MB 04:59 2026-02-25T14:59:41.263 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:41.263 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.1 MB/s | 343 MB 04:59 2026-02-25T14:59:41.263 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T14:59:41.263 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T14:59:41.263 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T14:59:42.290 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T14:59:42.290 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T14:59:59.915 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T14:59:59.989 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:00:00.052 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:00:00.116 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:00:00.117 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:00.117 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:00:00.117 INFO:teuthology.orchestra.run.trial174.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:00:00.117 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:00.117 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:00:00.174 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install ceph-fuse-debuginfo 2026-02-25T15:00:00.493 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:33:54 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:00:00.577 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:00:00.578 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:00.578 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:00:00.578 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 10 M 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 51 M 2026-02-25T15:00:00.579 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:00:07.214 INFO:teuthology.orchestra.run.trial174.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.5 MB/s | 10 MB 00:06 2026-02-25T15:00:07.215 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:00:07.215 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.5 MB/s | 10 MB 00:06 2026-02-25T15:00:07.215 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:00:07.216 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:00:07.217 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:00:07.264 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:00:07.264 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:00:07.814 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:00:07.831 INFO:teuthology.orchestra.run.trial174.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:00:07.930 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:00:07.993 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:00:07.993 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:07.994 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:00:07.994 INFO:teuthology.orchestra.run.trial174.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:00:07.994 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:07.994 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:00:08.019 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librados-devel-debuginfo 2026-02-25T15:00:08.338 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:34:02 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:00:08.421 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:00:08.422 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:08.422 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:00:08.422 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:08.422 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 144 k 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 802 k 2026-02-25T15:00:08.423 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:00:08.970 INFO:teuthology.orchestra.run.trial174.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 263 kB/s | 144 kB 00:00 2026-02-25T15:00:08.970 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:00:08.971 INFO:teuthology.orchestra.run.trial174.stdout:Total 262 kB/s | 144 kB 00:00 2026-02-25T15:00:08.971 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:00:08.972 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:00:08.973 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:00:08.992 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:00:08.992 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:00:09.034 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:00:09.051 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:00:09.111 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:00:09.173 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:00:09.173 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:09.174 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:00:09.174 INFO:teuthology.orchestra.run.trial174.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:00:09.174 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:09.174 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:00:09.200 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install libcephfs2-debuginfo 2026-02-25T15:00:09.520 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:34:03 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:00:09.604 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:00:09.605 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:09.605 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:00:09.605 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:09.605 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:00:09.605 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-25T15:00:09.605 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:09.605 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:00:09.606 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:09.606 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:00:09.606 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:09.606 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 9.1 M 2026-02-25T15:00:09.606 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 46 M 2026-02-25T15:00:09.606 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:00:18.481 INFO:teuthology.orchestra.run.trial174.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 1.0 MB/s | 9.1 MB 00:08 2026-02-25T15:00:18.482 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:00:18.482 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.0 MB/s | 9.1 MB 00:08 2026-02-25T15:00:18.482 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:00:18.484 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:00:18.484 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:00:18.529 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:00:18.529 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:00:19.025 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:00:19.042 INFO:teuthology.orchestra.run.trial174.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:00:19.139 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:00:19.203 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:00:19.203 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:19.204 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:00:19.204 INFO:teuthology.orchestra.run.trial174.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:00:19.204 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:19.204 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:00:19.231 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librados2-debuginfo 2026-02-25T15:00:19.546 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:34:13 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:00:19.629 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:00:19.630 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:00:19.631 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:00:19.631 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 63 M 2026-02-25T15:00:19.631 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 397 M 2026-02-25T15:00:19.631 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:01:17.279 INFO:teuthology.orchestra.run.trial174.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.1 MB/s | 63 MB 00:57 2026-02-25T15:01:17.280 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:01:17.280 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.1 MB/s | 63 MB 00:57 2026-02-25T15:01:17.280 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:01:17.282 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:01:17.282 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:01:17.490 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:01:17.490 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:01:21.011 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:01:21.434 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:21.434 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:01:21.434 INFO:teuthology.orchestra.run.trial174.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:01:21.434 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:21.434 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:01:21.464 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install librbd1-debuginfo 2026-02-25T15:01:21.782 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:35:15 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:01:21.866 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:01:21.867 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:21.867 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:01:21.867 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:21.867 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:01:21.867 INFO:teuthology.orchestra.run.trial174.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-25T15:01:21.867 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:21.867 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:01:21.868 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:21.868 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:01:21.868 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:21.868 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 80 M 2026-02-25T15:01:21.868 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 406 M 2026-02-25T15:01:21.868 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:01:48.311 INFO:teuthology.orchestra.run.trial174.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 3.0 MB/s | 80 MB 00:26 2026-02-25T15:01:48.312 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:01:48.312 INFO:teuthology.orchestra.run.trial174.stdout:Total 3.0 MB/s | 80 MB 00:26 2026-02-25T15:01:48.312 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:01:48.314 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:01:48.314 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:01:48.570 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:01:48.571 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:01:52.807 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:01:52.825 INFO:teuthology.orchestra.run.trial174.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:01:53.178 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:01:53.241 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:01:53.241 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:53.241 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:01:53.241 INFO:teuthology.orchestra.run.trial174.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:01:53.241 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:53.242 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:01:53.275 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-cephfs-debuginfo 2026-02-25T15:01:53.598 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:35:47 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:01:53.685 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:01:53.685 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:53.686 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 645 k 2026-02-25T15:01:53.687 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 2.3 M 2026-02-25T15:01:53.687 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:01:54.415 INFO:teuthology.orchestra.run.trial174.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 884 kB/s | 645 kB 00:00 2026-02-25T15:01:54.416 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:01:54.416 INFO:teuthology.orchestra.run.trial174.stdout:Total 882 kB/s | 645 kB 00:00 2026-02-25T15:01:54.417 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:01:54.418 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:01:54.418 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:01:54.439 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:01:54.439 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:01:54.504 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:01:54.523 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:01:54.587 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:01:54.650 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:01:54.650 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:54.650 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:01:54.650 INFO:teuthology.orchestra.run.trial174.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:01:54.650 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:54.650 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:01:54.677 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rados-debuginfo 2026-02-25T15:01:54.992 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:35:48 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:01:55.074 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:01:55.075 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:55.075 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:01:55.075 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:55.076 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:01:55.076 INFO:teuthology.orchestra.run.trial174.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-25T15:01:55.076 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:55.076 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:01:55.076 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:55.076 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:01:55.076 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:55.076 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 802 k 2026-02-25T15:01:55.077 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 3.1 M 2026-02-25T15:01:55.077 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:01:55.963 INFO:teuthology.orchestra.run.trial174.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 903 kB/s | 802 kB 00:00 2026-02-25T15:01:55.965 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:01:55.965 INFO:teuthology.orchestra.run.trial174.stdout:Total 901 kB/s | 802 kB 00:00 2026-02-25T15:01:55.966 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:01:55.968 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:01:55.968 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:01:55.988 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:01:55.989 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:01:56.064 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:01:56.081 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:01:56.148 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:01:56.212 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:01:56.213 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:56.213 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:01:56.213 INFO:teuthology.orchestra.run.trial174.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:01:56.213 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:56.213 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:01:56.240 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rbd-debuginfo 2026-02-25T15:01:56.557 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:35:50 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:01:56.640 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:01:56.641 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:56.641 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:01:56.641 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:56.641 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:01:56.641 INFO:teuthology.orchestra.run.trial174.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-25T15:01:56.641 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:56.642 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:01:56.642 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:56.642 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:01:56.642 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:56.642 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 1.2 M 2026-02-25T15:01:56.642 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 4.7 M 2026-02-25T15:01:56.642 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:01:57.880 INFO:teuthology.orchestra.run.trial174.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 963 kB/s | 1.2 MB 00:01 2026-02-25T15:01:57.881 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:01:57.881 INFO:teuthology.orchestra.run.trial174.stdout:Total 961 kB/s | 1.2 MB 00:01 2026-02-25T15:01:57.881 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:01:57.883 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:01:57.883 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:01:57.904 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:01:57.905 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:01:57.998 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:01:58.015 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:01:58.077 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:01:58.141 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:01:58.142 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:58.142 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:01:58.142 INFO:teuthology.orchestra.run.trial174.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:01:58.142 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:58.142 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:01:58.168 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install python3-rgw-debuginfo 2026-02-25T15:01:58.482 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:35:52 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:01:58.566 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:01:58.567 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:58.567 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:01:58.567 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:58.567 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 350 k 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 1.1 M 2026-02-25T15:01:58.568 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:01:59.283 INFO:teuthology.orchestra.run.trial174.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 490 kB/s | 350 kB 00:00 2026-02-25T15:01:59.284 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:01:59.284 INFO:teuthology.orchestra.run.trial174.stdout:Total 489 kB/s | 350 kB 00:00 2026-02-25T15:01:59.284 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:01:59.286 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:01:59.286 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:01:59.304 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:01:59.305 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:01:59.355 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:01:59.372 INFO:teuthology.orchestra.run.trial174.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:01:59.430 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:01:59.492 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:01:59.492 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:59.492 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:01:59.492 INFO:teuthology.orchestra.run.trial174.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:01:59.492 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:59.492 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:01:59.517 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-fuse-debuginfo 2026-02-25T15:01:59.834 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:35:53 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:01:59.917 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:01:59.917 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:59.917 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:01:59.917 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:59.917 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:01:59.917 INFO:teuthology.orchestra.run.trial174.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-25T15:01:59.917 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:59.917 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:01:59.918 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:01:59.918 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:01:59.918 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:01:59.918 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 1.5 M 2026-02-25T15:01:59.918 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 7.9 M 2026-02-25T15:01:59.918 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:02:01.413 INFO:teuthology.orchestra.run.trial174.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.0 MB/s | 1.5 MB 00:01 2026-02-25T15:02:01.414 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:02:01.414 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.0 MB/s | 1.5 MB 00:01 2026-02-25T15:02:01.414 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:02:01.416 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:02:01.416 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:02:01.438 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:02:01.438 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:02:01.551 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:02:01.568 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:02:01.635 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:02:01.698 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:02:01.698 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:01.698 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:02:01.698 INFO:teuthology.orchestra.run.trial174.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:02:01.698 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:01.698 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:02:01.725 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-mirror-debuginfo 2026-02-25T15:02:02.035 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:35:56 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:02:02.120 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:02:02.120 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:02:02.120 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:02:02.120 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:02:02.120 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:02:02.120 INFO:teuthology.orchestra.run.trial174.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-25T15:02:02.120 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:02.121 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:02:02.121 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:02:02.121 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:02:02.121 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:02.121 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 79 M 2026-02-25T15:02:02.121 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 375 M 2026-02-25T15:02:02.121 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:02:43.963 INFO:teuthology.orchestra.run.trial167.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.0 MB/s | 343 MB 05:33 2026-02-25T15:02:43.964 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:02:43.964 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.0 MB/s | 343 MB 05:33 2026-02-25T15:02:43.964 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:02:43.966 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:02:43.966 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:02:44.991 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:02:44.991 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:02:50.176 INFO:teuthology.orchestra.run.trial174.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 1.6 MB/s | 79 MB 00:48 2026-02-25T15:02:50.177 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:02:50.177 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.6 MB/s | 79 MB 00:48 2026-02-25T15:02:50.177 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:02:50.179 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:02:50.179 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:02:50.432 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:02:50.432 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:02:51.186 INFO:teuthology.orchestra.run.trial078.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.1 MB/s | 343 MB 05:03 2026-02-25T15:02:51.187 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:02:51.187 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.1 MB/s | 343 MB 05:03 2026-02-25T15:02:51.187 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:02:51.189 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:02:51.189 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:02:52.218 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:02:52.218 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:02:54.565 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:02:54.582 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:02:54.909 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:02:54.972 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:02:54.972 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:54.972 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:02:54.973 INFO:teuthology.orchestra.run.trial174.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:02:54.973 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:54.973 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:02:55.003 DEBUG:teuthology.orchestra.run.trial174:> sudo yum -y install rbd-nbd-debuginfo 2026-02-25T15:02:55.322 INFO:teuthology.orchestra.run.trial174.stdout:Last metadata expiration check: 0:36:49 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:02:55.406 INFO:teuthology.orchestra.run.trial174.stdout:Dependencies resolved. 2026-02-25T15:02:55.406 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout: Package Arch Version Repo Size 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout:Installing: 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout:Transaction Summary 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout:================================================================================ 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout:Install 1 Package 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:55.407 INFO:teuthology.orchestra.run.trial174.stdout:Total download size: 2.4 M 2026-02-25T15:02:55.408 INFO:teuthology.orchestra.run.trial174.stdout:Installed size: 12 M 2026-02-25T15:02:55.408 INFO:teuthology.orchestra.run.trial174.stdout:Downloading Packages: 2026-02-25T15:02:57.038 INFO:teuthology.orchestra.run.trial174.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 1.5 MB/s | 2.4 MB 00:01 2026-02-25T15:02:57.038 INFO:teuthology.orchestra.run.trial174.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:02:57.038 INFO:teuthology.orchestra.run.trial174.stdout:Total 1.5 MB/s | 2.4 MB 00:01 2026-02-25T15:02:57.038 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction check 2026-02-25T15:02:57.040 INFO:teuthology.orchestra.run.trial174.stdout:Transaction check succeeded. 2026-02-25T15:02:57.040 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction test 2026-02-25T15:02:57.066 INFO:teuthology.orchestra.run.trial174.stdout:Transaction test succeeded. 2026-02-25T15:02:57.066 INFO:teuthology.orchestra.run.trial174.stdout:Running transaction 2026-02-25T15:02:57.231 INFO:teuthology.orchestra.run.trial174.stdout: Preparing : 1/1 2026-02-25T15:02:57.248 INFO:teuthology.orchestra.run.trial174.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:02:57.321 INFO:teuthology.orchestra.run.trial174.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:02:57.384 INFO:teuthology.orchestra.run.trial174.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:02:57.384 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:57.384 INFO:teuthology.orchestra.run.trial174.stdout:Installed: 2026-02-25T15:02:57.384 INFO:teuthology.orchestra.run.trial174.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:02:57.384 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:02:57.384 INFO:teuthology.orchestra.run.trial174.stdout:Complete! 2026-02-25T15:02:57.414 DEBUG:teuthology.parallel:result is None 2026-02-25T15:03:02.276 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:03:02.293 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:03:02.931 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:03:02.994 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:03:02.994 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:02.994 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:03:02.995 INFO:teuthology.orchestra.run.trial167.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:03:02.995 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:02.995 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:03:03.051 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install ceph-fuse-debuginfo 2026-02-25T15:03:03.365 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:36:57 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:03:03.448 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:03:03.449 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:03.449 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:03:03.449 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:03.449 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 10 M 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 51 M 2026-02-25T15:03:03.450 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:03:09.553 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:03:09.570 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:03:10.792 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:03:10.855 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:03:10.855 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:10.855 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:03:10.856 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:03:10.856 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:10.856 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:03:10.916 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-fuse-debuginfo 2026-02-25T15:03:11.234 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:37:02 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:03:11.319 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:03:11.320 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:11.320 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:03:11.320 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:11.320 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:03:11.320 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-25T15:03:11.320 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:11.320 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:03:11.321 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:11.321 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:03:11.321 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:11.321 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 10 M 2026-02-25T15:03:11.321 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 51 M 2026-02-25T15:03:11.321 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:03:13.468 INFO:teuthology.orchestra.run.trial167.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.0 MB/s | 10 MB 00:10 2026-02-25T15:03:13.469 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:03:13.469 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.0 MB/s | 10 MB 00:10 2026-02-25T15:03:13.469 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:03:13.471 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:03:13.471 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:03:13.519 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:03:13.520 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:03:14.072 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:03:14.090 INFO:teuthology.orchestra.run.trial167.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:03:14.186 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:03:14.248 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:03:14.248 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:14.248 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:03:14.248 INFO:teuthology.orchestra.run.trial167.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:03:14.249 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:14.249 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:03:14.275 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install librados-devel-debuginfo 2026-02-25T15:03:14.587 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:37:08 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:03:14.669 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:03:14.670 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:14.670 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:03:14.670 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:14.670 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 144 k 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 802 k 2026-02-25T15:03:14.671 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:03:15.473 INFO:teuthology.orchestra.run.trial167.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 179 kB/s | 144 kB 00:00 2026-02-25T15:03:15.474 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:03:15.474 INFO:teuthology.orchestra.run.trial167.stdout:Total 179 kB/s | 144 kB 00:00 2026-02-25T15:03:15.474 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:03:15.476 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:03:15.477 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:03:15.495 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:03:15.495 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:03:15.536 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:03:15.553 INFO:teuthology.orchestra.run.trial167.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:03:15.613 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:03:15.675 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:03:15.676 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:15.676 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:03:15.676 INFO:teuthology.orchestra.run.trial167.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:03:15.676 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:15.676 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:03:15.702 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install libcephfs2-debuginfo 2026-02-25T15:03:16.016 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:37:10 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:03:16.100 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:03:16.100 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:16.101 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 9.1 M 2026-02-25T15:03:16.102 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 46 M 2026-02-25T15:03:16.102 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:03:17.483 INFO:teuthology.orchestra.run.trial078.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.7 MB/s | 10 MB 00:06 2026-02-25T15:03:17.483 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:03:17.484 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.7 MB/s | 10 MB 00:06 2026-02-25T15:03:17.484 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:03:17.486 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:03:17.486 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:03:17.532 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:03:17.532 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:03:18.091 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:03:18.109 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:03:18.198 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:03:18.259 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:03:18.260 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:18.260 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:03:18.260 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:03:18.260 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:18.260 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:03:18.287 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librados-devel-debuginfo 2026-02-25T15:03:18.611 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:37:09 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:03:18.696 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:03:18.696 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:18.697 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 144 k 2026-02-25T15:03:18.698 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 802 k 2026-02-25T15:03:18.698 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:03:19.181 INFO:teuthology.orchestra.run.trial078.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 297 kB/s | 144 kB 00:00 2026-02-25T15:03:19.181 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:03:19.181 INFO:teuthology.orchestra.run.trial078.stdout:Total 297 kB/s | 144 kB 00:00 2026-02-25T15:03:19.181 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:03:19.183 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:03:19.183 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:03:19.201 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:03:19.201 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:03:19.243 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:03:19.260 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:03:19.322 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:03:19.385 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:03:19.385 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:19.385 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:03:19.385 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:03:19.385 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:19.385 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:03:19.414 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install libcephfs2-debuginfo 2026-02-25T15:03:19.731 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:37:10 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:03:19.816 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:03:19.817 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:19.817 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:03:19.817 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:19.817 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 9.1 M 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 46 M 2026-02-25T15:03:19.818 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:03:28.013 INFO:teuthology.orchestra.run.trial167.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 781 kB/s | 9.1 MB 00:11 2026-02-25T15:03:28.014 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:03:28.015 INFO:teuthology.orchestra.run.trial167.stdout:Total 781 kB/s | 9.1 MB 00:11 2026-02-25T15:03:28.015 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:03:28.016 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:03:28.016 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:03:28.060 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:03:28.061 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:03:28.557 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:03:28.575 INFO:teuthology.orchestra.run.trial167.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:03:28.668 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:03:28.732 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:03:28.732 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:28.732 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:03:28.732 INFO:teuthology.orchestra.run.trial167.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:03:28.732 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:28.732 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:03:28.760 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install librados2-debuginfo 2026-02-25T15:03:29.076 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:37:23 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:03:29.159 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 63 M 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 397 M 2026-02-25T15:03:29.160 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:03:30.083 INFO:teuthology.orchestra.run.trial078.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 907 kB/s | 9.1 MB 00:10 2026-02-25T15:03:30.084 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:03:30.084 INFO:teuthology.orchestra.run.trial078.stdout:Total 906 kB/s | 9.1 MB 00:10 2026-02-25T15:03:30.084 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:03:30.086 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:03:30.086 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:03:30.130 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:03:30.130 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:03:30.626 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:03:30.644 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:03:30.735 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:03:30.797 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:03:30.797 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:30.797 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:03:30.797 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:03:30.797 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:30.797 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:03:30.824 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librados2-debuginfo 2026-02-25T15:03:31.142 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:37:22 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 63 M 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 397 M 2026-02-25T15:03:31.226 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:04:09.109 INFO:teuthology.orchestra.run.trial167.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.6 MB/s | 63 MB 00:39 2026-02-25T15:04:09.109 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:04:09.109 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.6 MB/s | 63 MB 00:39 2026-02-25T15:04:09.110 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:04:09.112 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:04:09.112 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:04:09.319 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:04:09.320 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:04:12.875 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:04:12.893 INFO:teuthology.orchestra.run.trial167.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:04:13.236 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:04:13.299 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:04:13.299 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:13.299 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:04:13.300 INFO:teuthology.orchestra.run.trial167.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:04:13.300 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:13.300 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:04:13.330 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install librbd1-debuginfo 2026-02-25T15:04:13.648 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:38:07 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:04:13.731 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:04:13.731 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:13.731 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:04:13.731 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:13.731 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:04:13.731 INFO:teuthology.orchestra.run.trial167.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-25T15:04:13.731 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:13.731 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:04:13.732 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:13.732 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:04:13.732 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:13.732 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 80 M 2026-02-25T15:04:13.732 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 406 M 2026-02-25T15:04:13.732 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:04:14.695 INFO:teuthology.orchestra.run.trial078.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.5 MB/s | 63 MB 00:43 2026-02-25T15:04:14.696 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:04:14.696 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.5 MB/s | 63 MB 00:43 2026-02-25T15:04:14.696 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:04:14.698 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:04:14.698 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:04:14.904 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:04:14.904 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:04:18.401 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:04:18.419 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:04:18.732 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:04:18.793 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:04:18.794 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:04:18.794 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:04:18.794 INFO:teuthology.orchestra.run.trial078.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:04:18.794 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:04:18.794 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:04:18.824 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librbd1-debuginfo 2026-02-25T15:04:19.141 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:38:10 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 80 M 2026-02-25T15:04:19.224 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 406 M 2026-02-25T15:04:19.225 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:04:42.222 INFO:teuthology.orchestra.run.trial155.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.1 MB/s | 1.7 GB 25:44 2026-02-25T15:04:42.223 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:04:42.223 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.1 MB/s | 1.7 GB 25:44 2026-02-25T15:04:42.223 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:04:42.227 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:04:42.227 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:04:47.425 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:04:47.425 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:04:49.115 INFO:teuthology.orchestra.run.trial167.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 2.3 MB/s | 80 MB 00:35 2026-02-25T15:04:49.116 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:04:49.116 INFO:teuthology.orchestra.run.trial167.stdout:Total 2.3 MB/s | 80 MB 00:35 2026-02-25T15:04:49.116 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:04:49.118 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:04:49.118 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:04:49.374 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:04:49.374 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:04:53.690 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:04:53.708 INFO:teuthology.orchestra.run.trial167.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:04:54.067 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:04:54.131 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:04:54.131 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:54.131 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:04:54.131 INFO:teuthology.orchestra.run.trial167.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:04:54.131 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:54.131 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:04:54.163 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install python3-cephfs-debuginfo 2026-02-25T15:04:54.475 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:38:48 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:04:54.558 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:04:54.559 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:54.559 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:04:54.559 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:54.559 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 645 k 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 2.3 M 2026-02-25T15:04:54.560 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:04:55.236 INFO:teuthology.orchestra.run.trial167.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 952 kB/s | 645 kB 00:00 2026-02-25T15:04:55.237 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:04:55.237 INFO:teuthology.orchestra.run.trial167.stdout:Total 951 kB/s | 645 kB 00:00 2026-02-25T15:04:55.237 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:04:55.239 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:04:55.239 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:04:55.258 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:04:55.258 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:04:55.323 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:04:55.341 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:04:55.400 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:04:55.462 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:04:55.462 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:55.462 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:04:55.462 INFO:teuthology.orchestra.run.trial167.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:04:55.462 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:55.462 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:04:55.488 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install python3-rados-debuginfo 2026-02-25T15:04:55.801 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:38:49 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:04:55.883 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:04:55.884 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:04:55.885 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:55.886 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 802 k 2026-02-25T15:04:55.886 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 3.1 M 2026-02-25T15:04:55.886 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:04:56.564 INFO:teuthology.orchestra.run.trial167.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 1.2 MB/s | 802 kB 00:00 2026-02-25T15:04:56.564 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:04:56.564 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.2 MB/s | 802 kB 00:00 2026-02-25T15:04:56.564 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:04:56.566 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:04:56.566 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:04:56.586 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:04:56.586 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:04:56.662 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:04:56.679 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:04:56.745 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:04:56.809 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:04:56.809 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:56.809 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:04:56.809 INFO:teuthology.orchestra.run.trial167.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:04:56.809 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:56.809 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:04:56.837 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install python3-rbd-debuginfo 2026-02-25T15:04:57.153 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:38:51 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:04:57.236 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:04:57.236 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:57.236 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:04:57.236 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:57.236 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:04:57.236 INFO:teuthology.orchestra.run.trial167.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-25T15:04:57.236 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:57.236 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:04:57.237 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:57.237 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:04:57.237 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:57.237 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 1.2 M 2026-02-25T15:04:57.237 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 4.7 M 2026-02-25T15:04:57.237 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:04:58.057 INFO:teuthology.orchestra.run.trial167.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 1.4 MB/s | 1.2 MB 00:00 2026-02-25T15:04:58.058 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:04:58.058 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.4 MB/s | 1.2 MB 00:00 2026-02-25T15:04:58.058 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:04:58.060 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:04:58.060 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:04:58.081 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:04:58.081 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:04:58.173 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:04:58.190 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:04:58.252 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:04:58.315 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:04:58.315 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:58.315 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:04:58.315 INFO:teuthology.orchestra.run.trial167.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:04:58.315 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:58.315 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:04:58.341 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install python3-rgw-debuginfo 2026-02-25T15:04:58.655 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:38:52 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:04:58.739 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:04:58.739 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:58.739 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:04:58.739 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:58.739 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:04:58.739 INFO:teuthology.orchestra.run.trial167.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-25T15:04:58.740 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:58.740 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:04:58.740 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:04:58.740 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:04:58.740 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:58.740 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 350 k 2026-02-25T15:04:58.740 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 1.1 M 2026-02-25T15:04:58.740 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:04:59.490 INFO:teuthology.orchestra.run.trial167.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 467 kB/s | 350 kB 00:00 2026-02-25T15:04:59.490 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:04:59.491 INFO:teuthology.orchestra.run.trial167.stdout:Total 466 kB/s | 350 kB 00:00 2026-02-25T15:04:59.491 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:04:59.492 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:04:59.492 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:04:59.512 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:04:59.512 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:04:59.562 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:04:59.580 INFO:teuthology.orchestra.run.trial167.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:04:59.639 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:04:59.701 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:04:59.701 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:59.701 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:04:59.702 INFO:teuthology.orchestra.run.trial167.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:04:59.702 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:04:59.702 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:04:59.727 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install rbd-fuse-debuginfo 2026-02-25T15:05:00.042 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:38:54 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:05:00.126 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:00.127 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:05:00.128 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:00.128 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 1.5 M 2026-02-25T15:05:00.128 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 7.9 M 2026-02-25T15:05:00.128 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:05:01.663 INFO:teuthology.orchestra.run.trial167.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.0 MB/s | 1.5 MB 00:01 2026-02-25T15:05:01.664 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:05:01.664 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.0 MB/s | 1.5 MB 00:01 2026-02-25T15:05:01.664 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:05:01.666 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:05:01.666 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:05:01.688 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:05:01.688 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:05:01.802 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:05:01.819 INFO:teuthology.orchestra.run.trial167.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:01.886 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:01.948 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:01.948 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:01.948 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:05:01.948 INFO:teuthology.orchestra.run.trial167.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:05:01.948 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:01.948 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:05:01.974 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install rbd-mirror-debuginfo 2026-02-25T15:05:02.287 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:38:56 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:05:02.371 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:05:02.371 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:02.371 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:05:02.371 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:02.371 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 79 M 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 375 M 2026-02-25T15:05:02.372 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:05:12.102 INFO:teuthology.orchestra.run.trial078.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 1.5 MB/s | 80 MB 00:52 2026-02-25T15:05:12.103 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:05:12.103 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.5 MB/s | 80 MB 00:52 2026-02-25T15:05:12.103 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:05:12.104 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:05:12.105 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:05:12.362 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:05:12.362 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:05:16.626 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:05:16.643 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:16.999 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:17.061 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:17.061 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:17.061 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:05:17.061 INFO:teuthology.orchestra.run.trial078.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:05:17.061 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:17.061 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:05:17.093 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-cephfs-debuginfo 2026-02-25T15:05:17.409 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:39:08 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:05:17.492 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:05:17.493 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:17.493 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:05:17.493 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:17.493 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 645 k 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 2.3 M 2026-02-25T15:05:17.494 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:05:18.316 INFO:teuthology.orchestra.run.trial078.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 784 kB/s | 645 kB 00:00 2026-02-25T15:05:18.317 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:05:18.317 INFO:teuthology.orchestra.run.trial078.stdout:Total 783 kB/s | 645 kB 00:00 2026-02-25T15:05:18.317 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:05:18.319 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:05:18.319 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:05:18.338 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:05:18.339 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:05:18.404 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:05:18.421 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:05:18.484 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:05:18.545 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:05:18.546 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:18.546 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:05:18.546 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:05:18.546 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:18.546 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:05:18.573 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rados-debuginfo 2026-02-25T15:05:18.894 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:39:09 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:05:18.977 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:05:18.978 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:18.978 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:05:18.978 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:18.978 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:05:18.978 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-25T15:05:18.978 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:18.979 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:05:18.979 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:18.979 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:05:18.979 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:18.979 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 802 k 2026-02-25T15:05:18.979 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 3.1 M 2026-02-25T15:05:18.979 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:05:19.866 INFO:teuthology.orchestra.run.trial078.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 904 kB/s | 802 kB 00:00 2026-02-25T15:05:19.866 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:05:19.866 INFO:teuthology.orchestra.run.trial078.stdout:Total 904 kB/s | 802 kB 00:00 2026-02-25T15:05:19.866 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:05:19.868 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:05:19.868 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:05:19.888 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:05:19.888 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:05:19.961 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:05:19.978 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:05:20.039 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:05:20.101 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:05:20.101 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:20.101 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:05:20.101 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:05:20.101 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:20.102 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:05:20.128 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rbd-debuginfo 2026-02-25T15:05:20.443 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:39:11 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:05:20.525 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:05:20.526 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:20.527 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 1.2 M 2026-02-25T15:05:20.528 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 4.7 M 2026-02-25T15:05:20.528 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:05:22.034 INFO:teuthology.orchestra.run.trial078.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 791 kB/s | 1.2 MB 00:01 2026-02-25T15:05:22.035 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:05:22.035 INFO:teuthology.orchestra.run.trial078.stdout:Total 791 kB/s | 1.2 MB 00:01 2026-02-25T15:05:22.035 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:05:22.037 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:05:22.037 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:05:22.057 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:05:22.058 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:05:22.149 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:05:22.166 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:05:22.226 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:05:22.287 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:05:22.288 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:22.288 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:05:22.288 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:05:22.288 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:22.288 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:05:22.314 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rgw-debuginfo 2026-02-25T15:05:22.625 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:39:13 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:05:22.710 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:05:22.711 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:22.711 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:05:22.711 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:22.711 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:05:22.711 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-25T15:05:22.712 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:22.712 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:05:22.712 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:22.712 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:05:22.712 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:22.712 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 350 k 2026-02-25T15:05:22.712 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 1.1 M 2026-02-25T15:05:22.712 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:05:23.311 INFO:teuthology.orchestra.run.trial078.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 584 kB/s | 350 kB 00:00 2026-02-25T15:05:23.312 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:05:23.312 INFO:teuthology.orchestra.run.trial078.stdout:Total 583 kB/s | 350 kB 00:00 2026-02-25T15:05:23.312 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:05:23.314 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:05:23.314 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:05:23.333 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:05:23.333 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:05:23.383 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:05:23.400 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:05:23.459 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:05:23.521 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:05:23.521 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:23.521 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:05:23.522 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:05:23.522 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:23.522 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:05:23.549 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-fuse-debuginfo 2026-02-25T15:05:23.862 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:39:14 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:05:23.947 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:05:23.947 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:23.948 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 1.5 M 2026-02-25T15:05:23.949 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 7.9 M 2026-02-25T15:05:23.949 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:05:25.578 INFO:teuthology.orchestra.run.trial078.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 963 kB/s | 1.5 MB 00:01 2026-02-25T15:05:25.578 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:05:25.579 INFO:teuthology.orchestra.run.trial078.stdout:Total 963 kB/s | 1.5 MB 00:01 2026-02-25T15:05:25.579 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:05:25.580 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:05:25.580 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:05:25.604 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:05:25.604 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:05:25.716 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:05:25.733 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:25.796 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:25.858 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:05:25.858 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:25.858 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:05:25.858 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:05:25.858 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:25.858 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:05:25.885 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-mirror-debuginfo 2026-02-25T15:05:26.204 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:39:17 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:05:26.289 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:05:26.290 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:05:26.291 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 79 M 2026-02-25T15:05:26.292 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 375 M 2026-02-25T15:05:26.292 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:05:53.370 INFO:teuthology.orchestra.run.trial167.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 1.6 MB/s | 79 MB 00:50 2026-02-25T15:05:53.371 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:05:53.371 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.6 MB/s | 79 MB 00:50 2026-02-25T15:05:53.371 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:05:53.373 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:05:53.373 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:05:53.624 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:05:53.625 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:05:57.668 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:05:57.686 INFO:teuthology.orchestra.run.trial167.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:05:58.011 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:05:58.075 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:05:58.075 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:58.075 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:05:58.076 INFO:teuthology.orchestra.run.trial167.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:05:58.076 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:58.076 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:05:58.106 DEBUG:teuthology.orchestra.run.trial167:> sudo yum -y install rbd-nbd-debuginfo 2026-02-25T15:05:58.423 INFO:teuthology.orchestra.run.trial167.stdout:Last metadata expiration check: 0:39:52 ago on Wed 25 Feb 2026 02:26:06 PM UTC. 2026-02-25T15:05:58.506 INFO:teuthology.orchestra.run.trial167.stdout:Dependencies resolved. 2026-02-25T15:05:58.507 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:58.507 INFO:teuthology.orchestra.run.trial167.stdout: Package Arch Version Repo Size 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout:Installing: 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout:Transaction Summary 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout:================================================================================ 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout:Install 1 Package 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout:Total download size: 2.4 M 2026-02-25T15:05:58.508 INFO:teuthology.orchestra.run.trial167.stdout:Installed size: 12 M 2026-02-25T15:05:58.509 INFO:teuthology.orchestra.run.trial167.stdout:Downloading Packages: 2026-02-25T15:06:00.897 INFO:teuthology.orchestra.run.trial167.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 1.0 MB/s | 2.4 MB 00:02 2026-02-25T15:06:00.897 INFO:teuthology.orchestra.run.trial167.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:06:00.898 INFO:teuthology.orchestra.run.trial167.stdout:Total 1.0 MB/s | 2.4 MB 00:02 2026-02-25T15:06:00.898 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction check 2026-02-25T15:06:00.900 INFO:teuthology.orchestra.run.trial167.stdout:Transaction check succeeded. 2026-02-25T15:06:00.900 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction test 2026-02-25T15:06:00.925 INFO:teuthology.orchestra.run.trial167.stdout:Transaction test succeeded. 2026-02-25T15:06:00.926 INFO:teuthology.orchestra.run.trial167.stdout:Running transaction 2026-02-25T15:06:01.084 INFO:teuthology.orchestra.run.trial167.stdout: Preparing : 1/1 2026-02-25T15:06:01.102 INFO:teuthology.orchestra.run.trial167.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:01.170 INFO:teuthology.orchestra.run.trial167.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:01.232 INFO:teuthology.orchestra.run.trial167.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:01.232 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:06:01.232 INFO:teuthology.orchestra.run.trial167.stdout:Installed: 2026-02-25T15:06:01.233 INFO:teuthology.orchestra.run.trial167.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:06:01.233 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:06:01.233 INFO:teuthology.orchestra.run.trial167.stdout:Complete! 2026-02-25T15:06:01.261 DEBUG:teuthology.parallel:result is None 2026-02-25T15:06:13.371 INFO:teuthology.orchestra.run.trial078.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 1.7 MB/s | 79 MB 00:47 2026-02-25T15:06:13.372 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:06:13.372 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.7 MB/s | 79 MB 00:47 2026-02-25T15:06:13.373 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:06:13.374 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:06:13.374 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:06:13.626 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:06:13.627 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:06:17.751 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:06:17.768 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:06:18.077 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:06:18.139 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:06:18.139 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:06:18.140 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:06:18.140 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:06:18.140 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:06:18.140 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:06:18.173 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-nbd-debuginfo 2026-02-25T15:06:18.488 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:40:09 ago on Wed 25 Feb 2026 02:26:09 PM UTC. 2026-02-25T15:06:18.574 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-25T15:06:18.574 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-25T15:06:18.575 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:06:18.576 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 2.4 M 2026-02-25T15:06:18.576 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 12 M 2026-02-25T15:06:18.576 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-25T15:06:19.877 INFO:teuthology.orchestra.run.trial078.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 1.9 MB/s | 2.4 MB 00:01 2026-02-25T15:06:19.877 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:06:19.877 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.9 MB/s | 2.4 MB 00:01 2026-02-25T15:06:19.877 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-25T15:06:19.878 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-25T15:06:19.879 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-25T15:06:19.903 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-25T15:06:19.904 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-25T15:06:20.062 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-25T15:06:20.079 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:20.148 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:20.210 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:20.210 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:06:20.210 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-25T15:06:20.210 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:06:20.210 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:06:20.210 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-25T15:06:20.240 DEBUG:teuthology.parallel:result is None 2026-02-25T15:06:30.733 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:06:30.753 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:06:33.885 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:06:33.948 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:06:33.949 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:33.949 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:06:33.949 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:06:33.949 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:33.949 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:06:34.154 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-base-debuginfo 2026-02-25T15:06:34.475 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:40:29 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:06:34.542 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-25T15:06:34.561 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:06:34.561 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-25T15:06:34.562 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:06:34.584 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-debuginfo 2026-02-25T15:06:34.909 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:40:29 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:06:34.994 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:06:34.995 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:34.995 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:06:34.995 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:34.995 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:06:34.995 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-25T15:06:34.995 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:34.995 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:06:34.995 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:34.996 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:06:34.996 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:34.996 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 22 M 2026-02-25T15:06:34.996 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 146 M 2026-02-25T15:06:34.996 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:06:39.617 INFO:teuthology.orchestra.run.trial155.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 4.7 MB/s | 22 MB 00:04 2026-02-25T15:06:39.617 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:06:39.618 INFO:teuthology.orchestra.run.trial155.stdout:Total 4.7 MB/s | 22 MB 00:04 2026-02-25T15:06:39.618 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:06:39.619 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:06:39.619 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:06:39.701 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:06:39.701 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:06:40.949 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:06:40.967 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:41.132 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:41.194 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:41.194 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:41.194 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:06:41.195 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:06:41.195 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:41.195 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:06:41.224 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mds-debuginfo 2026-02-25T15:06:41.546 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:40:36 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:06:41.632 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:41.633 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 54 M 2026-02-25T15:06:41.633 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 221 M 2026-02-25T15:06:41.633 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:06:48.615 INFO:teuthology.orchestra.run.trial155.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 7.7 MB/s | 54 MB 00:06 2026-02-25T15:06:48.616 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:06:48.616 INFO:teuthology.orchestra.run.trial155.stdout:Total 7.7 MB/s | 54 MB 00:06 2026-02-25T15:06:48.616 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:06:48.618 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:06:48.618 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:06:48.795 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:06:48.796 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:06:51.451 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:06:51.469 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:51.685 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:51.746 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:06:51.746 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:51.746 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:06:51.746 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:06:51.746 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:51.747 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:06:51.778 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mon-debuginfo 2026-02-25T15:06:52.093 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:40:47 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:06:52.177 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:06:52.177 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:06:52.178 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:06:52.179 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 130 M 2026-02-25T15:06:52.179 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 643 M 2026-02-25T15:06:52.179 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:07:50.139 INFO:teuthology.orchestra.run.trial155.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.2 MB/s | 130 MB 00:57 2026-02-25T15:07:50.140 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:07:50.140 INFO:teuthology.orchestra.run.trial155.stdout:Total 2.2 MB/s | 130 MB 00:57 2026-02-25T15:07:50.141 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:07:50.142 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:07:50.142 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:07:50.540 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:07:50.540 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:07:57.185 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:07:57.202 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:07:57.730 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:07:57.792 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:07:57.792 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:07:57.792 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:07:57.792 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:07:57.792 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:07:57.793 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:07:57.829 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-osd-debuginfo 2026-02-25T15:07:58.143 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:41:53 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:07:58.229 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:07:58.229 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:07:58.229 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:07:58.229 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:07:58.229 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:07:58.229 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-25T15:07:58.229 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:07:58.230 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:07:58.230 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:07:58.230 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:07:58.230 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:07:58.230 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 343 M 2026-02-25T15:07:58.230 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 1.6 G 2026-02-25T15:07:58.230 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:09:58.265 INFO:teuthology.orchestra.run.trial155.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.9 MB/s | 343 MB 02:00 2026-02-25T15:09:58.266 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:09:58.266 INFO:teuthology.orchestra.run.trial155.stdout:Total 2.9 MB/s | 343 MB 02:00 2026-02-25T15:09:58.266 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:09:58.268 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:09:58.268 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:09:59.290 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:09:59.291 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:10:16.494 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:10:16.511 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:10:17.744 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:10:17.805 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:10:17.805 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:17.806 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:10:17.806 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:10:17.806 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:17.806 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:10:17.863 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-fuse-debuginfo 2026-02-25T15:10:18.176 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:44:13 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:10:18.259 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:18.260 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 10 M 2026-02-25T15:10:18.260 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 51 M 2026-02-25T15:10:18.260 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:10:27.669 INFO:teuthology.orchestra.run.trial155.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.1 MB/s | 10 MB 00:09 2026-02-25T15:10:27.670 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:10:27.670 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.1 MB/s | 10 MB 00:09 2026-02-25T15:10:27.670 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:10:27.671 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:10:27.672 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:10:27.719 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:10:27.719 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:10:28.269 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:10:28.287 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:10:28.386 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:10:28.449 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:10:28.449 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:28.450 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:10:28.450 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:10:28.450 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:28.450 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:10:28.479 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados-devel-debuginfo 2026-02-25T15:10:28.798 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:44:23 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 144 k 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 802 k 2026-02-25T15:10:28.884 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:10:29.138 INFO:teuthology.orchestra.run.trial155.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 567 kB/s | 144 kB 00:00 2026-02-25T15:10:29.138 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:10:29.138 INFO:teuthology.orchestra.run.trial155.stdout:Total 565 kB/s | 144 kB 00:00 2026-02-25T15:10:29.138 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:10:29.141 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:10:29.141 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:10:29.160 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:10:29.160 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:10:29.200 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:10:29.217 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:10:29.275 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:10:29.337 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:10:29.337 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:29.337 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:10:29.337 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:10:29.337 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:29.337 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:10:29.363 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs2-debuginfo 2026-02-25T15:10:29.678 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:44:24 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:10:29.763 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:29.764 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 9.1 M 2026-02-25T15:10:29.764 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 46 M 2026-02-25T15:10:29.764 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:10:31.274 INFO:teuthology.orchestra.run.trial155.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 6.0 MB/s | 9.1 MB 00:01 2026-02-25T15:10:31.274 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:10:31.275 INFO:teuthology.orchestra.run.trial155.stdout:Total 6.0 MB/s | 9.1 MB 00:01 2026-02-25T15:10:31.275 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:10:31.276 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:10:31.276 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:10:31.320 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:10:31.320 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:10:31.817 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:10:31.834 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:10:31.926 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:10:31.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:10:31.988 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:31.988 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:10:31.988 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:10:31.989 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:31.989 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:10:32.014 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados2-debuginfo 2026-02-25T15:10:32.331 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:44:27 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:10:32.416 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:10:32.416 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:32.416 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:10:32.416 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:32.416 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:10:32.416 INFO:teuthology.orchestra.run.trial155.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-25T15:10:32.416 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:32.416 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:10:32.417 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:32.417 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:10:32.417 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:32.417 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 63 M 2026-02-25T15:10:32.417 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 397 M 2026-02-25T15:10:32.417 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:10:39.665 INFO:teuthology.orchestra.run.trial155.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 8.8 MB/s | 63 MB 00:07 2026-02-25T15:10:39.666 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:10:39.667 INFO:teuthology.orchestra.run.trial155.stdout:Total 8.8 MB/s | 63 MB 00:07 2026-02-25T15:10:39.667 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:10:39.668 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:10:39.668 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:10:39.874 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:10:39.874 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:10:43.378 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:10:43.395 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:10:43.748 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:10:43.811 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-25T15:10:43.811 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:43.811 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:10:43.811 INFO:teuthology.orchestra.run.trial155.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:10:43.812 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:43.812 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:10:43.843 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librbd1-debuginfo 2026-02-25T15:10:44.163 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:44:39 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:10:44.246 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:10:44.247 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:44.247 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:10:44.247 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 80 M 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 406 M 2026-02-25T15:10:44.248 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:10:58.195 INFO:teuthology.orchestra.run.trial155.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 5.8 MB/s | 80 MB 00:13 2026-02-25T15:10:58.196 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:10:58.196 INFO:teuthology.orchestra.run.trial155.stdout:Total 5.8 MB/s | 80 MB 00:13 2026-02-25T15:10:58.197 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:10:58.198 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:10:58.198 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:10:58.455 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:10:58.455 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:11:02.633 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:11:02.652 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:03.001 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:03.065 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:03.065 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:03.065 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:11:03.065 INFO:teuthology.orchestra.run.trial155.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:11:03.065 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:03.065 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:11:03.100 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-cephfs-debuginfo 2026-02-25T15:11:03.420 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:44:58 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:11:03.504 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:11:03.505 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:03.505 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:11:03.505 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:03.505 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:11:03.505 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-25T15:11:03.505 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:03.505 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:11:03.505 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:03.506 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:11:03.506 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:03.506 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 645 k 2026-02-25T15:11:03.506 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 2.3 M 2026-02-25T15:11:03.506 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:11:03.993 INFO:teuthology.orchestra.run.trial155.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 1.3 MB/s | 645 kB 00:00 2026-02-25T15:11:03.993 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:11:03.994 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.3 MB/s | 645 kB 00:00 2026-02-25T15:11:03.994 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:11:03.995 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:11:03.996 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:11:04.015 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:11:04.015 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:11:04.079 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:11:04.096 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:11:04.157 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:11:04.220 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-25T15:11:04.220 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:04.220 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:11:04.220 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:11:04.220 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:04.220 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:11:04.246 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rados-debuginfo 2026-02-25T15:11:04.562 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:44:59 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:11:04.648 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:04.649 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:11:04.650 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:04.650 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 802 k 2026-02-25T15:11:04.650 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 3.1 M 2026-02-25T15:11:04.650 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:11:06.071 INFO:teuthology.orchestra.run.trial155.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 564 kB/s | 802 kB 00:01 2026-02-25T15:11:06.072 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:11:06.073 INFO:teuthology.orchestra.run.trial155.stdout:Total 564 kB/s | 802 kB 00:01 2026-02-25T15:11:06.073 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:11:06.074 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:11:06.074 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:11:06.095 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:11:06.095 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:11:06.169 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:11:06.185 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:11:06.247 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:11:06.309 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-25T15:11:06.309 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:06.310 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:11:06.310 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:11:06.310 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:06.310 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:11:06.336 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rbd-debuginfo 2026-02-25T15:11:06.652 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:45:01 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:11:06.737 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:11:06.738 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:06.739 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:11:06.739 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:06.739 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:11:06.739 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-25T15:11:06.739 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:06.739 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:11:06.739 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:06.739 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:11:06.740 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:06.740 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 1.2 M 2026-02-25T15:11:06.740 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 4.7 M 2026-02-25T15:11:06.740 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:11:07.234 INFO:teuthology.orchestra.run.trial155.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 2.4 MB/s | 1.2 MB 00:00 2026-02-25T15:11:07.236 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:11:07.236 INFO:teuthology.orchestra.run.trial155.stdout:Total 2.3 MB/s | 1.2 MB 00:00 2026-02-25T15:11:07.236 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:11:07.238 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:11:07.238 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:11:07.259 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:11:07.259 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:11:07.351 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:11:07.368 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:11:07.431 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:11:07.493 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:11:07.493 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:07.493 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:11:07.493 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:11:07.493 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:07.493 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:11:07.519 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rgw-debuginfo 2026-02-25T15:11:07.835 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:45:02 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:11:07.920 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:11:07.921 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:07.921 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:11:07.921 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:07.921 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:11:07.921 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-25T15:11:07.921 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:07.921 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:11:07.921 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:07.922 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:11:07.922 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:07.922 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 350 k 2026-02-25T15:11:07.922 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 1.1 M 2026-02-25T15:11:07.922 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:11:08.447 INFO:teuthology.orchestra.run.trial155.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 666 kB/s | 350 kB 00:00 2026-02-25T15:11:08.448 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:11:08.448 INFO:teuthology.orchestra.run.trial155.stdout:Total 665 kB/s | 350 kB 00:00 2026-02-25T15:11:08.448 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:11:08.450 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:11:08.450 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:11:08.468 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:11:08.469 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:11:08.519 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:11:08.537 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:11:08.595 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:11:08.657 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-25T15:11:08.657 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:08.657 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:11:08.657 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:11:08.657 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:08.657 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:11:08.683 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-fuse-debuginfo 2026-02-25T15:11:09.002 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:45:03 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:11:09.086 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:11:09.087 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:09.087 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:11:09.087 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:09.087 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 1.5 M 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 7.9 M 2026-02-25T15:11:09.088 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:11:10.348 INFO:teuthology.orchestra.run.trial155.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.2 MB/s | 1.5 MB 00:01 2026-02-25T15:11:10.348 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:11:10.348 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.2 MB/s | 1.5 MB 00:01 2026-02-25T15:11:10.349 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:11:10.351 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:11:10.351 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:11:10.373 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:11:10.373 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:11:10.486 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:11:10.504 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:10.574 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:10.637 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:10.637 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:10.637 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:11:10.637 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:11:10.637 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:10.637 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:11:10.664 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-mirror-debuginfo 2026-02-25T15:11:10.982 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:45:05 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:11:11.068 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:11:11.069 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:11.069 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:11:11.069 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:11.069 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 79 M 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 375 M 2026-02-25T15:11:11.070 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:11:19.012 INFO:teuthology.orchestra.run.trial155.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 10 MB/s | 79 MB 00:07 2026-02-25T15:11:19.012 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:11:19.013 INFO:teuthology.orchestra.run.trial155.stdout:Total 10 MB/s | 79 MB 00:07 2026-02-25T15:11:19.013 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:11:19.015 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:11:19.015 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:11:19.266 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:11:19.266 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:11:23.312 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:11:23.330 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:11:23.658 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:11:23.720 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-25T15:11:23.720 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:23.720 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:11:23.720 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:11:23.720 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:23.721 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:11:23.753 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-nbd-debuginfo 2026-02-25T15:11:24.070 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:45:19 ago on Wed 25 Feb 2026 02:26:05 PM UTC. 2026-02-25T15:11:24.153 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-25T15:11:24.154 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:24.154 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-25T15:11:24.154 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 2.4 M 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 12 M 2026-02-25T15:11:24.155 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-25T15:11:24.902 INFO:teuthology.orchestra.run.trial155.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 3.3 MB/s | 2.4 MB 00:00 2026-02-25T15:11:24.903 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-25T15:11:24.903 INFO:teuthology.orchestra.run.trial155.stdout:Total 3.3 MB/s | 2.4 MB 00:00 2026-02-25T15:11:24.903 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-25T15:11:24.905 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-25T15:11:24.906 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-25T15:11:24.931 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-25T15:11:24.931 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-25T15:11:25.091 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-25T15:11:25.108 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:25.179 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:25.241 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-25T15:11:25.241 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:25.242 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-25T15:11:25.242 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-25T15:11:25.242 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:25.242 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-25T15:11:25.271 DEBUG:teuthology.parallel:result is None 2026-02-25T15:11:25.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T15:11:25.401 DEBUG:teuthology.orchestra.run.trial078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T15:11:25.432 INFO:teuthology.orchestra.run.trial078.stdout:20.2.0-681.g36d388f2.el9 2026-02-25T15:11:25.433 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-25T15:11:25.433 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-25T15:11:25.437 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T15:11:25.584 DEBUG:teuthology.orchestra.run.trial155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T15:11:25.606 INFO:teuthology.orchestra.run.trial155.stdout:20.2.0-681.g36d388f2.el9 2026-02-25T15:11:25.606 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-25T15:11:25.606 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-25T15:11:25.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T15:11:25.760 DEBUG:teuthology.orchestra.run.trial167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T15:11:25.792 INFO:teuthology.orchestra.run.trial167.stdout:20.2.0-681.g36d388f2.el9 2026-02-25T15:11:25.792 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-25T15:11:25.792 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-25T15:11:25.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T15:11:25.952 DEBUG:teuthology.orchestra.run.trial174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T15:11:26.021 INFO:teuthology.orchestra.run.trial174.stdout:20.2.0-681.g36d388f2.el9 2026-02-25T15:11:26.021 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-25T15:11:26.021 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-25T15:11:26.024 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-25T15:11:26.025 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:26.025 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T15:11:26.052 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:26.052 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T15:11:26.079 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:26.079 DEBUG:teuthology.orchestra.run.trial167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T15:11:26.105 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:26.106 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T15:11:26.132 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-25T15:11:26.132 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:26.133 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T15:11:26.158 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T15:11:26.222 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:26.222 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T15:11:26.248 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T15:11:26.312 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:26.312 DEBUG:teuthology.orchestra.run.trial167:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T15:11:26.338 DEBUG:teuthology.orchestra.run.trial167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T15:11:26.401 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:26.401 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T15:11:26.427 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T15:11:26.491 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-25T15:11:26.491 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:26.491 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T15:11:26.517 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T15:11:26.581 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:26.581 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T15:11:26.607 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T15:11:26.672 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:26.672 DEBUG:teuthology.orchestra.run.trial167:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T15:11:26.697 DEBUG:teuthology.orchestra.run.trial167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T15:11:26.762 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:26.762 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T15:11:26.788 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T15:11:26.853 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-25T15:11:26.853 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:26.853 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T15:11:26.879 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T15:11:26.943 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:26.943 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T15:11:26.968 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T15:11:27.033 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:27.033 DEBUG:teuthology.orchestra.run.trial167:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T15:11:27.058 DEBUG:teuthology.orchestra.run.trial167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T15:11:27.123 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:27.123 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T15:11:27.147 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T15:11:27.211 INFO:teuthology.run_tasks:Running task ceph... 2026-02-25T15:11:27.325 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-25T15:11:27.325 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 777 /var/log/ceph 2026-02-25T15:11:27.327 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 777 /var/log/ceph 2026-02-25T15:11:27.354 DEBUG:teuthology.orchestra.run.trial167:> sudo chmod 777 /var/log/ceph 2026-02-25T15:11:27.356 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod 777 /var/log/ceph 2026-02-25T15:11:27.381 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-25T15:11:27.381 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T15:11:27.397 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T15:11:27.399 DEBUG:teuthology.orchestra.run.trial167:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T15:11:27.421 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T15:11:27.443 INFO:tasks.ceph:Creating extra log directories... 2026-02-25T15:11:27.444 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T15:11:27.460 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T15:11:27.462 DEBUG:teuthology.orchestra.run.trial167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T15:11:27.484 DEBUG:teuthology.orchestra.run.trial174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T15:11:27.516 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-25T15:11:27.516 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-25T15:11:27.516 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221', 'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '70221', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'mon_bind_msgr2': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'owner': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 6877, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'targets': {'trial078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFpIk+MeVFhr81f4yfQAZxXNO8+2NCvlAcMSPbOOunhYPlovu1GwYKFEJMt4O9gE+OPcXPsud/AR4W64+eNmGOg=', 'trial155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8fOW3FaYxbHPkl9kSJBeKtFz9n9tZj1yMLYWl0f9+dzaTh5tQYoF6n/FAoit3LiPrJunQskIdK9TgA3CRUhUg=', 'trial167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMNa3zPTQyrEvWDzOdTRAszeBg6Db3+QhOuu0aogJVV2OPqCe64OxndJLzi9wR+tZ8M8Zmq4vTMClDYFxqLWlVg=', 'trial174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqYxFH2ThPebUfrkKQcIxdGtWUtyX51PKFnGpaWub2T126Rf49jfqKDGzDNnFxisUO6oyrnjy0iot9fjcpNymM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-25_14:09:18', 'tube': 'trial', 'user': 'jayaprakash', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-25T15:11:27.516 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T15:11:27.524 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T15:11:27.526 DEBUG:teuthology.orchestra.run.trial167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T15:11:27.547 DEBUG:teuthology.orchestra.run.trial174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T15:11:27.562 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T15:11:27.579 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T15:11:27.582 DEBUG:teuthology.orchestra.run.trial167:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T15:11:27.603 DEBUG:teuthology.orchestra.run.trial174:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T15:11:27.626 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:27.626 DEBUG:teuthology.orchestra.run.trial078:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T15:11:27.656 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T15:11:27.657 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_1 2026-02-25T15:11:27.713 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T15:11:27.714 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:27.714 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 906 Links: 1 2026-02-25T15:11:27.714 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:27.714 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:27.714 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-25 14:27:52.398612844 +0000 2026-02-25T15:11:27.714 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-25 14:25:32.459677231 +0000 2026-02-25T15:11:27.714 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-25 14:25:32.459677231 +0000 2026-02-25T15:11:27.714 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-25 14:25:32.459677231 +0000 2026-02-25T15:11:27.715 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T15:11:27.777 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-25T15:11:27.777 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-25T15:11:27.777 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000153477 s, 3.3 MB/s 2026-02-25T15:11:27.779 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T15:11:27.836 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_2 2026-02-25T15:11:27.892 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T15:11:27.893 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:27.893 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 936 Links: 1 2026-02-25T15:11:27.893 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:27.893 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:27.893 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-25 14:27:52.398612844 +0000 2026-02-25T15:11:27.893 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-25 14:25:32.703667785 +0000 2026-02-25T15:11:27.893 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-25 14:25:32.703667785 +0000 2026-02-25T15:11:27.893 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-25 14:25:32.703667785 +0000 2026-02-25T15:11:27.894 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T15:11:27.955 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-25T15:11:27.955 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-25T15:11:27.956 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000135353 s, 3.8 MB/s 2026-02-25T15:11:27.957 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T15:11:28.014 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_3 2026-02-25T15:11:28.070 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T15:11:28.070 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:28.070 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 966 Links: 1 2026-02-25T15:11:28.071 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:28.071 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:28.071 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-25 14:27:52.399612843 +0000 2026-02-25T15:11:28.071 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-25 14:25:32.949658258 +0000 2026-02-25T15:11:28.071 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-25 14:25:32.949658258 +0000 2026-02-25T15:11:28.071 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-25 14:25:32.949658258 +0000 2026-02-25T15:11:28.071 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T15:11:28.132 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-25T15:11:28.132 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-25T15:11:28.132 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000153678 s, 3.3 MB/s 2026-02-25T15:11:28.133 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T15:11:28.190 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_4 2026-02-25T15:11:28.246 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T15:11:28.246 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:28.246 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 991 Links: 1 2026-02-25T15:11:28.247 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:28.247 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:28.247 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-25 14:27:52.399612843 +0000 2026-02-25T15:11:28.247 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-25 14:25:33.208648220 +0000 2026-02-25T15:11:28.247 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-25 14:25:33.208648220 +0000 2026-02-25T15:11:28.247 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-25 14:25:33.208648220 +0000 2026-02-25T15:11:28.247 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T15:11:28.309 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-25T15:11:28.309 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-25T15:11:28.309 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000140723 s, 3.6 MB/s 2026-02-25T15:11:28.310 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T15:11:28.366 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:28.366 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:28.366 DEBUG:teuthology.orchestra.run.trial155:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T15:11:28.383 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T15:11:28.383 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_1 2026-02-25T15:11:28.438 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T15:11:28.439 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:28.439 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 915 Links: 1 2026-02-25T15:11:28.439 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:28.439 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:28.439 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-25 14:27:54.751476264 +0000 2026-02-25T15:11:28.439 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-25 14:25:35.598990903 +0000 2026-02-25T15:11:28.439 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-25 14:25:35.598990903 +0000 2026-02-25T15:11:28.439 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-25 14:25:35.598990903 +0000 2026-02-25T15:11:28.439 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T15:11:28.500 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-25T15:11:28.500 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-25T15:11:28.500 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000158016 s, 3.2 MB/s 2026-02-25T15:11:28.501 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T15:11:28.557 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_2 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 945 Links: 1 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-25 14:27:54.751476264 +0000 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-25 14:25:35.835981831 +0000 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-25 14:25:35.835981831 +0000 2026-02-25T15:11:28.613 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-25 14:25:35.835981831 +0000 2026-02-25T15:11:28.613 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T15:11:28.676 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-25T15:11:28.676 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-25T15:11:28.676 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000148318 s, 3.5 MB/s 2026-02-25T15:11:28.678 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T15:11:28.735 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_3 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 974 Links: 1 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-25 14:27:54.752476248 +0000 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-25 14:25:36.088972147 +0000 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-25 14:25:36.088972147 +0000 2026-02-25T15:11:28.791 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-25 14:25:36.088972147 +0000 2026-02-25T15:11:28.792 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T15:11:28.852 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-25T15:11:28.853 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-25T15:11:28.853 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.00014938 s, 3.4 MB/s 2026-02-25T15:11:28.854 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T15:11:28.911 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_4 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 999 Links: 1 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-25 14:27:54.752476248 +0000 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-25 14:25:36.339962540 +0000 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-25 14:25:36.339962540 +0000 2026-02-25T15:11:28.968 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-25 14:25:36.339962540 +0000 2026-02-25T15:11:28.969 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T15:11:29.030 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-25T15:11:29.030 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-25T15:11:29.030 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000149209 s, 3.4 MB/s 2026-02-25T15:11:29.031 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T15:11:29.088 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:29.088 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:29.088 DEBUG:teuthology.orchestra.run.trial167:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T15:11:29.106 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T15:11:29.106 DEBUG:teuthology.orchestra.run.trial167:> stat /dev/vg_nvme/lv_1 2026-02-25T15:11:29.162 INFO:teuthology.orchestra.run.trial167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T15:11:29.162 INFO:teuthology.orchestra.run.trial167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:29.162 INFO:teuthology.orchestra.run.trial167.stdout:Device: 6h/6d Inode: 909 Links: 1 2026-02-25T15:11:29.162 INFO:teuthology.orchestra.run.trial167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:29.163 INFO:teuthology.orchestra.run.trial167.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:29.163 INFO:teuthology.orchestra.run.trial167.stdout:Access: 2026-02-25 14:27:41.881500707 +0000 2026-02-25T15:11:29.163 INFO:teuthology.orchestra.run.trial167.stdout:Modify: 2026-02-25 14:25:32.451614917 +0000 2026-02-25T15:11:29.163 INFO:teuthology.orchestra.run.trial167.stdout:Change: 2026-02-25 14:25:32.451614917 +0000 2026-02-25T15:11:29.163 INFO:teuthology.orchestra.run.trial167.stdout: Birth: 2026-02-25 14:25:32.451614917 +0000 2026-02-25T15:11:29.163 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T15:11:29.225 INFO:teuthology.orchestra.run.trial167.stderr:1+0 records in 2026-02-25T15:11:29.225 INFO:teuthology.orchestra.run.trial167.stderr:1+0 records out 2026-02-25T15:11:29.225 INFO:teuthology.orchestra.run.trial167.stderr:512 bytes copied, 0.000146272 s, 3.5 MB/s 2026-02-25T15:11:29.226 DEBUG:teuthology.orchestra.run.trial167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T15:11:29.284 DEBUG:teuthology.orchestra.run.trial167:> stat /dev/vg_nvme/lv_2 2026-02-25T15:11:29.339 INFO:teuthology.orchestra.run.trial167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T15:11:29.340 INFO:teuthology.orchestra.run.trial167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:29.340 INFO:teuthology.orchestra.run.trial167.stdout:Device: 6h/6d Inode: 938 Links: 1 2026-02-25T15:11:29.340 INFO:teuthology.orchestra.run.trial167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:29.340 INFO:teuthology.orchestra.run.trial167.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:29.340 INFO:teuthology.orchestra.run.trial167.stdout:Access: 2026-02-25 14:27:41.882500645 +0000 2026-02-25T15:11:29.340 INFO:teuthology.orchestra.run.trial167.stdout:Modify: 2026-02-25 14:25:32.694624985 +0000 2026-02-25T15:11:29.340 INFO:teuthology.orchestra.run.trial167.stdout:Change: 2026-02-25 14:25:32.694624985 +0000 2026-02-25T15:11:29.340 INFO:teuthology.orchestra.run.trial167.stdout: Birth: 2026-02-25 14:25:32.694624985 +0000 2026-02-25T15:11:29.341 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T15:11:29.401 INFO:teuthology.orchestra.run.trial167.stderr:1+0 records in 2026-02-25T15:11:29.401 INFO:teuthology.orchestra.run.trial167.stderr:1+0 records out 2026-02-25T15:11:29.401 INFO:teuthology.orchestra.run.trial167.stderr:512 bytes copied, 0.000151381 s, 3.4 MB/s 2026-02-25T15:11:29.403 DEBUG:teuthology.orchestra.run.trial167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T15:11:29.459 DEBUG:teuthology.orchestra.run.trial167:> stat /dev/vg_nvme/lv_3 2026-02-25T15:11:29.516 INFO:teuthology.orchestra.run.trial167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T15:11:29.516 INFO:teuthology.orchestra.run.trial167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:29.517 INFO:teuthology.orchestra.run.trial167.stdout:Device: 6h/6d Inode: 964 Links: 1 2026-02-25T15:11:29.517 INFO:teuthology.orchestra.run.trial167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:29.517 INFO:teuthology.orchestra.run.trial167.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:29.517 INFO:teuthology.orchestra.run.trial167.stdout:Access: 2026-02-25 14:27:41.882500645 +0000 2026-02-25T15:11:29.517 INFO:teuthology.orchestra.run.trial167.stdout:Modify: 2026-02-25 14:25:32.938635095 +0000 2026-02-25T15:11:29.517 INFO:teuthology.orchestra.run.trial167.stdout:Change: 2026-02-25 14:25:32.938635095 +0000 2026-02-25T15:11:29.517 INFO:teuthology.orchestra.run.trial167.stdout: Birth: 2026-02-25 14:25:32.938635095 +0000 2026-02-25T15:11:29.517 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T15:11:29.578 INFO:teuthology.orchestra.run.trial167.stderr:1+0 records in 2026-02-25T15:11:29.579 INFO:teuthology.orchestra.run.trial167.stderr:1+0 records out 2026-02-25T15:11:29.579 INFO:teuthology.orchestra.run.trial167.stderr:512 bytes copied, 0.000146572 s, 3.5 MB/s 2026-02-25T15:11:29.580 DEBUG:teuthology.orchestra.run.trial167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T15:11:29.636 DEBUG:teuthology.orchestra.run.trial167:> stat /dev/vg_nvme/lv_4 2026-02-25T15:11:29.693 INFO:teuthology.orchestra.run.trial167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T15:11:29.693 INFO:teuthology.orchestra.run.trial167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:29.693 INFO:teuthology.orchestra.run.trial167.stdout:Device: 6h/6d Inode: 992 Links: 1 2026-02-25T15:11:29.693 INFO:teuthology.orchestra.run.trial167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:29.693 INFO:teuthology.orchestra.run.trial167.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:29.693 INFO:teuthology.orchestra.run.trial167.stdout:Access: 2026-02-25 14:27:41.882500645 +0000 2026-02-25T15:11:29.694 INFO:teuthology.orchestra.run.trial167.stdout:Modify: 2026-02-25 14:25:33.173644831 +0000 2026-02-25T15:11:29.694 INFO:teuthology.orchestra.run.trial167.stdout:Change: 2026-02-25 14:25:33.173644831 +0000 2026-02-25T15:11:29.694 INFO:teuthology.orchestra.run.trial167.stdout: Birth: 2026-02-25 14:25:33.173644831 +0000 2026-02-25T15:11:29.694 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T15:11:29.756 INFO:teuthology.orchestra.run.trial167.stderr:1+0 records in 2026-02-25T15:11:29.756 INFO:teuthology.orchestra.run.trial167.stderr:1+0 records out 2026-02-25T15:11:29.756 INFO:teuthology.orchestra.run.trial167.stderr:512 bytes copied, 0.000143807 s, 3.6 MB/s 2026-02-25T15:11:29.757 DEBUG:teuthology.orchestra.run.trial167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T15:11:29.814 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:29.815 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:29.815 DEBUG:teuthology.orchestra.run.trial174:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T15:11:29.833 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T15:11:29.833 DEBUG:teuthology.orchestra.run.trial174:> stat /dev/vg_nvme/lv_1 2026-02-25T15:11:29.889 INFO:teuthology.orchestra.run.trial174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T15:11:29.889 INFO:teuthology.orchestra.run.trial174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:29.890 INFO:teuthology.orchestra.run.trial174.stdout:Device: 6h/6d Inode: 909 Links: 1 2026-02-25T15:11:29.890 INFO:teuthology.orchestra.run.trial174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:29.890 INFO:teuthology.orchestra.run.trial174.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:29.890 INFO:teuthology.orchestra.run.trial174.stdout:Access: 2026-02-25 14:28:05.475646106 +0000 2026-02-25T15:11:29.890 INFO:teuthology.orchestra.run.trial174.stdout:Modify: 2026-02-25 14:25:32.679175672 +0000 2026-02-25T15:11:29.890 INFO:teuthology.orchestra.run.trial174.stdout:Change: 2026-02-25 14:25:32.679175672 +0000 2026-02-25T15:11:29.890 INFO:teuthology.orchestra.run.trial174.stdout: Birth: 2026-02-25 14:25:32.679175672 +0000 2026-02-25T15:11:29.890 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T15:11:29.952 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records in 2026-02-25T15:11:29.952 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records out 2026-02-25T15:11:29.953 INFO:teuthology.orchestra.run.trial174.stderr:512 bytes copied, 0.000163584 s, 3.1 MB/s 2026-02-25T15:11:29.954 DEBUG:teuthology.orchestra.run.trial174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T15:11:30.011 DEBUG:teuthology.orchestra.run.trial174:> stat /dev/vg_nvme/lv_2 2026-02-25T15:11:30.068 INFO:teuthology.orchestra.run.trial174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T15:11:30.068 INFO:teuthology.orchestra.run.trial174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:30.068 INFO:teuthology.orchestra.run.trial174.stdout:Device: 6h/6d Inode: 935 Links: 1 2026-02-25T15:11:30.068 INFO:teuthology.orchestra.run.trial174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:30.068 INFO:teuthology.orchestra.run.trial174.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:30.068 INFO:teuthology.orchestra.run.trial174.stdout:Access: 2026-02-25 14:28:05.475646106 +0000 2026-02-25T15:11:30.068 INFO:teuthology.orchestra.run.trial174.stdout:Modify: 2026-02-25 14:25:32.933166820 +0000 2026-02-25T15:11:30.069 INFO:teuthology.orchestra.run.trial174.stdout:Change: 2026-02-25 14:25:32.933166820 +0000 2026-02-25T15:11:30.069 INFO:teuthology.orchestra.run.trial174.stdout: Birth: 2026-02-25 14:25:32.933166820 +0000 2026-02-25T15:11:30.069 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T15:11:30.131 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records in 2026-02-25T15:11:30.131 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records out 2026-02-25T15:11:30.131 INFO:teuthology.orchestra.run.trial174.stderr:512 bytes copied, 0.000144568 s, 3.5 MB/s 2026-02-25T15:11:30.132 DEBUG:teuthology.orchestra.run.trial174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T15:11:30.190 DEBUG:teuthology.orchestra.run.trial174:> stat /dev/vg_nvme/lv_3 2026-02-25T15:11:30.247 INFO:teuthology.orchestra.run.trial174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T15:11:30.247 INFO:teuthology.orchestra.run.trial174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:30.247 INFO:teuthology.orchestra.run.trial174.stdout:Device: 6h/6d Inode: 966 Links: 1 2026-02-25T15:11:30.247 INFO:teuthology.orchestra.run.trial174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:30.247 INFO:teuthology.orchestra.run.trial174.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:30.248 INFO:teuthology.orchestra.run.trial174.stdout:Access: 2026-02-25 14:28:05.475646106 +0000 2026-02-25T15:11:30.248 INFO:teuthology.orchestra.run.trial174.stdout:Modify: 2026-02-25 14:25:33.182158143 +0000 2026-02-25T15:11:30.248 INFO:teuthology.orchestra.run.trial174.stdout:Change: 2026-02-25 14:25:33.182158143 +0000 2026-02-25T15:11:30.248 INFO:teuthology.orchestra.run.trial174.stdout: Birth: 2026-02-25 14:25:33.182158143 +0000 2026-02-25T15:11:30.248 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T15:11:30.310 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records in 2026-02-25T15:11:30.310 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records out 2026-02-25T15:11:30.310 INFO:teuthology.orchestra.run.trial174.stderr:512 bytes copied, 0.000144258 s, 3.5 MB/s 2026-02-25T15:11:30.312 DEBUG:teuthology.orchestra.run.trial174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T15:11:30.370 DEBUG:teuthology.orchestra.run.trial174:> stat /dev/vg_nvme/lv_4 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout:Device: 6h/6d Inode: 995 Links: 1 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout:Access: 2026-02-25 14:28:05.476646084 +0000 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout:Modify: 2026-02-25 14:25:33.441149118 +0000 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout:Change: 2026-02-25 14:25:33.441149118 +0000 2026-02-25T15:11:30.427 INFO:teuthology.orchestra.run.trial174.stdout: Birth: 2026-02-25 14:25:33.441149118 +0000 2026-02-25T15:11:30.428 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T15:11:30.490 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records in 2026-02-25T15:11:30.491 INFO:teuthology.orchestra.run.trial174.stderr:1+0 records out 2026-02-25T15:11:30.491 INFO:teuthology.orchestra.run.trial174.stderr:512 bytes copied, 0.00013485 s, 3.8 MB/s 2026-02-25T15:11:30.492 DEBUG:teuthology.orchestra.run.trial174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T15:11:30.551 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:30.551 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial155.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial167.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial174.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-25T15:11:30.551 INFO:tasks.ceph:Generating config... 2026-02-25T15:11:30.554 INFO:tasks.ceph:[client] debug monc = 20 2026-02-25T15:11:30.554 INFO:tasks.ceph:[client] debug ms = 1 2026-02-25T15:11:30.554 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-25T15:11:30.554 INFO:tasks.ceph:[client] debug rados = 20 2026-02-25T15:11:30.554 INFO:tasks.ceph:[client] rados replica read policy = balance 2026-02-25T15:11:30.554 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-25T15:11:30.554 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-25T15:11:30.554 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-25T15:11:30.554 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-25T15:11:30.554 INFO:tasks.ceph:[global] ms type = async 2026-02-25T15:11:30.555 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-25T15:11:30.555 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-25T15:11:30.555 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-25T15:11:30.556 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-25T15:11:30.556 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-25T15:11:30.556 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] bluestore allocator = btree 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-25T15:11:30.556 INFO:tasks.ceph:[osd] crush location = root=default host=host-$id 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-25T15:11:30.557 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-25T15:11:30.558 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-25T15:11:30.558 INFO:tasks.ceph:Setting up mon.a... 2026-02-25T15:11:30.559 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-25T15:11:30.595 INFO:teuthology.orchestra.run.trial078.stdout:creating /etc/ceph/ceph.keyring 2026-02-25T15:11:30.597 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-25T15:11:30.674 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T15:11:30.739 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.78:6789]'), ('mon.b', '[v1:10.20.193.155:6789]'), ('mon.c', '[v1:10.20.193.167:6789]')] 2026-02-25T15:11:30.739 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.78:6789],[v1:10.20.193.155:6789],[v1:10.20.193.167:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-25T15:11:30.741 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:30.741 DEBUG:teuthology.orchestra.run.trial078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T15:11:30.796 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.78:6789]' --addv b '[v1:10.20.193.155:6789]' --addv c '[v1:10.20.193.167:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:30.870 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: generated fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:setting min_mon_release = tentacle 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:epoch 0 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:min_mon_release 20 (tentacle) 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:election_strategy: 3 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:11:30.871 INFO:teuthology.orchestra.run.trial078.stdout:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:11:30.872 INFO:teuthology.orchestra.run.trial078.stdout:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:11:30.872 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-25T15:11:30.873 DEBUG:teuthology.orchestra.run.trial078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T15:11:30.929 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 609bd52f-adc3-49d3-9ae3-11e4ae0954b8... 2026-02-25T15:11:30.930 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T15:11:30.971 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T15:11:30.973 DEBUG:teuthology.orchestra.run.trial167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T15:11:30.976 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T15:11:31.008 INFO:teuthology.orchestra.run.trial078.stdout:[global] 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: chdir = "" 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: auth supported = cephx 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: filestore xattr use omap = true 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: mon clock drift allowed = 1.000 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: osd crush chooseleaf type = 0 2026-02-25T15:11:31.009 INFO:teuthology.orchestra.run.trial078.stdout: auth debug = true 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: ms die on old message = true 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: ms die on bug = true 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: mon pg warn max object skew = 0 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: osd pool default size = 2 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.010 INFO:teuthology.orchestra.run.trial078.stdout: mon osd allow primary affinity = true 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon osd allow pg remap = true 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on legacy crush tunables = false 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on crush straw calc version zero = false 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on no sortbitwise = false 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on osd down out interval zero = false 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on too few osds = false 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: mon_allow_pool_size_one = true 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T15:11:31.011 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: osd default data pool replay window = 5 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: mon allow pool delete = true 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: mon cluster log file level = debug 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: debug asserts on shutdown = true 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: mon health detail to clog = false 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: mon host = "[v1:10.20.193.78:6789],[v1:10.20.193.155:6789],[v1:10.20.193.167:6789]" 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: mon client directed command retry = 5 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: mon election default strategy = 3 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: ms bind msgr2 = False 2026-02-25T15:11:31.012 INFO:teuthology.orchestra.run.trial078.stdout: ms inject socket failures = 5000 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: ms type = async 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: osd heartbeat grace = 160 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: osd op thread timeout = 150 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: fsid = 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout:[osd] 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: osd journal size = 100 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: osd scrub load threshold = 5.0 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: osd scrub max interval = 600 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: osd mclock profile = high_recovery_ops 2026-02-25T15:11:31.013 INFO:teuthology.orchestra.run.trial078.stdout: osd mclock skip benchmark = True 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd recover clone overlap = true 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd recovery max chunk = 1048576 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd debug shutdown = true 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd debug op order = true 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify stray on activate = true 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd debug trim objects = true 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd open classes on start = true 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd debug pg log writeout = true 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.014 INFO:teuthology.orchestra.run.trial078.stdout: osd deep scrub update digest min age = 30 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: osd map max advance = 10 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: journal zero on create = true 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: filestore ondisk finisher threads = 3 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: filestore apply finisher threads = 3 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: bdev debug aio = true 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: osd debug misdirected ops = true 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: bdev async discard = True 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: bdev enable discard = True 2026-02-25T15:11:31.015 INFO:teuthology.orchestra.run.trial078.stdout: bluestore allocator = btree 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: bluestore block size = 96636764160 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: bluestore fsck on mount = True 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: bluestore onode segment size = 0 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: bluestore write v2 random = True 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: bluestore zero block detection = True 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: crush location = root=default host=host-$id 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: debug bluefs = 1 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: debug bluestore = 1 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: debug monc = 20 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: debug osd = 20 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: debug rocksdb = 10 2026-02-25T15:11:31.016 INFO:teuthology.orchestra.run.trial078.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: mon osd full ratio = 0.9 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: mon osd nearfull ratio = 0.8 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd class default list = * 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd class load list = * 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd client watch timeout = 240 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify cached snaps = True 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify missing on start = True 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd failsafe full ratio = 0.95 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd fast shutdown = False 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd mclock override recovery settings = True 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd objectstore = bluestore 2026-02-25T15:11:31.017 INFO:teuthology.orchestra.run.trial078.stdout: osd op queue = debug_random 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: osd op queue cut off = debug_random 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: osd shutdown pgref assert = True 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout:[mgr] 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: debug mgr = 20 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: debug mon = 20 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: debug auth = 20 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min pgs per osd = 4 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min bytes per osd = 10 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: mgr/telemetry/nag = false 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.018 INFO:teuthology.orchestra.run.trial078.stdout:[mon] 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: debug mon = 20 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: debug paxos = 20 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: debug auth = 20 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: mon data avail warn = 5 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: mon mgr mkfs grace = 240 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min pgs per osd = 4 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: mon osd reporter subtree level = osd 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: mon osd prime pg temp = true 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min bytes per osd = 10 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T15:11:31.019 INFO:teuthology.orchestra.run.trial078.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: # 1m isn't quite enough 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: mon_down_mkfs_grace = 2m 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_filestore_osds = false 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: mon min osdmap epochs = 50 2026-02-25T15:11:31.020 INFO:teuthology.orchestra.run.trial078.stdout: mon osd crush smoke test = False 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: mon osdmap full prune interval = 2 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: mon osdmap full prune min = 15 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: mon osdmap full prune txsize = 2 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: mon scrub interval = 300 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on pool no app = False 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: paxos service trim min = 10 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout:[client] 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: rgw cache enabled = true 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: rgw enable ops log = true 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: rgw enable usage log = true 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T15:11:31.021 INFO:teuthology.orchestra.run.trial078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T15:11:31.022 INFO:teuthology.orchestra.run.trial078.stdout: debug monc = 20 2026-02-25T15:11:31.022 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-25T15:11:31.022 INFO:teuthology.orchestra.run.trial078.stdout: debug objecter = 20 2026-02-25T15:11:31.022 INFO:teuthology.orchestra.run.trial078.stdout: debug rados = 20 2026-02-25T15:11:31.022 INFO:teuthology.orchestra.run.trial078.stdout: rados replica read policy = balance 2026-02-25T15:11:31.022 INFO:teuthology.orchestra.run.trial078.stdout:[mon.a] 2026-02-25T15:11:31.022 INFO:teuthology.orchestra.run.trial078.stdout:[mon.b] 2026-02-25T15:11:31.022 INFO:teuthology.orchestra.run.trial078.stdout:[mon.c] 2026-02-25T15:11:31.023 INFO:teuthology.orchestra.run.trial174.stdout:[global] 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: chdir = "" 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: auth supported = cephx 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: filestore xattr use omap = true 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: mon clock drift allowed = 1.000 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: osd crush chooseleaf type = 0 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: auth debug = true 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.024 INFO:teuthology.orchestra.run.trial174.stdout: ms die on old message = true 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: ms die on bug = true 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: mon pg warn max object skew = 0 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: osd pool default size = 2 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: mon osd allow primary affinity = true 2026-02-25T15:11:31.025 INFO:teuthology.orchestra.run.trial174.stdout: mon osd allow pg remap = true 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on legacy crush tunables = false 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on crush straw calc version zero = false 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on no sortbitwise = false 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on osd down out interval zero = false 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on too few osds = false 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: mon_allow_pool_size_one = true 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.026 INFO:teuthology.orchestra.run.trial174.stdout: osd default data pool replay window = 5 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: mon allow pool delete = true 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: mon cluster log file level = debug 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: debug asserts on shutdown = true 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: mon health detail to clog = false 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: mon host = "[v1:10.20.193.78:6789],[v1:10.20.193.155:6789],[v1:10.20.193.167:6789]" 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: mon client directed command retry = 5 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: mon election default strategy = 3 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: ms bind msgr2 = False 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: ms inject socket failures = 5000 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: ms type = async 2026-02-25T15:11:31.027 INFO:teuthology.orchestra.run.trial174.stdout: osd heartbeat grace = 160 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: osd op thread timeout = 150 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: fsid = 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout:[osd] 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: osd journal size = 100 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: osd scrub load threshold = 5.0 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: osd scrub max interval = 600 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: osd mclock profile = high_recovery_ops 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: osd mclock skip benchmark = True 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.028 INFO:teuthology.orchestra.run.trial174.stdout: osd recover clone overlap = true 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd recovery max chunk = 1048576 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd debug shutdown = true 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd debug op order = true 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd debug verify stray on activate = true 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd debug trim objects = true 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd open classes on start = true 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd debug pg log writeout = true 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd deep scrub update digest min age = 30 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.029 INFO:teuthology.orchestra.run.trial174.stdout: osd map max advance = 10 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: journal zero on create = true 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: filestore ondisk finisher threads = 3 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: filestore apply finisher threads = 3 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: bdev debug aio = true 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: osd debug misdirected ops = true 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: bdev async discard = True 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: bdev enable discard = True 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: bluestore allocator = btree 2026-02-25T15:11:31.030 INFO:teuthology.orchestra.run.trial174.stdout: bluestore block size = 96636764160 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: bluestore fsck on mount = True 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: bluestore onode segment size = 0 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: bluestore write v2 random = True 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: bluestore zero block detection = True 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: crush location = root=default host=host-$id 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: debug bluefs = 1 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: debug bluestore = 1 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: debug monc = 20 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: debug ms = 1 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: debug osd = 20 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: debug rocksdb = 10 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T15:11:31.031 INFO:teuthology.orchestra.run.trial174.stdout: mon osd full ratio = 0.9 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: mon osd nearfull ratio = 0.8 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd class default list = * 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd class load list = * 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd client watch timeout = 240 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd debug verify cached snaps = True 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd debug verify missing on start = True 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd failsafe full ratio = 0.95 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd fast shutdown = False 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd mclock override recovery settings = True 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd objectstore = bluestore 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd op queue = debug_random 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd op queue cut off = debug_random 2026-02-25T15:11:31.032 INFO:teuthology.orchestra.run.trial174.stdout: osd shutdown pgref assert = True 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout:[mgr] 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: debug ms = 1 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: debug mgr = 20 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: debug mon = 20 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: debug auth = 20 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: mon reweight min pgs per osd = 4 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: mon reweight min bytes per osd = 10 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: mgr/telemetry/nag = false 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout:[mon] 2026-02-25T15:11:31.033 INFO:teuthology.orchestra.run.trial174.stdout: debug ms = 1 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: debug mon = 20 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: debug paxos = 20 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: debug auth = 20 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: mon data avail warn = 5 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: mon mgr mkfs grace = 240 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: mon reweight min pgs per osd = 4 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: mon osd reporter subtree level = osd 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: mon osd prime pg temp = true 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: mon reweight min bytes per osd = 10 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T15:11:31.034 INFO:teuthology.orchestra.run.trial174.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: # 1m isn't quite enough 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: mon_down_mkfs_grace = 2m 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: mon_warn_on_filestore_osds = false 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: mon min osdmap epochs = 50 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: mon osd crush smoke test = False 2026-02-25T15:11:31.035 INFO:teuthology.orchestra.run.trial174.stdout: mon osdmap full prune interval = 2 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: mon osdmap full prune min = 15 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: mon osdmap full prune txsize = 2 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: mon scrub interval = 300 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: mon warn on pool no app = False 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: paxos service trim min = 10 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout:[client] 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: rgw cache enabled = true 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: rgw enable ops log = true 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: rgw enable usage log = true 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T15:11:31.036 INFO:teuthology.orchestra.run.trial174.stdout: debug monc = 20 2026-02-25T15:11:31.037 INFO:teuthology.orchestra.run.trial174.stdout: debug ms = 1 2026-02-25T15:11:31.037 INFO:teuthology.orchestra.run.trial174.stdout: debug objecter = 20 2026-02-25T15:11:31.037 INFO:teuthology.orchestra.run.trial174.stdout: debug rados = 20 2026-02-25T15:11:31.037 INFO:teuthology.orchestra.run.trial174.stdout: rados replica read policy = balance 2026-02-25T15:11:31.037 INFO:teuthology.orchestra.run.trial174.stdout:[mon.a] 2026-02-25T15:11:31.037 INFO:teuthology.orchestra.run.trial174.stdout:[mon.b] 2026-02-25T15:11:31.037 INFO:teuthology.orchestra.run.trial174.stdout:[mon.c] 2026-02-25T15:11:31.039 INFO:teuthology.orchestra.run.trial155.stdout:[global] 2026-02-25T15:11:31.039 INFO:teuthology.orchestra.run.trial155.stdout: chdir = "" 2026-02-25T15:11:31.039 INFO:teuthology.orchestra.run.trial155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T15:11:31.039 INFO:teuthology.orchestra.run.trial155.stdout: auth supported = cephx 2026-02-25T15:11:31.039 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.039 INFO:teuthology.orchestra.run.trial155.stdout: filestore xattr use omap = true 2026-02-25T15:11:31.039 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: mon clock drift allowed = 1.000 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: osd crush chooseleaf type = 0 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: auth debug = true 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: ms die on old message = true 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: ms die on bug = true 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: mon pg warn max object skew = 0 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.040 INFO:teuthology.orchestra.run.trial155.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: osd pool default size = 2 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon osd allow primary affinity = true 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon osd allow pg remap = true 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on legacy crush tunables = false 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on crush straw calc version zero = false 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on no sortbitwise = false 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on osd down out interval zero = false 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on too few osds = false 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T15:11:31.041 INFO:teuthology.orchestra.run.trial155.stdout: mon_allow_pool_size_one = true 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: osd default data pool replay window = 5 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: mon allow pool delete = true 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: mon cluster log file level = debug 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: debug asserts on shutdown = true 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: mon health detail to clog = false 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: mon host = "[v1:10.20.193.78:6789],[v1:10.20.193.155:6789],[v1:10.20.193.167:6789]" 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: mon client directed command retry = 5 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: mon election default strategy = 3 2026-02-25T15:11:31.042 INFO:teuthology.orchestra.run.trial155.stdout: ms bind msgr2 = False 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: ms inject socket failures = 5000 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: ms type = async 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: osd heartbeat grace = 160 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: osd op thread timeout = 150 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: fsid = 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout:[osd] 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: osd journal size = 100 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: osd scrub load threshold = 5.0 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: osd scrub max interval = 600 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock profile = high_recovery_ops 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock skip benchmark = True 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.043 INFO:teuthology.orchestra.run.trial155.stdout: osd recover clone overlap = true 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd recovery max chunk = 1048576 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd debug shutdown = true 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd debug op order = true 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify stray on activate = true 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd debug trim objects = true 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd open classes on start = true 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd debug pg log writeout = true 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd deep scrub update digest min age = 30 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: osd map max advance = 10 2026-02-25T15:11:31.044 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: journal zero on create = true 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: filestore ondisk finisher threads = 3 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: filestore apply finisher threads = 3 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bdev debug aio = true 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: osd debug misdirected ops = true 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bdev async discard = True 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bdev enable discard = True 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bluestore allocator = btree 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bluestore block size = 96636764160 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bluestore fsck on mount = True 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bluestore onode segment size = 0 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bluestore write v2 random = True 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: bluestore zero block detection = True 2026-02-25T15:11:31.045 INFO:teuthology.orchestra.run.trial155.stdout: crush location = root=default host=host-$id 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: debug bluefs = 1 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: debug bluestore = 1 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: debug monc = 20 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: debug osd = 20 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: debug rocksdb = 10 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: mon osd full ratio = 0.9 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: mon osd nearfull ratio = 0.8 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: osd class default list = * 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: osd class load list = * 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: osd client watch timeout = 240 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify cached snaps = True 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify missing on start = True 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: osd failsafe full ratio = 0.95 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: osd fast shutdown = False 2026-02-25T15:11:31.046 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock override recovery settings = True 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: osd objectstore = bluestore 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: osd op queue = debug_random 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: osd op queue cut off = debug_random 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: osd shutdown pgref assert = True 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout:[mgr] 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: debug mgr = 20 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: debug mon = 20 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: debug auth = 20 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min pgs per osd = 4 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min bytes per osd = 10 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: mgr/telemetry/nag = false 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout:[mon] 2026-02-25T15:11:31.047 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: debug mon = 20 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: debug paxos = 20 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: debug auth = 20 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: mon data avail warn = 5 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: mon mgr mkfs grace = 240 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min pgs per osd = 4 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: mon osd reporter subtree level = osd 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: mon osd prime pg temp = true 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min bytes per osd = 10 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T15:11:31.048 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: # 1m isn't quite enough 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon_down_mkfs_grace = 2m 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_filestore_osds = false 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon min osdmap epochs = 50 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon osd crush smoke test = False 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon osdmap full prune interval = 2 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon osdmap full prune min = 15 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon osdmap full prune txsize = 2 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon scrub interval = 300 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on pool no app = False 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: paxos service trim min = 10 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout:[client] 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: rgw cache enabled = true 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: rgw enable ops log = true 2026-02-25T15:11:31.049 INFO:teuthology.orchestra.run.trial155.stdout: rgw enable usage log = true 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout: debug monc = 20 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout: debug objecter = 20 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout: debug rados = 20 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout: rados replica read policy = balance 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout:[mon.a] 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout:[mon.b] 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial155.stdout:[mon.c] 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial167.stdout:[global] 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial167.stdout: chdir = "" 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial167.stdout: auth supported = cephx 2026-02-25T15:11:31.050 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: filestore xattr use omap = true 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: mon clock drift allowed = 1.000 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: osd crush chooseleaf type = 0 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: auth debug = true 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: ms die on old message = true 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: ms die on bug = true 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: mon pg warn max object skew = 0 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: osd pool default size = 2 2026-02-25T15:11:31.051 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon osd allow primary affinity = true 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon osd allow pg remap = true 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon warn on legacy crush tunables = false 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon warn on crush straw calc version zero = false 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon warn on no sortbitwise = false 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon warn on osd down out interval zero = false 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon warn on too few osds = false 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon_allow_pool_size_one = true 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: osd default data pool replay window = 5 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon allow pool delete = true 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: mon cluster log file level = debug 2026-02-25T15:11:31.052 INFO:teuthology.orchestra.run.trial167.stdout: debug asserts on shutdown = true 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: mon health detail to clog = false 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: mon host = "[v1:10.20.193.78:6789],[v1:10.20.193.155:6789],[v1:10.20.193.167:6789]" 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: mon client directed command retry = 5 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: mon election default strategy = 3 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: ms bind msgr2 = False 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: ms inject socket failures = 5000 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: ms type = async 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: osd heartbeat grace = 160 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: osd op thread timeout = 150 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: fsid = 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout:[osd] 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: osd journal size = 100 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: osd scrub load threshold = 5.0 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: osd scrub max interval = 600 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: osd mclock profile = high_recovery_ops 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: osd mclock skip benchmark = True 2026-02-25T15:11:31.053 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd recover clone overlap = true 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd recovery max chunk = 1048576 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd debug shutdown = true 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd debug op order = true 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd debug verify stray on activate = true 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd debug trim objects = true 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd open classes on start = true 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd debug pg log writeout = true 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd deep scrub update digest min age = 30 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: osd map max advance = 10 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: journal zero on create = true 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: filestore ondisk finisher threads = 3 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: filestore apply finisher threads = 3 2026-02-25T15:11:31.054 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bdev debug aio = true 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: osd debug misdirected ops = true 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bdev async discard = True 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bdev enable discard = True 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bluestore allocator = btree 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bluestore block size = 96636764160 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bluestore fsck on mount = True 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bluestore onode segment size = 0 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bluestore write v2 random = True 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: bluestore zero block detection = True 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: crush location = root=default host=host-$id 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: debug bluefs = 1 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: debug bluestore = 1 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: debug monc = 20 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: debug ms = 1 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: debug osd = 20 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: debug rocksdb = 10 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: mon osd full ratio = 0.9 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: mon osd nearfull ratio = 0.8 2026-02-25T15:11:31.055 INFO:teuthology.orchestra.run.trial167.stdout: osd class default list = * 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd class load list = * 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd client watch timeout = 240 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd debug verify cached snaps = True 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd debug verify missing on start = True 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd failsafe full ratio = 0.95 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd fast shutdown = False 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd mclock override recovery settings = True 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd objectstore = bluestore 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd op queue = debug_random 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd op queue cut off = debug_random 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: osd shutdown pgref assert = True 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout:[mgr] 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: debug ms = 1 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: debug mgr = 20 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: debug mon = 20 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: debug auth = 20 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: mon reweight min pgs per osd = 4 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: mon reweight min bytes per osd = 10 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: mgr/telemetry/nag = false 2026-02-25T15:11:31.056 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout:[mon] 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: debug ms = 1 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: debug mon = 20 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: debug paxos = 20 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: debug auth = 20 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: mon data avail warn = 5 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: mon mgr mkfs grace = 240 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: mon reweight min pgs per osd = 4 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: mon osd reporter subtree level = osd 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: mon osd prime pg temp = true 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: mon reweight min bytes per osd = 10 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T15:11:31.057 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: # 1m isn't quite enough 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon_down_mkfs_grace = 2m 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon_warn_on_filestore_osds = false 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon min osdmap epochs = 50 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon osd crush smoke test = False 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon osdmap full prune interval = 2 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon osdmap full prune min = 15 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon osdmap full prune txsize = 2 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon scrub interval = 300 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: mon warn on pool no app = False 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: paxos service trim min = 10 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout:[client] 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: rgw cache enabled = true 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: rgw enable ops log = true 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: rgw enable usage log = true 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: debug monc = 20 2026-02-25T15:11:31.058 INFO:teuthology.orchestra.run.trial167.stdout: debug ms = 1 2026-02-25T15:11:31.059 INFO:teuthology.orchestra.run.trial167.stdout: debug objecter = 20 2026-02-25T15:11:31.059 INFO:teuthology.orchestra.run.trial167.stdout: debug rados = 20 2026-02-25T15:11:31.059 INFO:teuthology.orchestra.run.trial167.stdout: rados replica read policy = balance 2026-02-25T15:11:31.059 INFO:teuthology.orchestra.run.trial167.stdout:[mon.a] 2026-02-25T15:11:31.059 INFO:teuthology.orchestra.run.trial167.stdout:[mon.b] 2026-02-25T15:11:31.059 INFO:teuthology.orchestra.run.trial167.stdout:[mon.c] 2026-02-25T15:11:31.060 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-25T15:11:31.060 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-25T15:11:31.121 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-25T15:11:31.121 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:31.121 DEBUG:teuthology.orchestra.run.trial078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-25T15:11:31.178 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:31.178 DEBUG:teuthology.orchestra.run.trial078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-25T15:11:31.234 INFO:tasks.ceph:Sending monmap to node ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:11:31.234 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:31.234 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T15:11:31.235 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T15:11:31.307 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:31.307 DEBUG:teuthology.orchestra.run.trial078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:31.364 INFO:tasks.ceph:Sending monmap to node ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:11:31.364 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:31.364 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T15:11:31.365 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T15:11:31.399 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:31.399 DEBUG:teuthology.orchestra.run.trial155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:31.454 INFO:tasks.ceph:Sending monmap to node ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:11:31.455 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:31.455 DEBUG:teuthology.orchestra.run.trial167:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T15:11:31.455 DEBUG:teuthology.orchestra.run.trial167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T15:11:31.489 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:31.490 DEBUG:teuthology.orchestra.run.trial167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:31.546 INFO:tasks.ceph:Sending monmap to node ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:11:31.546 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:31.546 DEBUG:teuthology.orchestra.run.trial174:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T15:11:31.546 DEBUG:teuthology.orchestra.run.trial174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T15:11:31.581 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:31.582 DEBUG:teuthology.orchestra.run.trial174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:31.638 INFO:tasks.ceph:Setting up mon nodes... 2026-02-25T15:11:31.638 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-25T15:11:31.638 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-25T15:11:31.683 INFO:teuthology.orchestra.run.trial078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-25T15:11:31.685 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T15:11:31.728 INFO:teuthology.orchestra.run.trial174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T15:11:31.731 INFO:tasks.ceph:Setting up mds nodes... 2026-02-25T15:11:31.731 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-25T15:11:31.731 DEBUG:teuthology.orchestra.run.trial174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-25T15:11:31.767 INFO:teuthology.orchestra.run.trial174.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-25T15:11:31.778 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-25T15:11:31.779 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial155.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial167.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial174.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-25T15:11:31.779 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-25T15:11:31.804 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:31.804 INFO:tasks.ceph:role: osd.0 2026-02-25T15:11:31.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:11:31.805 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T15:11:31.870 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:31.870 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:31.870 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:31.870 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:31.870 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:31.870 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:31.870 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:31.870 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:31.871 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:31.871 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:32.443 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-25T15:11:32.445 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-25T15:11:32.445 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-25T15:11:32.513 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-25T15:11:32.580 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-25T15:11:32.644 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:32.645 INFO:tasks.ceph:role: osd.4 2026-02-25T15:11:32.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:11:32.645 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T15:11:32.710 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:32.710 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:32.710 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:32.710 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:32.710 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:32.711 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:32.711 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:32.711 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:32.711 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:32.711 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:33.281 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-25T15:11:33.283 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-25T15:11:33.284 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-25T15:11:33.352 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-25T15:11:33.418 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-25T15:11:33.482 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:33.482 INFO:tasks.ceph:role: osd.8 2026-02-25T15:11:33.482 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:11:33.482 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T15:11:33.547 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:33.547 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:33.547 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:33.547 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:33.548 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:33.548 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:33.548 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:33.548 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:33.548 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:33.548 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:34.106 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-25T15:11:34.108 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-25T15:11:34.108 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-25T15:11:34.175 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-25T15:11:34.243 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-25T15:11:34.306 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:34.307 INFO:tasks.ceph:role: osd.12 2026-02-25T15:11:34.307 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:11:34.307 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T15:11:34.373 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:34.373 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:34.373 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:34.373 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:34.373 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:34.373 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:34.373 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:34.374 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:34.374 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:34.374 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:34.930 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-25T15:11:34.932 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-25T15:11:34.933 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-25T15:11:35.010 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-25T15:11:35.077 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:35.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:35.154+0000 7fbcdaea1900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-25T15:11:35.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:35.155+0000 7fbcdaea1900 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-25T15:11:35.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:35.155+0000 7fbcdaea1900 -1 bdev(0x55f0c9a69800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:35.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:35.155+0000 7fbcdaea1900 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-25T15:11:35.626 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-25T15:11:35.691 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:35.768+0000 7f6cbf740900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-25T15:11:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:35.768+0000 7f6cbf740900 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-25T15:11:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:35.769+0000 7f6cbf740900 -1 bdev(0x558a6b24b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:35.769+0000 7f6cbf740900 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-25T15:11:36.257 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-25T15:11:36.322 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:36.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:36.398+0000 7f83c09d5900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-25T15:11:36.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:36.398+0000 7f83c09d5900 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-25T15:11:36.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:36.398+0000 7f83c09d5900 -1 bdev(0x557bc1bb1800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:36.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:36.398+0000 7f83c09d5900 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-25T15:11:36.864 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-25T15:11:36.930 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:37.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:37.007+0000 7f2cc058a900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-25T15:11:37.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:37.007+0000 7f2cc058a900 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-25T15:11:37.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:37.007+0000 7f2cc058a900 -1 bdev(0x5608a2a35800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:37.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:37.008+0000 7f2cc058a900 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-25T15:11:37.500 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-25T15:11:37.565 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-25T15:11:37.591 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:37.591 INFO:tasks.ceph:role: osd.1 2026-02-25T15:11:37.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:11:37.591 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T15:11:37.655 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:37.655 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:37.655 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:37.655 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:37.655 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:37.656 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:37.656 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:37.656 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:37.656 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:37.656 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:38.223 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-25T15:11:38.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-25T15:11:38.225 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-25T15:11:38.293 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-25T15:11:38.360 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-25T15:11:38.423 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:38.423 INFO:tasks.ceph:role: osd.5 2026-02-25T15:11:38.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:11:38.423 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T15:11:38.487 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:38.487 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:38.487 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:38.487 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:38.488 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:38.488 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:38.488 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:38.488 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:38.488 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:38.488 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:39.045 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-25T15:11:39.047 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-25T15:11:39.048 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-25T15:11:39.115 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-25T15:11:39.181 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-25T15:11:39.245 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:39.245 INFO:tasks.ceph:role: osd.9 2026-02-25T15:11:39.245 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:11:39.245 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T15:11:39.309 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:39.309 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:39.309 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:39.309 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:39.309 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:39.310 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:39.310 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:39.310 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:39.310 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:39.310 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:39.866 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-25T15:11:39.868 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-25T15:11:39.868 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-25T15:11:39.945 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-25T15:11:40.012 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-25T15:11:40.076 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:40.076 INFO:tasks.ceph:role: osd.13 2026-02-25T15:11:40.077 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:11:40.077 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T15:11:40.142 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:40.142 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:40.143 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:40.143 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:40.143 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:40.143 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:40.143 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:40.143 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:40.143 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:40.143 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:40.699 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-25T15:11:40.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-25T15:11:40.701 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-25T15:11:40.784 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-25T15:11:40.852 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:40.931 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:40.928+0000 7f336f0a1900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-25T15:11:40.931 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:40.928+0000 7f336f0a1900 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-25T15:11:40.932 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:40.928+0000 7f336f0a1900 -1 bdev(0x55745c395800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:40.932 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:40.929+0000 7f336f0a1900 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-25T15:11:41.406 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-25T15:11:41.472 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:41.551 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:41.548+0000 7fd25d388900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-25T15:11:41.551 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:41.548+0000 7fd25d388900 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-25T15:11:41.551 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:41.548+0000 7fd25d388900 -1 bdev(0x5574ebbdd800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:41.551 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:41.548+0000 7fd25d388900 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-25T15:11:42.051 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-25T15:11:42.116 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:42.195 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:42.192+0000 7f9cdabc7900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-25T15:11:42.195 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:42.192+0000 7f9cdabc7900 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-25T15:11:42.195 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:42.192+0000 7f9cdabc7900 -1 bdev(0x5647f5cef800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:42.196 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:42.192+0000 7f9cdabc7900 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-25T15:11:42.654 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-25T15:11:42.720 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:42.798 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:42.795+0000 7f9833e1b900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-25T15:11:42.799 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:42.796+0000 7f9833e1b900 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-25T15:11:42.799 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:42.796+0000 7f9833e1b900 -1 bdev(0x55f1c6ee1800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:42.799 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-25T15:11:42.796+0000 7f9833e1b900 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-25T15:11:43.303 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-25T15:11:43.368 DEBUG:teuthology.orchestra.run.trial167:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-25T15:11:43.395 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:43.395 INFO:tasks.ceph:role: osd.2 2026-02-25T15:11:43.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:11:43.395 DEBUG:teuthology.orchestra.run.trial167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T15:11:43.459 INFO:teuthology.orchestra.run.trial167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:43.460 INFO:teuthology.orchestra.run.trial167.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:43.460 INFO:teuthology.orchestra.run.trial167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:43.460 INFO:teuthology.orchestra.run.trial167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:43.460 INFO:teuthology.orchestra.run.trial167.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:43.460 INFO:teuthology.orchestra.run.trial167.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:43.460 INFO:teuthology.orchestra.run.trial167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:43.460 INFO:teuthology.orchestra.run.trial167.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:43.460 INFO:teuthology.orchestra.run.trial167.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:43.461 INFO:teuthology.orchestra.run.trial167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:44.029 INFO:teuthology.orchestra.run.trial167.stdout:Discarding blocks...Done. 2026-02-25T15:11:44.031 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial167.front.sepia.ceph.com -o noatime 2026-02-25T15:11:44.032 DEBUG:teuthology.orchestra.run.trial167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-25T15:11:44.103 DEBUG:teuthology.orchestra.run.trial167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-25T15:11:44.170 DEBUG:teuthology.orchestra.run.trial167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-25T15:11:44.234 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:44.234 INFO:tasks.ceph:role: osd.6 2026-02-25T15:11:44.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:11:44.235 DEBUG:teuthology.orchestra.run.trial167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T15:11:44.299 INFO:teuthology.orchestra.run.trial167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:44.299 INFO:teuthology.orchestra.run.trial167.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:44.299 INFO:teuthology.orchestra.run.trial167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:44.300 INFO:teuthology.orchestra.run.trial167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:44.300 INFO:teuthology.orchestra.run.trial167.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:44.300 INFO:teuthology.orchestra.run.trial167.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:44.300 INFO:teuthology.orchestra.run.trial167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:44.300 INFO:teuthology.orchestra.run.trial167.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:44.300 INFO:teuthology.orchestra.run.trial167.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:44.300 INFO:teuthology.orchestra.run.trial167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:44.861 INFO:teuthology.orchestra.run.trial167.stdout:Discarding blocks...Done. 2026-02-25T15:11:44.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial167.front.sepia.ceph.com -o noatime 2026-02-25T15:11:44.864 DEBUG:teuthology.orchestra.run.trial167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-25T15:11:44.931 DEBUG:teuthology.orchestra.run.trial167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-25T15:11:44.998 DEBUG:teuthology.orchestra.run.trial167:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-25T15:11:45.062 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:45.062 INFO:tasks.ceph:role: osd.10 2026-02-25T15:11:45.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:11:45.062 DEBUG:teuthology.orchestra.run.trial167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T15:11:45.126 INFO:teuthology.orchestra.run.trial167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:45.127 INFO:teuthology.orchestra.run.trial167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:45.688 INFO:teuthology.orchestra.run.trial167.stdout:Discarding blocks...Done. 2026-02-25T15:11:45.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial167.front.sepia.ceph.com -o noatime 2026-02-25T15:11:45.690 DEBUG:teuthology.orchestra.run.trial167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-25T15:11:45.757 DEBUG:teuthology.orchestra.run.trial167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-25T15:11:45.823 DEBUG:teuthology.orchestra.run.trial167:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-25T15:11:45.888 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:45.888 INFO:tasks.ceph:role: osd.14 2026-02-25T15:11:45.889 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:11:45.889 DEBUG:teuthology.orchestra.run.trial167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T15:11:45.953 INFO:teuthology.orchestra.run.trial167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:45.954 INFO:teuthology.orchestra.run.trial167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:46.516 INFO:teuthology.orchestra.run.trial167.stdout:Discarding blocks...Done. 2026-02-25T15:11:46.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial167.front.sepia.ceph.com -o noatime 2026-02-25T15:11:46.519 DEBUG:teuthology.orchestra.run.trial167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-25T15:11:46.595 DEBUG:teuthology.orchestra.run.trial167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-25T15:11:46.661 DEBUG:teuthology.orchestra.run.trial167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:46.740 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:46.738+0000 7f41590d9900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-25T15:11:46.741 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:46.739+0000 7f41590d9900 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-25T15:11:46.741 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:46.739+0000 7f41590d9900 -1 bdev(0x561d3a6cb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:46.741 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:46.739+0000 7f41590d9900 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-25T15:11:47.212 DEBUG:teuthology.orchestra.run.trial167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-25T15:11:47.278 DEBUG:teuthology.orchestra.run.trial167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:47.357 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:47.355+0000 7f3fd0e67900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-25T15:11:47.358 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:47.356+0000 7f3fd0e67900 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-25T15:11:47.358 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:47.356+0000 7f3fd0e67900 -1 bdev(0x56168e0a7800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:47.358 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:47.356+0000 7f3fd0e67900 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-25T15:11:47.845 DEBUG:teuthology.orchestra.run.trial167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-25T15:11:47.909 DEBUG:teuthology.orchestra.run.trial167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:47.987 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:47.986+0000 7f7d64014900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-25T15:11:47.988 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:47.986+0000 7f7d64014900 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-25T15:11:47.988 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:47.986+0000 7f7d64014900 -1 bdev(0x5557f2a45800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:47.988 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:47.986+0000 7f7d64014900 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-25T15:11:48.511 DEBUG:teuthology.orchestra.run.trial167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-25T15:11:48.576 DEBUG:teuthology.orchestra.run.trial167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:48.654 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:48.653+0000 7fa5913ba900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-25T15:11:48.655 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:48.653+0000 7fa5913ba900 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-25T15:11:48.655 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:48.653+0000 7fa5913ba900 -1 bdev(0x564bd8db7800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:48.656 INFO:teuthology.orchestra.run.trial167.stderr:2026-02-25T15:11:48.653+0000 7fa5913ba900 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-25T15:11:49.133 DEBUG:teuthology.orchestra.run.trial167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-25T15:11:49.199 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-25T15:11:49.224 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:49.224 INFO:tasks.ceph:role: osd.3 2026-02-25T15:11:49.225 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:11:49.225 DEBUG:teuthology.orchestra.run.trial174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:49.289 INFO:teuthology.orchestra.run.trial174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:49.859 INFO:teuthology.orchestra.run.trial174.stdout:Discarding blocks...Done. 2026-02-25T15:11:49.861 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial174.front.sepia.ceph.com -o noatime 2026-02-25T15:11:49.861 DEBUG:teuthology.orchestra.run.trial174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-25T15:11:49.930 DEBUG:teuthology.orchestra.run.trial174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-25T15:11:49.997 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-25T15:11:50.061 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:50.062 INFO:tasks.ceph:role: osd.7 2026-02-25T15:11:50.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:11:50.062 DEBUG:teuthology.orchestra.run.trial174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T15:11:50.127 INFO:teuthology.orchestra.run.trial174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:50.127 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:50.127 INFO:teuthology.orchestra.run.trial174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:50.127 INFO:teuthology.orchestra.run.trial174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:50.127 INFO:teuthology.orchestra.run.trial174.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:50.127 INFO:teuthology.orchestra.run.trial174.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:50.127 INFO:teuthology.orchestra.run.trial174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:50.128 INFO:teuthology.orchestra.run.trial174.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:50.128 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:50.128 INFO:teuthology.orchestra.run.trial174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:50.685 INFO:teuthology.orchestra.run.trial174.stdout:Discarding blocks...Done. 2026-02-25T15:11:50.687 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial174.front.sepia.ceph.com -o noatime 2026-02-25T15:11:50.688 DEBUG:teuthology.orchestra.run.trial174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-25T15:11:50.756 DEBUG:teuthology.orchestra.run.trial174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-25T15:11:50.823 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-25T15:11:50.887 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:50.887 INFO:tasks.ceph:role: osd.11 2026-02-25T15:11:50.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:11:50.888 DEBUG:teuthology.orchestra.run.trial174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T15:11:50.952 INFO:teuthology.orchestra.run.trial174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:50.952 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:50.952 INFO:teuthology.orchestra.run.trial174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:50.952 INFO:teuthology.orchestra.run.trial174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:50.952 INFO:teuthology.orchestra.run.trial174.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:50.952 INFO:teuthology.orchestra.run.trial174.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:50.952 INFO:teuthology.orchestra.run.trial174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:50.952 INFO:teuthology.orchestra.run.trial174.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:50.953 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:50.953 INFO:teuthology.orchestra.run.trial174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:51.554 INFO:teuthology.orchestra.run.trial174.stdout:Discarding blocks...Done. 2026-02-25T15:11:51.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial174.front.sepia.ceph.com -o noatime 2026-02-25T15:11:51.556 DEBUG:teuthology.orchestra.run.trial174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-25T15:11:51.624 DEBUG:teuthology.orchestra.run.trial174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-25T15:11:51.691 DEBUG:teuthology.orchestra.run.trial174:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-25T15:11:51.756 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:11:51.756 INFO:tasks.ceph:role: osd.15 2026-02-25T15:11:51.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:11:51.756 DEBUG:teuthology.orchestra.run.trial174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T15:11:51.821 INFO:teuthology.orchestra.run.trial174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:11:51.821 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:11:51.821 INFO:teuthology.orchestra.run.trial174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:11:51.821 INFO:teuthology.orchestra.run.trial174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:11:51.821 INFO:teuthology.orchestra.run.trial174.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:11:51.821 INFO:teuthology.orchestra.run.trial174.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:11:51.821 INFO:teuthology.orchestra.run.trial174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:11:51.821 INFO:teuthology.orchestra.run.trial174.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:11:51.822 INFO:teuthology.orchestra.run.trial174.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:11:51.822 INFO:teuthology.orchestra.run.trial174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:11:52.378 INFO:teuthology.orchestra.run.trial174.stdout:Discarding blocks...Done. 2026-02-25T15:11:52.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial174.front.sepia.ceph.com -o noatime 2026-02-25T15:11:52.380 DEBUG:teuthology.orchestra.run.trial174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-25T15:11:52.456 DEBUG:teuthology.orchestra.run.trial174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-25T15:11:52.524 DEBUG:teuthology.orchestra.run.trial174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:52.604 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:52.602+0000 7fc643cba900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-25T15:11:52.604 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:52.602+0000 7fc643cba900 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-25T15:11:52.604 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:52.602+0000 7fc643cba900 -1 bdev(0x55ee31133800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:52.604 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:52.602+0000 7fc643cba900 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-25T15:11:53.119 DEBUG:teuthology.orchestra.run.trial174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-25T15:11:53.184 DEBUG:teuthology.orchestra.run.trial174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:53.262 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:53.261+0000 7efd17223900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-25T15:11:53.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:53.261+0000 7efd17223900 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-25T15:11:53.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:53.261+0000 7efd17223900 -1 bdev(0x559e1b8c7800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:53.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:53.262+0000 7efd17223900 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-25T15:11:53.735 DEBUG:teuthology.orchestra.run.trial174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-25T15:11:53.800 DEBUG:teuthology.orchestra.run.trial174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:53.876 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:53.875+0000 7f1ef09a8900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-25T15:11:53.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:53.876+0000 7f1ef09a8900 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-25T15:11:53.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:53.876+0000 7f1ef09a8900 -1 bdev(0x55ebf0d4f800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:53.877 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:53.876+0000 7f1ef09a8900 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-25T15:11:54.371 DEBUG:teuthology.orchestra.run.trial174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-25T15:11:54.437 DEBUG:teuthology.orchestra.run.trial174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:54.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:54.513+0000 7fc57b92d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-25T15:11:54.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:54.513+0000 7fc57b92d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-25T15:11:54.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:54.513+0000 7fc57b92d900 -1 bdev(0x56473a9bb800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-25T15:11:54.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:11:54.513+0000 7fc57b92d900 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-25T15:11:55.000 DEBUG:teuthology.orchestra.run.trial174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-25T15:11:55.065 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-25T15:11:55.065 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:55.065 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-25T15:11:55.090 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:55.091 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-25T15:11:55.153 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:55.153 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-25T15:11:55.216 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:55.216 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-25T15:11:55.280 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:11:55.280 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-25T15:11:55.343 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:55.343 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-25T15:11:55.370 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:55.370 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-25T15:11:55.434 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:55.434 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-25T15:11:55.497 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:11:55.497 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-25T15:11:55.562 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:55.562 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-25T15:11:55.589 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:55.589 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-25T15:11:55.652 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:55.652 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-25T15:11:55.716 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:11:55.716 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-25T15:11:55.780 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:55.781 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-25T15:11:55.807 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:55.807 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-25T15:11:55.871 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:55.871 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-25T15:11:55.935 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:55.936 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-25T15:11:55.998 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:55.999 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-25T15:11:56.061 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:11:56.062 DEBUG:teuthology.orchestra.run.trial174:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-25T15:11:56.117 INFO:tasks.ceph:Adding keys to all mons... 2026-02-25T15:11:56.117 DEBUG:teuthology.orchestra.run.trial078:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T15:11:56.120 DEBUG:teuthology.orchestra.run.trial155:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T15:11:56.123 DEBUG:teuthology.orchestra.run.trial167:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout:[mgr.y] 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAjEZ9pjo6sKBAAAxF/YNg0Jz2EtF0Dyr2Pbw== 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout:[osd.0] 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAnEZ9p/ThHCRAArHReVqpV/ZsCYNbEw1oR7g== 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout:[osd.4] 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAnEZ9peWnfLRAAnom/u+PK8Zn2c/l1OUeBNw== 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout:[osd.8] 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAoEZ9pIBPMFxAAxDb8KZljxjk1R4fQrCR8KA== 2026-02-25T15:11:56.142 INFO:teuthology.orchestra.run.trial078.stdout:[osd.12] 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout: key = AQApEZ9p9riCABAALIQ++w8Qa7MQW5C+d9zKXw== 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout:[osd.1] 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAsEZ9pBQZsNxAAfZoqNLWLmqeQhCyZDv5E0w== 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout:[osd.5] 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAtEZ9p8CrCIBAAqXD+KMG4Y1qZhjXuMVdKgQ== 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout:[osd.9] 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAuEZ9psDKMCxAACsayK54YJVR6EFgZtGkgbw== 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout:[osd.13] 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAuEZ9p5jyDLxAA2oPkgGoyhcgOqOs/opMjHg== 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout:[osd.2] 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAyEZ9pXYgULBAA9m52isLrgTX5eUwZ+SYsxw== 2026-02-25T15:11:56.143 INFO:teuthology.orchestra.run.trial078.stdout:[osd.6] 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAzEZ9pSuo+FRAAohnfBIJnX2SgVnnGu76g4Q== 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout:[osd.10] 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAzEZ9pty3VOhAAPjV9WcFwD6FBWLrU7jdaug== 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout:[osd.14] 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout: key = AQA0EZ9p3wr9JhAArH+0sR71loBMa325i9Zz5Q== 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout:[mgr.x] 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAjEZ9psXFhKxAAS2/ajYslXM96t5ITA9mudg== 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout:[osd.3] 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout: key = AQA4EZ9pTnXwIxAAkuZ7U7XB0nhWDQaV8476EA== 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout:[osd.7] 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout: key = AQA5EZ9p0fOgDxAALhZT/9r9WNFhLbWsKqAeKQ== 2026-02-25T15:11:56.144 INFO:teuthology.orchestra.run.trial078.stdout:[osd.11] 2026-02-25T15:11:56.145 INFO:teuthology.orchestra.run.trial078.stdout: key = AQA5EZ9p5p49NBAAfOCeC3gc0c88M2m1S7b1EA== 2026-02-25T15:11:56.145 INFO:teuthology.orchestra.run.trial078.stdout:[osd.15] 2026-02-25T15:11:56.145 INFO:teuthology.orchestra.run.trial078.stdout: key = AQA6EZ9pH8CfHhAA4bQaEsVPdB/b1KCzhJTtNA== 2026-02-25T15:11:56.145 INFO:teuthology.orchestra.run.trial078.stdout:[client.0] 2026-02-25T15:11:56.145 INFO:teuthology.orchestra.run.trial078.stdout: key = AQAjEZ9pcV6yLRAA3dmF1pnWcbeTw/YhXgq4Gw== 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout:[mgr.y] 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAjEZ9pjo6sKBAAAxF/YNg0Jz2EtF0Dyr2Pbw== 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout:[osd.0] 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAnEZ9p/ThHCRAArHReVqpV/ZsCYNbEw1oR7g== 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout:[osd.4] 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAnEZ9peWnfLRAAnom/u+PK8Zn2c/l1OUeBNw== 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout:[osd.8] 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAoEZ9pIBPMFxAAxDb8KZljxjk1R4fQrCR8KA== 2026-02-25T15:11:56.147 INFO:teuthology.orchestra.run.trial155.stdout:[osd.12] 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout: key = AQApEZ9p9riCABAALIQ++w8Qa7MQW5C+d9zKXw== 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout:[osd.1] 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAsEZ9pBQZsNxAAfZoqNLWLmqeQhCyZDv5E0w== 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout:[osd.5] 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAtEZ9p8CrCIBAAqXD+KMG4Y1qZhjXuMVdKgQ== 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout:[osd.9] 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAuEZ9psDKMCxAACsayK54YJVR6EFgZtGkgbw== 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout:[osd.13] 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAuEZ9p5jyDLxAA2oPkgGoyhcgOqOs/opMjHg== 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout:[osd.2] 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAyEZ9pXYgULBAA9m52isLrgTX5eUwZ+SYsxw== 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout:[osd.6] 2026-02-25T15:11:56.148 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAzEZ9pSuo+FRAAohnfBIJnX2SgVnnGu76g4Q== 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout:[osd.10] 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAzEZ9pty3VOhAAPjV9WcFwD6FBWLrU7jdaug== 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout:[osd.14] 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout: key = AQA0EZ9p3wr9JhAArH+0sR71loBMa325i9Zz5Q== 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout:[mgr.x] 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAjEZ9psXFhKxAAS2/ajYslXM96t5ITA9mudg== 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout:[osd.3] 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout: key = AQA4EZ9pTnXwIxAAkuZ7U7XB0nhWDQaV8476EA== 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout:[osd.7] 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout: key = AQA5EZ9p0fOgDxAALhZT/9r9WNFhLbWsKqAeKQ== 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout:[osd.11] 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout: key = AQA5EZ9p5p49NBAAfOCeC3gc0c88M2m1S7b1EA== 2026-02-25T15:11:56.149 INFO:teuthology.orchestra.run.trial155.stdout:[osd.15] 2026-02-25T15:11:56.150 INFO:teuthology.orchestra.run.trial155.stdout: key = AQA6EZ9pH8CfHhAA4bQaEsVPdB/b1KCzhJTtNA== 2026-02-25T15:11:56.150 INFO:teuthology.orchestra.run.trial155.stdout:[client.0] 2026-02-25T15:11:56.150 INFO:teuthology.orchestra.run.trial155.stdout: key = AQAjEZ9pcV6yLRAA3dmF1pnWcbeTw/YhXgq4Gw== 2026-02-25T15:11:56.151 INFO:teuthology.orchestra.run.trial167.stdout:[mgr.y] 2026-02-25T15:11:56.151 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAjEZ9pjo6sKBAAAxF/YNg0Jz2EtF0Dyr2Pbw== 2026-02-25T15:11:56.151 INFO:teuthology.orchestra.run.trial167.stdout:[osd.0] 2026-02-25T15:11:56.151 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAnEZ9p/ThHCRAArHReVqpV/ZsCYNbEw1oR7g== 2026-02-25T15:11:56.151 INFO:teuthology.orchestra.run.trial167.stdout:[osd.4] 2026-02-25T15:11:56.151 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAnEZ9peWnfLRAAnom/u+PK8Zn2c/l1OUeBNw== 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout:[osd.8] 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAoEZ9pIBPMFxAAxDb8KZljxjk1R4fQrCR8KA== 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout:[osd.12] 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout: key = AQApEZ9p9riCABAALIQ++w8Qa7MQW5C+d9zKXw== 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout:[osd.1] 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAsEZ9pBQZsNxAAfZoqNLWLmqeQhCyZDv5E0w== 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout:[osd.5] 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAtEZ9p8CrCIBAAqXD+KMG4Y1qZhjXuMVdKgQ== 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout:[osd.9] 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAuEZ9psDKMCxAACsayK54YJVR6EFgZtGkgbw== 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout:[osd.13] 2026-02-25T15:11:56.152 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAuEZ9p5jyDLxAA2oPkgGoyhcgOqOs/opMjHg== 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout:[osd.2] 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAyEZ9pXYgULBAA9m52isLrgTX5eUwZ+SYsxw== 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout:[osd.6] 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAzEZ9pSuo+FRAAohnfBIJnX2SgVnnGu76g4Q== 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout:[osd.10] 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAzEZ9pty3VOhAAPjV9WcFwD6FBWLrU7jdaug== 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout:[osd.14] 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout: key = AQA0EZ9p3wr9JhAArH+0sR71loBMa325i9Zz5Q== 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout:[mgr.x] 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAjEZ9psXFhKxAAS2/ajYslXM96t5ITA9mudg== 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout:[osd.3] 2026-02-25T15:11:56.153 INFO:teuthology.orchestra.run.trial167.stdout: key = AQA4EZ9pTnXwIxAAkuZ7U7XB0nhWDQaV8476EA== 2026-02-25T15:11:56.154 INFO:teuthology.orchestra.run.trial167.stdout:[osd.7] 2026-02-25T15:11:56.154 INFO:teuthology.orchestra.run.trial167.stdout: key = AQA5EZ9p0fOgDxAALhZT/9r9WNFhLbWsKqAeKQ== 2026-02-25T15:11:56.154 INFO:teuthology.orchestra.run.trial167.stdout:[osd.11] 2026-02-25T15:11:56.154 INFO:teuthology.orchestra.run.trial167.stdout: key = AQA5EZ9p5p49NBAAfOCeC3gc0c88M2m1S7b1EA== 2026-02-25T15:11:56.154 INFO:teuthology.orchestra.run.trial167.stdout:[osd.15] 2026-02-25T15:11:56.154 INFO:teuthology.orchestra.run.trial167.stdout: key = AQA6EZ9pH8CfHhAA4bQaEsVPdB/b1KCzhJTtNA== 2026-02-25T15:11:56.154 INFO:teuthology.orchestra.run.trial167.stdout:[client.0] 2026-02-25T15:11:56.154 INFO:teuthology.orchestra.run.trial167.stdout: key = AQAjEZ9pcV6yLRAA3dmF1pnWcbeTw/YhXgq4Gw== 2026-02-25T15:11:56.154 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:11:56.189 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:11:56.192 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:11:56.232 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.270 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.273 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.312 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.351 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.354 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.392 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.430 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.433 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.474 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.509 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.513 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.553 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.588 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.592 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.633 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.667 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.673 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.713 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.748 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.753 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.792 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.827 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.833 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.872 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.906 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.913 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.952 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.985 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:56.993 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.033 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.064 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.073 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.113 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.144 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.152 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.192 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:11:57.223 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:11:57.231 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:11:57.271 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.303 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.310 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.350 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.382 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.389 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.429 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.461 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.468 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.508 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.541 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.550 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:11:57.590 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T15:11:57.621 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T15:11:57.630 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T15:11:57.671 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-25T15:11:57.671 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-25T15:11:57.724 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T15:11:57.812 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-25T15:11:57.836 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-25T15:11:57.862 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T15:11:57.949 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-25T15:11:57.973 DEBUG:teuthology.orchestra.run.trial167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-25T15:11:58.000 DEBUG:teuthology.orchestra.run.trial167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T15:11:58.086 DEBUG:teuthology.orchestra.run.trial167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-25T15:11:58.110 DEBUG:teuthology.orchestra.run.trial078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:58.113 DEBUG:teuthology.orchestra.run.trial155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:58.116 DEBUG:teuthology.orchestra.run.trial167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:11:58.166 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-25T15:11:58.167 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-25T15:11:58.167 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-25T15:11:58.167 DEBUG:teuthology.orchestra.run.trial078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-25T15:11:58.171 INFO:tasks.ceph.mon.a:Started 2026-02-25T15:11:58.171 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-25T15:11:58.171 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-25T15:11:58.172 DEBUG:teuthology.orchestra.run.trial155:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-25T15:11:58.174 INFO:tasks.ceph.mon.b:Started 2026-02-25T15:11:58.174 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-25T15:11:58.174 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-25T15:11:58.174 DEBUG:teuthology.orchestra.run.trial167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-25T15:11:58.209 INFO:tasks.ceph.mon.c:Started 2026-02-25T15:11:58.209 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-25T15:11:58.209 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-25T15:11:58.209 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-25T15:11:58.212 INFO:tasks.ceph.mgr.y:Started 2026-02-25T15:11:58.212 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-25T15:11:58.212 DEBUG:teuthology.orchestra.run.trial174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-25T15:11:58.214 INFO:tasks.ceph.mgr.x:Started 2026-02-25T15:11:58.215 DEBUG:tasks.ceph:set 0 configs 2026-02-25T15:11:58.215 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph config dump 2026-02-25T15:11:58.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.280+0000 7fb7af713640 10 monclient: get_monmap_and_config 2026-02-25T15:11:58.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.280+0000 7fb7af713640 10 monclient: build_initial_monmap 2026-02-25T15:11:58.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.280+0000 7fb7af713640 10 monclient: monmap: 2026-02-25T15:11:58.282 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:11:58.282 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:11:58.282 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:58.281177+0000 2026-02-25T15:11:58.283 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:58.281177+0000 2026-02-25T15:11:58.283 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:11:58.283 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:11:58.283 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:11:58.283 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:11:58.283 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:11:58.283 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.280+0000 7fb7af713640 1 Processor -- start 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.280+0000 7fb7af713640 1 -- start start 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.280+0000 7fb7af713640 10 monclient: init 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 10 monclient: _reopen_session rank -1 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 10 monclient(hunting): picked mon.noname-a con 0x7fb7a81626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a81655c0 con 0x7fb7a81626a0 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b12b0 con 0x7fb7a8058da0 2026-02-25T15:11:58.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b1590 con 0x7fb7a80b0410 2026-02-25T15:11:58.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 10 monclient(hunting): _renew_subs 2026-02-25T15:11:58.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7af713640 10 monclient(hunting): authenticate will time out at 3287.870284s 2026-02-25T15:11:58.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.281+0000 7fb7adc89640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb7a81c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:11:58.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.286+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb7a81647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:11:58.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.286+0000 7fb7acc87640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb7a8164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:11:58.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.482+0000 7fb7adc89640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb7a81c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:11:58.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.487+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb7a81647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:11:58.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.487+0000 7fb7acc87640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb7a8164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:11:58.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.883+0000 7fb7adc89640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb7a81c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:11:58.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.888+0000 7fb7acc87640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb7a8164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:11:58.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:58.888+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb7a81647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:11:59.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:59.684+0000 7fb7adc89640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb7a81c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:11:59.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:59.689+0000 7fb7acc87640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb7a8164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:11:59.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:11:59.689+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb7a81647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:00.252 INFO:tasks.ceph.mon.a.trial078.stderr:--00:00:00:02.031 44773-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-25T15:12:00.268 INFO:tasks.ceph.mon.b.trial155.stderr:--00:00:00:02.046 44107-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-25T15:12:00.309 INFO:tasks.ceph.mon.c.trial167.stderr:--00:00:00:02.049 43880-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-25T15:12:01.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 10 monclient(hunting): tick 2026-02-25T15:12:01.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:12:01.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 1 monclient(hunting): continuing hunt 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb7a8164eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb7a81647a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb7a81c6d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-a con 0x7fb7a81626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b1870 con 0x7fb7a81626a0 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a81655c0 con 0x7fb7a8058da0 2026-02-25T15:12:01.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb7acc87640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:12:01.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b12b0 con 0x7fb7a80b0410 2026-02-25T15:12:01.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb796ffd640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:01.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:01.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.281+0000 7fb7adc89640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c066820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:12:01.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.482+0000 7fb7acc87640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:12:01.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.482+0000 7fb7adc89640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c066820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:12:01.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.482+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:01.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.883+0000 7fb7adc89640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c066820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:12:01.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.883+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:01.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:01.883+0000 7fb7acc87640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:12:02.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:02.685+0000 7fb7adc89640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c066820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:12:02.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:02.685+0000 7fb7acc87640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:12:02.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:02.685+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:04.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 10 monclient(hunting): tick 2026-02-25T15:12:04.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:12:04.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 1 monclient(hunting): continuing hunt 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c066820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-a con 0x7fb7a81626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b1590 con 0x7fb7a81626a0 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b1870 con 0x7fb7a8058da0 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a81655c0 con 0x7fb7a80b0410 2026-02-25T15:12:04.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb7acc87640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:12:04.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb796ffd640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:04.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:04.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.281+0000 7fb7adc89640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:12:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.482+0000 7fb7acc87640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:12:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.482+0000 7fb7adc89640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:12:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.482+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:04.525 INFO:tasks.ceph.mon.a.trial078.stderr:--00:00:00:06.304 44773-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-25T15:12:04.541 INFO:tasks.ceph.mon.b.trial155.stderr:--00:00:00:06.318 44107-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-25T15:12:04.557 INFO:tasks.ceph.mon.c.trial167.stderr:--00:00:00:06.297 43880-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-25T15:12:04.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.883+0000 7fb7adc89640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:12:04.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.883+0000 7fb7acc87640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:12:04.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:04.883+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:05.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:05.684+0000 7fb7acc87640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-25T15:12:05.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:05.684+0000 7fb7ad488640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.155:6789/0 2026-02-25T15:12:05.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:05.685+0000 7fb7adc89640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.167:6789/0 2026-02-25T15:12:06.031 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:00:07.810 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:12:06.045 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:00:07.822 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:12:06.059 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:00:07.799 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:12:06.179 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:00:07.959 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:12:06.194 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:00:07.972 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:12:06.208 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:00:07.949 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 10 monclient(hunting): tick 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 1 monclient(hunting): continuing hunt 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:12:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-a con 0x7fb7a81626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b12b0 con 0x7fb7a81626a0 2026-02-25T15:12:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b1590 con 0x7fb7a8058da0 2026-02-25T15:12:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b1870 con 0x7fb7a80b0410 2026-02-25T15:12:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.281+0000 7fb796ffd640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.282+0000 7fb7adc89640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 0x7fb78c0237c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:40840/0 (socket says 10.20.193.78:40840) 2026-02-25T15:12:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:07.282+0000 7fb7adc89640 1 -- 10.20.193.78:0/3210950911 learned_addr learned my addr 10.20.193.78:0/3210950911 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:10.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 10 monclient(hunting): tick 2026-02-25T15:12:10.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 1 monclient(hunting): continuing hunt 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c0237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c044f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-a con 0x7fb7a81626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a81655c0 con 0x7fb7a81626a0 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c067a10 con 0x7fb7a8058da0 2026-02-25T15:12:10.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c067be0 con 0x7fb7a80b0410 2026-02-25T15:12:10.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:10.282+0000 7fb796ffd640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:13.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.281+0000 7fb796ffd640 10 monclient(hunting): tick 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.281+0000 7fb796ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.281+0000 7fb796ffd640 1 monclient(hunting): continuing hunt 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.281+0000 7fb796ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.281+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.281+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c023780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-a con 0x7fb7a81626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c045f60 con 0x7fb7a81626a0 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c046150 con 0x7fb7a8058da0 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c046320 con 0x7fb7a80b0410 2026-02-25T15:12:13.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:13.282+0000 7fb796ffd640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:16.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 10 monclient(hunting): tick 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 1 monclient(hunting): continuing hunt 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c023780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.78:6789/0 conn(0x7fb7a81626a0 legacy=0x7fb78c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-a con 0x7fb78c06b210 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:16.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c06c220 con 0x7fb78c06b210 2026-02-25T15:12:16.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c06bd90 con 0x7fb7a8058da0 2026-02-25T15:12:16.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c06c000 con 0x7fb7a80b0410 2026-02-25T15:12:16.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:16.282+0000 7fb796ffd640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:18.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.504+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162040179 0 0) 0x7fb78c06c220 con 0x7fb78c06b210 2026-02-25T15:12:18.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.504+0000 7fb797fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:18.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.504+0000 7fb797fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:18.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.504+0000 7fb797fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:18.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.504+0000 7fb797fff640 10 monclient(hunting): my global_id is 4101 2026-02-25T15:12:18.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.504+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb790003610 con 0x7fb78c06b210 2026-02-25T15:12:18.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.516+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525936281 0 0) 0x7fb78c06bd90 con 0x7fb7a8058da0 2026-02-25T15:12:18.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.516+0000 7fb797fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:18.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.516+0000 7fb797fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:18.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.516+0000 7fb797fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:18.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.516+0000 7fb797fff640 10 monclient(hunting): my global_id is 4105 2026-02-25T15:12:18.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.516+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb78c06c220 con 0x7fb7a8058da0 2026-02-25T15:12:18.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.519+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104805284 0 0) 0x7fb78c06c000 con 0x7fb7a80b0410 2026-02-25T15:12:18.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.519+0000 7fb797fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:18.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.519+0000 7fb797fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:18.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.519+0000 7fb797fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:18.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.519+0000 7fb797fff640 10 monclient(hunting): my global_id is 4106 2026-02-25T15:12:18.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.519+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb78c06bd90 con 0x7fb7a80b0410 2026-02-25T15:12:18.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3948845614 0 0) 0x7fb790003610 con 0x7fb78c06b210 2026-02-25T15:12:18.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.167:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb78c06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb78c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 10 monclient: _finish_hunting 0 2026-02-25T15:12:18.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 1 monclient: found mon.noname-a 2026-02-25T15:12:18.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c0057e0 con 0x7fb78c06b210 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 10 monclient: _finish_auth 0 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 10 monclient: _check_auth_tickets 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb798004020 con 0x7fb78c06b210 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb797fff640 10 monclient: dump: 2026-02-25T15:12:18.535 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb7af713640 5 monclient: authenticate success, global_id 4101 2026-02-25T15:12:18.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.531+0000 7fb7af713640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:18.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb798004280 con 0x7fb78c06b210 2026-02-25T15:12:18.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb797fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:18.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb797fff640 1 -- 10.20.193.78:0/3210950911 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb798004690 con 0x7fb78c06b210 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb797fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb797fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb797fff640 10 monclient: dump: 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.556 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 4 set_mon_vals no callback set 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 10 monclient: shutdown 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 1 -- 10.20.193.78:0/3210950911 >> v1:10.20.193.78:6789/0 conn(0x7fb78c06b210 legacy=0x7fb78c06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 1 -- 10.20.193.78:0/3210950911 shutdown_connections 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 1 -- 10.20.193.78:0/3210950911 >> 10.20.193.78:0/3210950911 conn(0x7fb7a80b65f0 msgr2=0x7fb7a80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:18.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 1 -- 10.20.193.78:0/3210950911 shutdown_connections 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.551+0000 7fb7af713640 1 -- 10.20.193.78:0/3210950911 wait complete. 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 10 monclient: build_initial_monmap 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 10 monclient: monmap: 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:18.558 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 1 librados: starting msgr at 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 1 librados: starting objecter 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 1 Processor -- start 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 1 -- start start 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 1 librados: setting wanted keys 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 1 librados: calling monclient init 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.552+0000 7fb7af713640 10 monclient: init 2026-02-25T15:12:18.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 10 monclient(hunting): picked mon.noname-c con 0x7fb78c06b210 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 10 monclient(hunting): picked mon.noname-a con 0x7fb7a80b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a8131b80 con 0x7fb7a80b0410 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a8131e60 con 0x7fb7a8058da0 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a8132140 con 0x7fb78c06b210 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:18.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.553+0000 7fb7af713640 10 monclient(hunting): authenticate will time out at 3308.142351s 2026-02-25T15:12:18.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.554+0000 7fb7acc87640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 0x7fb7a813ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:35798/0 (socket says 10.20.193.78:35798) 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.554+0000 7fb7acc87640 1 -- 10.20.193.78:0/3513646543 learned_addr learned my addr 10.20.193.78:0/3513646543 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.554+0000 7fb795ffb640 10 client.?.objecter ms_handle_connect 0x7fb7a8058da0 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.554+0000 7fb795ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.555+0000 7fb795ffb640 10 client.?.objecter ms_handle_connect 0x7fb78c06b210 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.555+0000 7fb795ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.555+0000 7fb7ad488640 1 -- 10.20.193.78:0/3513646543 >> v1:10.20.193.167:6789/0 conn(0x7fb78c06b210 legacy=0x7fb7a813d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.555+0000 7fb7ad488640 1 -- 10.20.193.78:0/3513646543 >> v1:10.20.193.167:6789/0 conn(0x7fb78c06b210 legacy=0x7fb7a813d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.555+0000 7fb7ad488640 1 --1- 10.20.193.78:0/3513646543 >> v1:10.20.193.167:6789/0 conn(0x7fb78c06b210 0x7fb7a813d530 :-1 s=OPENED pgs=20 cs=1 l=1).handle_message read tag failed 2026-02-25T15:12:18.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.555+0000 7fb7ad488640 1 --1- 10.20.193.78:0/3513646543 >> v1:10.20.193.167:6789/0 conn(0x7fb78c06b210 0x7fb7a813d530 :-1 s=OPENED pgs=20 cs=1 l=1).fault on lossy channel, failing 2026-02-25T15:12:18.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.555+0000 7fb795ffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.167:6789/0 2026-02-25T15:12:18.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.581+0000 7fb795ffb640 10 client.?.objecter ms_handle_connect 0x7fb7a80b0410 2026-02-25T15:12:18.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.581+0000 7fb795ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:18.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.582+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216620115 0 0) 0x7fb7a8131b80 con 0x7fb7a80b0410 2026-02-25T15:12:18.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.582+0000 7fb795ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:18.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.582+0000 7fb795ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:18.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.582+0000 7fb795ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:18.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.582+0000 7fb795ffb640 10 monclient(hunting): my global_id is 4110 2026-02-25T15:12:18.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.582+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb778003610 con 0x7fb7a80b0410 2026-02-25T15:12:18.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.589+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776947217 0 0) 0x7fb7a8131e60 con 0x7fb7a8058da0 2026-02-25T15:12:18.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.589+0000 7fb795ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:18.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.589+0000 7fb795ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:18.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.589+0000 7fb795ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:18.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.589+0000 7fb795ffb640 10 monclient(hunting): my global_id is 4111 2026-02-25T15:12:18.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.589+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a8131b80 con 0x7fb7a8058da0 2026-02-25T15:12:18.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.592+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 797163337 0 0) 0x7fb778003610 con 0x7fb7a80b0410 2026-02-25T15:12:18.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.592+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7a8131e60 con 0x7fb7a80b0410 2026-02-25T15:12:18.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.592+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb7a4004650 con 0x7fb7a80b0410 2026-02-25T15:12:18.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.592+0000 7fb795ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:18.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.592+0000 7fb795ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:18.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.592+0000 7fb795ffb640 10 monclient(hunting): dump: 2026-02-25T15:12:18.595 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:18.595 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.593+0000 7fb795ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:18.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 526345398 0 0) 0x7fb7a8131e60 con 0x7fb7a80b0410 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 >> v1:10.20.193.167:6789/0 conn(0x7fb78c06b210 legacy=0x7fb7a813d530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 >> v1:10.20.193.155:6789/0 conn(0x7fb7a8058da0 legacy=0x7fb7a813ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 1 monclient: found mon.a 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a8132420 con 0x7fb7a80b0410 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 10 monclient: _finish_auth 0 2026-02-25T15:12:18.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb795ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 5 monclient: authenticate success, global_id 4110 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 10 monclient: _renew_subs 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a8132700 con 0x7fb7a80b0410 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 10 client.4110.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 10 monclient: _renew_subs 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb7a813ec80 con 0x7fb7a80b0410 2026-02-25T15:12:18.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.628+0000 7fb7af713640 1 librados: init done 2026-02-25T15:12:18.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.629+0000 7fb7af713640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:18.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.629+0000 7fb7af713640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:18.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.629+0000 7fb7af713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.629+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a8162150 con 0x7fb7a80b0410 2026-02-25T15:12:18.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7a4004ae0 con 0x7fb7a80b0410 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb7a4004ef0 con 0x7fb7a80b0410 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 10 monclient: dump: 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.726 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb7977fe640 4 set_mon_vals no callback set 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fb7a40054e0 con 0x7fb7a80b0410 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1807605974 0 0) 0x7fb7a4006e90 con 0x7fb7a80b0410 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 10 client.4110.objecter ms_dispatch2 0x7fb7a8000b90 osd_map(1..1 src has 1..1) 2026-02-25T15:12:18.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 3 client.4110.objecter handle_osd_map got epochs [1,1] > 0 2026-02-25T15:12:18.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 3 client.4110.objecter handle_osd_map decoding full epoch 1 2026-02-25T15:12:18.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 20 client.4110.objecter dump_active .. 0 homeless 2026-02-25T15:12:18.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fb7a40071f0 con 0x7fb7a80b0410 2026-02-25T15:12:18.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:18.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.723+0000 7fb795ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:18.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.753+0000 7fb7af713640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-25T15:12:18.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.753+0000 7fb7af713640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-25T15:12:18.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.753+0000 7fb7af713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.753+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb7a8162150 con 0x7fb7a80b0410 2026-02-25T15:12:18.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.770+0000 7fb795ffb640 1 -- 10.20.193.78:0/3513646543 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7fb7a40063a0 con 0x7fb7a80b0410 2026-02-25T15:12:18.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.770+0000 7fb795ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-25T15:12:18.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.770+0000 7fb795ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:18.773 INFO:teuthology.orchestra.run.trial078.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-25T15:12:18.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 10 librados: watch_flush enter 2026-02-25T15:12:18.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 10 librados: watch_flush exit 2026-02-25T15:12:18.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 20 client.4110.objecter shutdown clearing up homeless session... 2026-02-25T15:12:18.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 10 client.4110.objecter successfully canceled tick 2026-02-25T15:12:18.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 10 monclient: shutdown 2026-02-25T15:12:18.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:18.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 >> v1:10.20.193.78:6789/0 conn(0x7fb7a80b0410 legacy=0x7fb7a8147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 shutdown_connections 2026-02-25T15:12:18.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 >> 10.20.193.78:0/3513646543 conn(0x7fb7a80b65f0 msgr2=0x7fb7a8059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:18.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 shutdown_connections 2026-02-25T15:12:18.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 1 -- 10.20.193.78:0/3513646543 wait complete. 2026-02-25T15:12:18.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.771+0000 7fb7af713640 1 librados: shutdown 2026-02-25T15:12:18.782 INFO:tasks.ceph:Setting crush tunables to default 2026-02-25T15:12:18.782 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd crush tunables default 2026-02-25T15:12:18.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.848+0000 7fad7ce7b640 10 monclient: get_monmap_and_config 2026-02-25T15:12:18.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.848+0000 7fad7ce7b640 10 monclient: build_initial_monmap 2026-02-25T15:12:18.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.848+0000 7fad7ce7b640 10 monclient: monmap: 2026-02-25T15:12:18.850 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:18.850 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.850 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:12:18.849197+0000 2026-02-25T15:12:18.851 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:12:18.849197+0000 2026-02-25T15:12:18.851 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:18.851 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.851 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:18.851 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:18.851 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:18.851 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.848+0000 7fad7ce7b640 1 Processor -- start 2026-02-25T15:12:18.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.848+0000 7fad7ce7b640 1 -- start start 2026-02-25T15:12:18.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.848+0000 7fad7ce7b640 10 monclient: init 2026-02-25T15:12:18.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:18.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 10 monclient(hunting): picked mon.noname-b con 0x7fad780b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 10 monclient(hunting): picked mon.noname-c con 0x7fad780ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 10 monclient(hunting): picked mon.noname-a con 0x7fad780585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad78163930 con 0x7fad780585e0 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad78163bb0 con 0x7fad780b9f80 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad78163e90 con 0x7fad780ba350 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad7ce7b640 10 monclient(hunting): authenticate will time out at 3308.438504s 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad75d74640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fad780ba350 0x7fad78057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:53082/0 (socket says 10.20.193.78:53082) 2026-02-25T15:12:18.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.849+0000 7fad75d74640 1 -- 10.20.193.78:0/3350131904 learned_addr learned my addr 10.20.193.78:0/3350131904 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:18.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.870+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3623182814 0 0) 0x7fad68002c90 con 0x7fad780585e0 2026-02-25T15:12:18.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.870+0000 7fad75573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:18.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.870+0000 7fad75573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:18.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.870+0000 7fad75573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:18.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.870+0000 7fad75573640 10 monclient(hunting): my global_id is 4116 2026-02-25T15:12:18.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.870+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad64003610 con 0x7fad780585e0 2026-02-25T15:12:18.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2787930836 0 0) 0x7fad64003610 con 0x7fad780585e0 2026-02-25T15:12:18.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 >> v1:10.20.193.167:6789/0 conn(0x7fad780ba350 legacy=0x7fad78057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 >> v1:10.20.193.155:6789/0 conn(0x7fad780b9f80 legacy=0x7fad78163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 10 monclient: _finish_hunting 0 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 1 monclient: found mon.noname-a 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad780573f0 con 0x7fad780585e0 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 10 monclient: _finish_auth 0 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 10 monclient: _check_auth_tickets 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad7ce7b640 5 monclient: authenticate success, global_id 4116 2026-02-25T15:12:18.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad7ce7b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fad68003340 con 0x7fad780585e0 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad75573640 10 monclient: dump: 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.879 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.872+0000 7fad7ce7b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad68003550 con 0x7fad780585e0 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad75573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad75573640 1 -- 10.20.193.78:0/3350131904 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fad68003a80 con 0x7fad780585e0 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad75573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad75573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:18.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad75573640 10 monclient: dump: 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 4 set_mon_vals no callback set 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 10 monclient: shutdown 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 1 -- 10.20.193.78:0/3350131904 >> v1:10.20.193.78:6789/0 conn(0x7fad780585e0 legacy=0x7fad78166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 1 -- 10.20.193.78:0/3350131904 shutdown_connections 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 1 -- 10.20.193.78:0/3350131904 >> 10.20.193.78:0/3350131904 conn(0x7fad780b7990 msgr2=0x7fad780b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 1 -- 10.20.193.78:0/3350131904 shutdown_connections 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.873+0000 7fad7ce7b640 1 -- 10.20.193.78:0/3350131904 wait complete. 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient: build_initial_monmap 2026-02-25T15:12:18.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient: monmap: 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 librados: starting msgr at 2026-02-25T15:12:18.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 librados: starting objecter 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 Processor -- start 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 -- start start 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 librados: setting wanted keys 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 librados: calling monclient init 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient: init 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient(hunting): picked mon.noname-b con 0x7fad780585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:18.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient(hunting): picked mon.noname-c con 0x7fad780b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient(hunting): picked mon.noname-a con 0x7fad780ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad781628a0 con 0x7fad780ba350 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad78162b80 con 0x7fad780585e0 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad78162e60 con 0x7fad780b9f80 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.874+0000 7fad7ce7b640 10 monclient(hunting): authenticate will time out at 3308.463859s 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.875+0000 7fad76d76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fad780ba350 0x7fad780b3330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:48526/0 (socket says 10.20.193.78:48526) 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.875+0000 7fad76d76640 1 -- 10.20.193.78:0/872139462 learned_addr learned my addr 10.20.193.78:0/872139462 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.875+0000 7fad5effd640 10 client.?.objecter ms_handle_connect 0x7fad780ba350 2026-02-25T15:12:18.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.875+0000 7fad5effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:18.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.876+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2713474749 0 0) 0x7fad781628a0 con 0x7fad780ba350 2026-02-25T15:12:18.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.876+0000 7fad5effd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:18.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.876+0000 7fad5effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:18.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.876+0000 7fad5effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.876+0000 7fad5effd640 10 monclient(hunting): my global_id is 4119 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.876+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad44003610 con 0x7fad780ba350 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.877+0000 7fad5effd640 10 client.?.objecter ms_handle_connect 0x7fad780585e0 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.877+0000 7fad5effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.879+0000 7fad5effd640 10 client.?.objecter ms_handle_connect 0x7fad780b9f80 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.879+0000 7fad5effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.880+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3970219753 0 0) 0x7fad44003610 con 0x7fad780ba350 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.880+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad781628a0 con 0x7fad780ba350 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.880+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fad680038a0 con 0x7fad780ba350 2026-02-25T15:12:18.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.880+0000 7fad5effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.880+0000 7fad5effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.880+0000 7fad5effd640 10 monclient(hunting): dump: 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:18.889 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:18.890 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.880+0000 7fad5effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:18.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3091722533 0 0) 0x7fad781628a0 con 0x7fad780ba350 2026-02-25T15:12:18.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 >> v1:10.20.193.167:6789/0 conn(0x7fad780b9f80 legacy=0x7fad781656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 >> v1:10.20.193.155:6789/0 conn(0x7fad780585e0 legacy=0x7fad78155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:18.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 10 monclient: _finish_hunting 0 2026-02-25T15:12:18.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 1 monclient: found mon.a 2026-02-25T15:12:18.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:18.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad78163140 con 0x7fad780ba350 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 10 monclient: _finish_auth 0 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 10 monclient: _check_auth_tickets 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 5 monclient: authenticate success, global_id 4119 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 10 monclient: _renew_subs 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad78162550 con 0x7fad780ba350 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 10 client.4119.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 10 monclient: _renew_subs 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fad781fea80 con 0x7fad780ba350 2026-02-25T15:12:18.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.907+0000 7fad7ce7b640 1 librados: init done 2026-02-25T15:12:18.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.908+0000 7fad7ce7b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:18.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.908+0000 7fad7ce7b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:18.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.908+0000 7fad7ce7b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.908+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7815c5c0 con 0x7fad780ba350 2026-02-25T15:12:18.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.939+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad68003ab0 con 0x7fad780ba350 2026-02-25T15:12:18.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.939+0000 7fad5effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:18.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.939+0000 7fad74d72640 4 set_mon_vals no callback set 2026-02-25T15:12:18.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fad68004040 con 0x7fad780ba350 2026-02-25T15:12:18.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:18.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:18.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 10 monclient: dump: 2026-02-25T15:12:18.944 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:18.944 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fad68004670 con 0x7fad780ba350 2026-02-25T15:12:18.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1807605974 0 0) 0x7fad68006fa0 con 0x7fad780ba350 2026-02-25T15:12:18.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 10 client.4119.objecter ms_dispatch2 0x7fad78000b90 osd_map(1..1 src has 1..1) 2026-02-25T15:12:18.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 3 client.4119.objecter handle_osd_map got epochs [1,1] > 0 2026-02-25T15:12:18.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 3 client.4119.objecter handle_osd_map decoding full epoch 1 2026-02-25T15:12:18.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.941+0000 7fad5effd640 20 client.4119.objecter dump_active .. 0 homeless 2026-02-25T15:12:18.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.942+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fad78163930 con 0x7fad780ba350 2026-02-25T15:12:18.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.942+0000 7fad5effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:18.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.942+0000 7fad5effd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:18.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.975+0000 7fad7ce7b640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-25T15:12:18.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.975+0000 7fad7ce7b640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-25T15:12:18.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.975+0000 7fad7ce7b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:18.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:18.975+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fad78157650 con 0x7fad780ba350 2026-02-25T15:12:19.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad5effd640 1 -- 10.20.193.78:0/872139462 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7fad68005ee0 con 0x7fad780ba350 2026-02-25T15:12:19.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad5effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-25T15:12:19.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad5effd640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-25T15:12:19.050 INFO:teuthology.orchestra.run.trial078.stderr:adjusted tunables profile to default 2026-02-25T15:12:19.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 10 librados: watch_flush enter 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 10 librados: watch_flush exit 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 20 client.4119.objecter shutdown clearing up homeless session... 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 10 client.4119.objecter successfully canceled tick 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 10 monclient: shutdown 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 >> v1:10.20.193.78:6789/0 conn(0x7fad780ba350 legacy=0x7fad780b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 shutdown_connections 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.048+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 >> 10.20.193.78:0/872139462 conn(0x7fad780b7990 msgr2=0x7fad781667d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:19.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.049+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 shutdown_connections 2026-02-25T15:12:19.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.049+0000 7fad7ce7b640 1 -- 10.20.193.78:0/872139462 wait complete. 2026-02-25T15:12:19.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:19.049+0000 7fad7ce7b640 1 librados: shutdown 2026-02-25T15:12:19.059 INFO:tasks.ceph:check_enable_crimson: False 2026-02-25T15:12:19.059 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-25T15:12:19.059 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:12:19.060 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-25T15:12:19.083 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:12:19.083 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-25T15:12:19.148 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:12:19.148 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-25T15:12:19.214 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-25T15:12:19.214 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-25T15:12:19.278 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:12:19.279 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-25T15:12:19.306 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:12:19.306 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-25T15:12:19.369 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:12:19.369 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-25T15:12:19.434 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-25T15:12:19.434 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-25T15:12:19.444 INFO:tasks.ceph.mgr.y.trial078.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-25T15:12:19.444 INFO:tasks.ceph.mgr.y.trial078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-25T15:12:19.444 INFO:tasks.ceph.mgr.y.trial078.stderr: from numpy import show_config as show_numpy_config 2026-02-25T15:12:19.449 INFO:tasks.ceph.mgr.x.trial174.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-25T15:12:19.449 INFO:tasks.ceph.mgr.x.trial174.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-25T15:12:19.450 INFO:tasks.ceph.mgr.x.trial174.stderr: from numpy import show_config as show_numpy_config 2026-02-25T15:12:19.498 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:12:19.498 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-25T15:12:19.526 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:12:19.526 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-25T15:12:19.590 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:12:19.590 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-25T15:12:19.654 DEBUG:teuthology.orchestra.run.trial167:> set -ex 2026-02-25T15:12:19.654 DEBUG:teuthology.orchestra.run.trial167:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-25T15:12:19.717 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:12:19.717 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-25T15:12:19.742 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:12:19.742 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-25T15:12:19.805 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:12:19.805 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-25T15:12:19.868 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:12:19.868 DEBUG:teuthology.orchestra.run.trial174:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-25T15:12:19.931 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 103f8616-97cb-41dd-a0f9-f0b0e45afa16 0 2026-02-25T15:12:20.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.032+0000 7fba8d3e3640 10 monclient: get_monmap_and_config 2026-02-25T15:12:20.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.032+0000 7fba8d3e3640 10 monclient: build_initial_monmap 2026-02-25T15:12:20.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.032+0000 7fba8d3e3640 10 monclient: monmap: 2026-02-25T15:12:20.035 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:20.035 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.035 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:20.033428+0000 2026-02-25T15:12:20.035 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:20.033428+0000 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 1 Processor -- start 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 1 -- start start 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 10 monclient: init 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:20.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 10 monclient(hunting): picked mon.noname-b con 0x7fba8811c500 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 10 monclient(hunting): picked mon.noname-a con 0x7fba8811e420 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 10 monclient(hunting): picked mon.noname-c con 0x7fba8811ffc0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba88120d10 con 0x7fba8811e420 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba88120f00 con 0x7fba8811c500 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba881210f0 con 0x7fba8811ffc0 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba8d3e3640 10 monclient(hunting): authenticate will time out at 3302.692370s 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba877fe640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fba8811ffc0 0x7fba88120420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:47368/0 (socket says 10.20.193.174:47368) 2026-02-25T15:12:20.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.033+0000 7fba877fe640 1 -- 10.20.193.174:0/3342613831 learned_addr learned my addr 10.20.193.174:0/3342613831 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:20.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 673481775 0 0) 0x7fba881210f0 con 0x7fba8811ffc0 2026-02-25T15:12:20.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): my global_id is 4121 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba74003610 con 0x7fba8811ffc0 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740586656 0 0) 0x7fba88120f00 con 0x7fba8811c500 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): my global_id is 4123 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba881210f0 con 0x7fba8811c500 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408158342 0 0) 0x7fba88120d10 con 0x7fba8811e420 2026-02-25T15:12:20.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 10 monclient(hunting): my global_id is 4122 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.035+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba88120f00 con 0x7fba8811e420 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 21603059 0 0) 0x7fba88120f00 con 0x7fba8811e420 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 >> v1:10.20.193.167:6789/0 conn(0x7fba8811ffc0 legacy=0x7fba88120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 >> v1:10.20.193.155:6789/0 conn(0x7fba8811c500 legacy=0x7fba8811c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 1 monclient: found mon.noname-a 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:20.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba88121380 con 0x7fba8811e420 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 10 monclient: _finish_auth 0 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba8d3e3640 5 monclient: authenticate success, global_id 4122 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba8d3e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fba70002dd0 con 0x7fba8811e420 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba85ffb640 10 monclient: dump: 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.045 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.037+0000 7fba8d3e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba70003010 con 0x7fba8811e420 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba85ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba85ffb640 1 -- 10.20.193.174:0/3342613831 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fba70003450 con 0x7fba8811e420 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba85ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba85ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba85ffb640 10 monclient: dump: 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 4 set_mon_vals no callback set 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 10 monclient: shutdown 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3342613831 >> v1:10.20.193.78:6789/0 conn(0x7fba8811e420 legacy=0x7fba8811e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3342613831 shutdown_connections 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3342613831 >> 10.20.193.174:0/3342613831 conn(0x7fba880588d0 msgr2=0x7fba88058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3342613831 shutdown_connections 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3342613831 wait complete. 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 10 monclient: build_initial_monmap 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 10 monclient: monmap: 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:20.048 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 1 librados: starting msgr at 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 1 librados: starting objecter 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.038+0000 7fba8d3e3640 1 Processor -- start 2026-02-25T15:12:20.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 1 -- start start 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 1 librados: setting wanted keys 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 1 librados: calling monclient init 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 10 monclient: init 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 10 monclient(hunting): picked mon.noname-c con 0x7fba8811c500 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 10 monclient(hunting): picked mon.noname-b con 0x7fba8811e420 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 10 monclient(hunting): picked mon.noname-a con 0x7fba8811ffc0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba88179670 con 0x7fba8811ffc0 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8817a850 con 0x7fba8811e420 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8817ba30 con 0x7fba8811c500 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:20.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba8d3e3640 10 monclient(hunting): authenticate will time out at 3302.698175s 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba86ffd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fba8811c500 0x7fba8812fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:47382/0 (socket says 10.20.193.174:47382) 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba86ffd640 1 -- 10.20.193.174:0/3702064363 learned_addr learned my addr 10.20.193.174:0/3702064363 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba677fe640 10 client.?.objecter ms_handle_connect 0x7fba8811c500 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba677fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba677fe640 10 client.?.objecter ms_handle_connect 0x7fba8811ffc0 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.039+0000 7fba677fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2079401057 0 0) 0x7fba88179670 con 0x7fba8811ffc0 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 10 monclient(hunting): my global_id is 4125 2026-02-25T15:12:20.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba54003610 con 0x7fba8811ffc0 2026-02-25T15:12:20.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288565980 0 0) 0x7fba8817ba30 con 0x7fba8811c500 2026-02-25T15:12:20.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 10 monclient(hunting): my global_id is 4124 2026-02-25T15:12:20.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.040+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba88179670 con 0x7fba8811c500 2026-02-25T15:12:20.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.043+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2766672450 0 0) 0x7fba54003610 con 0x7fba8811ffc0 2026-02-25T15:12:20.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.043+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba8817ba30 con 0x7fba8811ffc0 2026-02-25T15:12:20.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.043+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fba780033b0 con 0x7fba8811ffc0 2026-02-25T15:12:20.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.043+0000 7fba677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:20.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.043+0000 7fba677fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:20.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.043+0000 7fba677fe640 10 monclient(hunting): dump: 2026-02-25T15:12:20.055 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.055 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.043+0000 7fba677fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1545625644 0 0) 0x7fba88179670 con 0x7fba8811c500 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba54003610 con 0x7fba8811c500 2026-02-25T15:12:20.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fba7c003090 con 0x7fba8811c500 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 10 monclient(hunting): dump: 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.057 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1289880376 0 0) 0x7fba8817ba30 con 0x7fba8811ffc0 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 >> v1:10.20.193.167:6789/0 conn(0x7fba8811c500 legacy=0x7fba8812fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 >> v1:10.20.193.155:6789/0 conn(0x7fba8811e420 legacy=0x7fba88176830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 10 monclient: _finish_hunting 0 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 1 monclient: found mon.a 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8817cc10 con 0x7fba8811ffc0 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 10 monclient: _finish_auth 0 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 10 monclient: _check_auth_tickets 2026-02-25T15:12:20.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 5 monclient: authenticate success, global_id 4125 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 10 monclient: _renew_subs 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba88179840 con 0x7fba8811ffc0 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 10 client.4125.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 10 monclient: _renew_subs 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fba88179e80 con 0x7fba8811ffc0 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.044+0000 7fba8d3e3640 1 librados: init done 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.045+0000 7fba8d3e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.045+0000 7fba8d3e3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.045+0000 7fba8d3e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:20.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.045+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8818b560 con 0x7fba8811ffc0 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba78004c50 con 0x7fba8811ffc0 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fba78005060 con 0x7fba8811ffc0 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba857fa640 4 set_mon_vals no callback set 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 10 monclient: dump: 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.060 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fba78005650 con 0x7fba8811ffc0 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 2651964400 0 0) 0x7fba78006e60 con 0x7fba8811ffc0 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 10 client.4125.objecter ms_dispatch2 0x7fba88000b90 osd_map(2..2 src has 1..2) 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 3 client.4125.objecter handle_osd_map got epochs [2,2] > 0 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 3 client.4125.objecter handle_osd_map decoding full epoch 2 2026-02-25T15:12:20.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.046+0000 7fba677fe640 20 client.4125.objecter dump_active .. 0 homeless 2026-02-25T15:12:20.077 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.076+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fba78005970 con 0x7fba8811ffc0 2026-02-25T15:12:20.078 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.076+0000 7fba677fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.078 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.076+0000 7fba677fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:20.111 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.110+0000 7fba8d3e3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "103f8616-97cb-41dd-a0f9-f0b0e45afa16", "id": 0}] 2026-02-25T15:12:20.111 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.110+0000 7fba8d3e3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "103f8616-97cb-41dd-a0f9-f0b0e45afa16", "id": 0}] 2026-02-25T15:12:20.111 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.110+0000 7fba8d3e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:20.111 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.110+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd new", "uuid": "103f8616-97cb-41dd-a0f9-f0b0e45afa16", "id": 0} v 0) -- 0x7fba8817a170 con 0x7fba8811ffc0 2026-02-25T15:12:20.157 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba677fe640 1 -- 10.20.193.174:0/3702064363 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "103f8616-97cb-41dd-a0f9-f0b0e45afa16", "id": 0}]=0 v3) ==== 112+0+2 (unknown 3924867914 0 732707515) 0x7fba78005d20 con 0x7fba8811ffc0 2026-02-25T15:12:20.157 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba677fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "103f8616-97cb-41dd-a0f9-f0b0e45afa16", "id": 0}] 2026-02-25T15:12:20.157 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba677fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:20.158 INFO:teuthology.orchestra.run.trial174.stdout:0 2026-02-25T15:12:20.159 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 10 librados: watch_flush enter 2026-02-25T15:12:20.159 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 10 librados: watch_flush exit 2026-02-25T15:12:20.159 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 20 client.4125.objecter shutdown clearing up homeless session... 2026-02-25T15:12:20.159 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 10 client.4125.objecter successfully canceled tick 2026-02-25T15:12:20.159 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 10 monclient: shutdown 2026-02-25T15:12:20.159 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:20.160 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 >> v1:10.20.193.78:6789/0 conn(0x7fba8811ffc0 legacy=0x7fba88177f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.160 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 shutdown_connections 2026-02-25T15:12:20.160 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.156+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 >> 10.20.193.174:0/3702064363 conn(0x7fba880588d0 msgr2=0x7fba88058ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:20.160 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.157+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 shutdown_connections 2026-02-25T15:12:20.160 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.157+0000 7fba8d3e3640 1 -- 10.20.193.174:0/3702064363 wait complete. 2026-02-25T15:12:20.160 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.157+0000 7fba8d3e3640 1 librados: shutdown 2026-02-25T15:12:20.166 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 38bba215-85ca-4c94-b874-04b5b8c9e3b4 1 2026-02-25T15:12:20.232 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.229+0000 7fbcb7e82640 10 monclient: get_monmap_and_config 2026-02-25T15:12:20.232 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.229+0000 7fbcb7e82640 10 monclient: build_initial_monmap 2026-02-25T15:12:20.232 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.229+0000 7fbcb7e82640 10 monclient: monmap: 2026-02-25T15:12:20.232 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:20.230426+0000 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:20.230426+0000 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 1 Processor -- start 2026-02-25T15:12:20.233 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 1 -- start start 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 10 monclient: init 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 10 monclient(hunting): picked mon.noname-c con 0x7fbcb011c500 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 10 monclient(hunting): picked mon.noname-b con 0x7fbcb011e420 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 10 monclient(hunting): picked mon.noname-a con 0x7fbcb011ffc0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb0120d10 con 0x7fbcb011ffc0 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb0120f00 con 0x7fbcb011e420 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb01210f0 con 0x7fbcb011c500 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb7e82640 10 monclient(hunting): authenticate will time out at 3302.889472s 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb5bf7640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fbcb011c500 0x7fbcb011c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44796/0 (socket says 10.20.193.174:44796) 2026-02-25T15:12:20.234 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.230+0000 7fbcb5bf7640 1 -- 10.20.193.174:0/1229960004 learned_addr learned my addr 10.20.193.174:0/1229960004 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:20.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7915541 0 0) 0x7fbcb01210f0 con 0x7fbcb011c500 2026-02-25T15:12:20.236 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): my global_id is 4127 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc98003610 con 0x7fbcb011c500 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242319738 0 0) 0x7fbcb0120d10 con 0x7fbcb011ffc0 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): my global_id is 4128 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb01210f0 con 0x7fbcb011ffc0 2026-02-25T15:12:20.237 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359641075 0 0) 0x7fbcb0120f00 con 0x7fbcb011e420 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 10 monclient(hunting): my global_id is 4126 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.232+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb0120d10 con 0x7fbcb011e420 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3611471296 0 0) 0x7fbc98003610 con 0x7fbcb011c500 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 >> v1:10.20.193.155:6789/0 conn(0x7fbcb011e420 legacy=0x7fbcb011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 >> v1:10.20.193.78:6789/0 conn(0x7fbcb011ffc0 legacy=0x7fbcb0120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 10 monclient: _finish_hunting 0 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 1 monclient: found mon.noname-c 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:20.238 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb0121380 con 0x7fbcb011c500 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 10 monclient: _finish_auth 0 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 10 monclient: _check_auth_tickets 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbca0002df0 con 0x7fbcb011c500 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb7e82640 5 monclient: authenticate success, global_id 4127 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb7e82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb4bf5640 10 monclient: dump: 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.239 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.240 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.240 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.240 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.240 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.240 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.240 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.240 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.233+0000 7fbcb7e82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:20.251 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.247+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbca0003030 con 0x7fbcb011c500 2026-02-25T15:12:20.251 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.247+0000 7fbcb4bf5640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:20.251 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.247+0000 7fbcb4bf5640 1 -- 10.20.193.174:0/1229960004 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbca0003470 con 0x7fbcb011c500 2026-02-25T15:12:20.251 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.247+0000 7fbcb4bf5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.251 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.247+0000 7fbcb4bf5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.247+0000 7fbcb4bf5640 10 monclient: dump: 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.252 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.247+0000 7fbcb7e82640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.247+0000 7fbcb7e82640 4 set_mon_vals no callback set 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient: shutdown 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1229960004 >> v1:10.20.193.167:6789/0 conn(0x7fbcb011c500 legacy=0x7fbcb011c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1229960004 shutdown_connections 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1229960004 >> 10.20.193.174:0/1229960004 conn(0x7fbcb00588d0 msgr2=0x7fbcb0058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1229960004 shutdown_connections 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1229960004 wait complete. 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient: build_initial_monmap 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient: monmap: 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:20.253 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 librados: starting msgr at 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 librados: starting objecter 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 Processor -- start 2026-02-25T15:12:20.254 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- start start 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 librados: setting wanted keys 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 librados: calling monclient init 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient: init 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient(hunting): picked mon.noname-a con 0x7fbcb011c500 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient(hunting): picked mon.noname-b con 0x7fbcb011e420 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient(hunting): picked mon.noname-c con 0x7fbcb011ffc0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb0179850 con 0x7fbcb011c500 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb017aa30 con 0x7fbcb011e420 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb017bc10 con 0x7fbcb011ffc0 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:20.255 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.248+0000 7fbcb7e82640 10 monclient(hunting): authenticate will time out at 3302.907973s 2026-02-25T15:12:20.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.249+0000 7fbcb63f8640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fbcb011ffc0 0x7fbcb0178130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44812/0 (socket says 10.20.193.174:44812) 2026-02-25T15:12:20.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.249+0000 7fbcb63f8640 1 -- 10.20.193.174:0/1188355477 learned_addr learned my addr 10.20.193.174:0/1188355477 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:20.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.249+0000 7fbc9e7fc640 10 client.?.objecter ms_handle_connect 0x7fbcb011ffc0 2026-02-25T15:12:20.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.249+0000 7fbc9e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.249+0000 7fbc9e7fc640 10 client.?.objecter ms_handle_connect 0x7fbcb011e420 2026-02-25T15:12:20.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.249+0000 7fbc9e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.249+0000 7fbc9e7fc640 10 client.?.objecter ms_handle_connect 0x7fbcb011c500 2026-02-25T15:12:20.256 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.249+0000 7fbc9e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.259 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399193244 0 0) 0x7fbcb017bc10 con 0x7fbcb011ffc0 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): my global_id is 4130 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc80003610 con 0x7fbcb011ffc0 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476975663 0 0) 0x7fbcb017aa30 con 0x7fbcb011e420 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.260 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): my global_id is 4129 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb017bc10 con 0x7fbcb011e420 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772792568 0 0) 0x7fbcb0179850 con 0x7fbcb011c500 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 10 monclient(hunting): my global_id is 4131 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.250+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb017aa30 con 0x7fbcb011c500 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3677738157 0 0) 0x7fbc80003610 con 0x7fbcb011ffc0 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcb0179850 con 0x7fbcb011ffc0 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbcac003490 con 0x7fbcb011ffc0 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:20.261 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 10 monclient(hunting): dump: 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.262 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3767331847 0 0) 0x7fbcb017aa30 con 0x7fbcb011c500 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc80003610 con 0x7fbcb011c500 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbca00031e0 con 0x7fbcb011c500 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.253+0000 7fbc9e7fc640 10 monclient(hunting): dump: 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.263 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2692933712 0 0) 0x7fbcb0179850 con 0x7fbcb011ffc0 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 >> v1:10.20.193.155:6789/0 conn(0x7fbcb011e420 legacy=0x7fbcb0176a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 >> v1:10.20.193.78:6789/0 conn(0x7fbcb011c500 legacy=0x7fbcb0130060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 1 monclient: found mon.c 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.264 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb017cdf0 con 0x7fbcb011ffc0 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 10 monclient: _finish_auth 0 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbc9e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 5 monclient: authenticate success, global_id 4130 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 10 monclient: _renew_subs 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb017ac00 con 0x7fbcb011ffc0 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 10 client.4130.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 10 monclient: _renew_subs 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbcb017b1f0 con 0x7fbcb011ffc0 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.254+0000 7fbcb7e82640 1 librados: init done 2026-02-25T15:12:20.265 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.255+0000 7fbcb7e82640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.266 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.255+0000 7fbcb7e82640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.266 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.255+0000 7fbcb7e82640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.266 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.255+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb018b560 con 0x7fbcb011ffc0 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.313+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcac0037e0 con 0x7fbcb011ffc0 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.313+0000 7fbc9e7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.313+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbcac003ed0 con 0x7fbcb011ffc0 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.313+0000 7fbc9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.313+0000 7fbc9e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.313+0000 7fbc9ffff640 4 set_mon_vals no callback set 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.313+0000 7fbc9e7fc640 10 monclient: dump: 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.315 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.316 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.316 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.316 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.316 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.316 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.316 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.316 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.315+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fbcac0044c0 con 0x7fbcb011ffc0 2026-02-25T15:12:20.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.315+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 3477361823 0 0) 0x7fbcac006ee0 con 0x7fbcb011ffc0 2026-02-25T15:12:20.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.315+0000 7fbc9e7fc640 10 client.4130.objecter ms_dispatch2 0x7fbcb0000b90 osd_map(3..3 src has 1..3) 2026-02-25T15:12:20.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.315+0000 7fbc9e7fc640 3 client.4130.objecter handle_osd_map got epochs [3,3] > 0 2026-02-25T15:12:20.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.315+0000 7fbc9e7fc640 3 client.4130.objecter handle_osd_map decoding full epoch 3 2026-02-25T15:12:20.317 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.315+0000 7fbc9e7fc640 20 client.4130.objecter dump_active .. 0 homeless 2026-02-25T15:12:20.337 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.335+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fbcac0047e0 con 0x7fbcb011ffc0 2026-02-25T15:12:20.337 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.335+0000 7fbc9e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.337 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.335+0000 7fbc9e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:20.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.369+0000 7fbcb7e82640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "38bba215-85ca-4c94-b874-04b5b8c9e3b4", "id": 1}] 2026-02-25T15:12:20.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.369+0000 7fbcb7e82640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "38bba215-85ca-4c94-b874-04b5b8c9e3b4", "id": 1}] 2026-02-25T15:12:20.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.369+0000 7fbcb7e82640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.371 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.369+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd new", "uuid": "38bba215-85ca-4c94-b874-04b5b8c9e3b4", "id": 1} v 0) -- 0x7fbcb017b990 con 0x7fbcb011ffc0 2026-02-25T15:12:20.436 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.434+0000 7fbc9e7fc640 1 -- 10.20.193.174:0/1188355477 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38bba215-85ca-4c94-b874-04b5b8c9e3b4", "id": 1}]=0 v4) ==== 112+0+2 (unknown 3725360575 0 940483276) 0x7fbcac005c30 con 0x7fbcb011ffc0 2026-02-25T15:12:20.436 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.434+0000 7fbc9e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "38bba215-85ca-4c94-b874-04b5b8c9e3b4", "id": 1}] 2026-02-25T15:12:20.436 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.434+0000 7fbc9e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:20.436 INFO:teuthology.orchestra.run.trial174.stdout:1 2026-02-25T15:12:20.437 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 10 librados: watch_flush enter 2026-02-25T15:12:20.437 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 10 librados: watch_flush exit 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 20 client.4130.objecter shutdown clearing up homeless session... 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 10 client.4130.objecter successfully canceled tick 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 10 monclient: shutdown 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 >> v1:10.20.193.167:6789/0 conn(0x7fbcb011ffc0 legacy=0x7fbcb0178130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 shutdown_connections 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 >> 10.20.193.174:0/1188355477 conn(0x7fbcb00588d0 msgr2=0x7fbcb0059040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 shutdown_connections 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 1 -- 10.20.193.174:0/1188355477 wait complete. 2026-02-25T15:12:20.438 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.435+0000 7fbcb7e82640 1 librados: shutdown 2026-02-25T15:12:20.445 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new c52b2aaa-ad6c-4538-aec9-721e83f3b87b 2 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.508+0000 7f8514c6a640 10 monclient: get_monmap_and_config 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.508+0000 7f8514c6a640 10 monclient: build_initial_monmap 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.508+0000 7f8514c6a640 10 monclient: monmap: 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:20.509357+0000 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:20.509357+0000 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:20.511 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 1 Processor -- start 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 1 -- start start 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 10 monclient: init 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 10 monclient(hunting): picked mon.noname-b con 0x7f851011e790 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 10 monclient(hunting): picked mon.noname-c con 0x7f85101406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 10 monclient(hunting): picked mon.noname-a con 0x7f8510162250 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:20.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8510183fe0 con 0x7f8510162250 2026-02-25T15:12:20.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85101851e0 con 0x7f851011e790 2026-02-25T15:12:20.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85101863e0 con 0x7f85101406c0 2026-02-25T15:12:20.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:20.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f8514c6a640 10 monclient(hunting): authenticate will time out at 3303.168292s 2026-02-25T15:12:20.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f850dd74640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f85101406c0 0x7f8510160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44820/0 (socket says 10.20.193.174:44820) 2026-02-25T15:12:20.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.509+0000 7f850dd74640 1 -- 10.20.193.174:0/982070606 learned_addr learned my addr 10.20.193.174:0/982070606 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:20.518 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788112487 0 0) 0x7f85101863e0 con 0x7f85101406c0 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): my global_id is 4133 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84fc003610 con 0x7f85101406c0 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 363479210 0 0) 0x7f85101851e0 con 0x7f851011e790 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): my global_id is 4132 2026-02-25T15:12:20.519 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85101863e0 con 0x7f851011e790 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1737365354 0 0) 0x7f8510183fe0 con 0x7f8510162250 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 10 monclient(hunting): my global_id is 4134 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.511+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85101851e0 con 0x7f8510162250 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260799840 0 0) 0x7f84fc003610 con 0x7f85101406c0 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 >> v1:10.20.193.155:6789/0 conn(0x7f851011e790 legacy=0x7f851011eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 >> v1:10.20.193.78:6789/0 conn(0x7f8510162250 legacy=0x7f85101826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 10 monclient: _finish_hunting 0 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 1 monclient: found mon.noname-c 2026-02-25T15:12:20.520 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8510187680 con 0x7f85101406c0 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 10 monclient: _finish_auth 0 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 10 monclient: _check_auth_tickets 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f84f8002df0 con 0x7f85101406c0 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f850d573640 10 monclient: dump: 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.521 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f8514c6a640 5 monclient: authenticate success, global_id 4133 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.512+0000 7f8514c6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f84f8003030 con 0x7f85101406c0 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f850d573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f850d573640 1 -- 10.20.193.174:0/982070606 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f84f8003470 con 0x7f85101406c0 2026-02-25T15:12:20.522 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f850d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f850d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f850d573640 10 monclient: dump: 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.523 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 4 set_mon_vals no callback set 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 10 monclient: shutdown 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 1 -- 10.20.193.174:0/982070606 >> v1:10.20.193.167:6789/0 conn(0x7f85101406c0 legacy=0x7f8510160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 1 -- 10.20.193.174:0/982070606 shutdown_connections 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 1 -- 10.20.193.174:0/982070606 >> 10.20.193.174:0/982070606 conn(0x7f85100588d0 msgr2=0x7f8510058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 1 -- 10.20.193.174:0/982070606 shutdown_connections 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.513+0000 7f8514c6a640 1 -- 10.20.193.174:0/982070606 wait complete. 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient: build_initial_monmap 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient: monmap: 2026-02-25T15:12:20.524 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 librados: starting msgr at 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 librados: starting objecter 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:20.525 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 Processor -- start 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 -- start start 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 librados: setting wanted keys 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 librados: calling monclient init 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient: init 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient(hunting): picked mon.noname-b con 0x7f851011e790 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient(hunting): picked mon.noname-c con 0x7f85101406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient(hunting): picked mon.noname-a con 0x7f8510162250 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8510125880 con 0x7f8510162250 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f851012d6e0 con 0x7f851011e790 2026-02-25T15:12:20.526 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f851012e900 con 0x7f85101406c0 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f8514c6a640 10 monclient(hunting): authenticate will time out at 3303.173468s 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f850dd74640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f85101406c0 0x7f8510124ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44824/0 (socket says 10.20.193.174:44824) 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.514+0000 7f850dd74640 1 -- 10.20.193.174:0/2857917843 learned_addr learned my addr 10.20.193.174:0/2857917843 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 client.?.objecter ms_handle_connect 0x7f851011e790 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 client.?.objecter ms_handle_connect 0x7f85101406c0 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 client.?.objecter ms_handle_connect 0x7f8510162250 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826136313 0 0) 0x7f851012e900 con 0x7f85101406c0 2026-02-25T15:12:20.527 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.515+0000 7f84f6ffd640 10 monclient(hunting): my global_id is 4136 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84dc003610 con 0x7f85101406c0 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855568034 0 0) 0x7f851012d6e0 con 0x7f851011e790 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 10 monclient(hunting): my global_id is 4135 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f851012e900 con 0x7f851011e790 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298685587 0 0) 0x7f8510125880 con 0x7f8510162250 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.528 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 10 monclient(hunting): my global_id is 4137 2026-02-25T15:12:20.529 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.516+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f851012d6e0 con 0x7f8510162250 2026-02-25T15:12:20.532 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3388777038 0 0) 0x7f851012e900 con 0x7f851011e790 2026-02-25T15:12:20.532 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8510125880 con 0x7f851011e790 2026-02-25T15:12:20.532 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f85040030b0 con 0x7f851011e790 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): dump: 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.533 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3303840466 0 0) 0x7f84dc003610 con 0x7f85101406c0 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f851012e900 con 0x7f85101406c0 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f84f8003380 con 0x7f85101406c0 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): dump: 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.534 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 770137855 0 0) 0x7f851012d6e0 con 0x7f8510162250 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f84dc003610 con 0x7f8510162250 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8500003490 con 0x7f8510162250 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.518+0000 7f84f6ffd640 10 monclient(hunting): dump: 2026-02-25T15:12:20.535 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3687328350 0 0) 0x7f851012e900 con 0x7f85101406c0 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 >> v1:10.20.193.155:6789/0 conn(0x7f851011e790 legacy=0x7f85101826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 >> v1:10.20.193.78:6789/0 conn(0x7f8510162250 legacy=0x7f8510161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.536 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 1 monclient: found mon.c 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851012fba0 con 0x7f85101406c0 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f84f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 5 monclient: authenticate success, global_id 4136 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 10 monclient: _renew_subs 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f851012eb30 con 0x7f85101406c0 2026-02-25T15:12:20.537 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 10 client.4136.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 10 monclient: _renew_subs 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f851012f170 con 0x7f85101406c0 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 1 librados: init done 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.520+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85101858b0 con 0x7f85101406c0 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.521+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f84f8003520 con 0x7f85101406c0 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.521+0000 7f84f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.521+0000 7f850cd72640 4 set_mon_vals no callback set 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f84f8004ce0 con 0x7f85101406c0 2026-02-25T15:12:20.538 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 10 monclient: dump: 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f84f8005290 con 0x7f85101406c0 2026-02-25T15:12:20.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 1356656273 0 0) 0x7f84f8006b00 con 0x7f85101406c0 2026-02-25T15:12:20.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 10 client.4136.objecter ms_dispatch2 0x7f8510000b90 osd_map(4..4 src has 1..4) 2026-02-25T15:12:20.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 3 client.4136.objecter handle_osd_map got epochs [4,4] > 0 2026-02-25T15:12:20.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.522+0000 7f84f6ffd640 3 client.4136.objecter handle_osd_map decoding full epoch 4 2026-02-25T15:12:20.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.523+0000 7f84f6ffd640 20 client.4136.objecter dump_active .. 0 homeless 2026-02-25T15:12:20.552 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.551+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f84f80065f0 con 0x7f85101406c0 2026-02-25T15:12:20.552 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.551+0000 7f84f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.552 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.551+0000 7f84f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:20.585 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.584+0000 7f8514c6a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c52b2aaa-ad6c-4538-aec9-721e83f3b87b", "id": 2}] 2026-02-25T15:12:20.586 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.584+0000 7f8514c6a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c52b2aaa-ad6c-4538-aec9-721e83f3b87b", "id": 2}] 2026-02-25T15:12:20.586 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.584+0000 7f8514c6a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:20.586 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.584+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd new", "uuid": "c52b2aaa-ad6c-4538-aec9-721e83f3b87b", "id": 2} v 0) -- 0x7f851012f460 con 0x7f85101406c0 2026-02-25T15:12:20.660 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f84f6ffd640 1 -- 10.20.193.174:0/2857917843 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c52b2aaa-ad6c-4538-aec9-721e83f3b87b", "id": 2}]=0 v5) ==== 112+0+2 (unknown 2798919704 0 216599125) 0x7f84f80068e0 con 0x7f85101406c0 2026-02-25T15:12:20.660 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f84f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c52b2aaa-ad6c-4538-aec9-721e83f3b87b", "id": 2}] 2026-02-25T15:12:20.660 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f84f6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:20.660 INFO:teuthology.orchestra.run.trial174.stdout:2 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 10 librados: watch_flush enter 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 10 librados: watch_flush exit 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 20 client.4136.objecter shutdown clearing up homeless session... 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 10 client.4136.objecter successfully canceled tick 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 10 monclient: shutdown 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 >> v1:10.20.193.167:6789/0 conn(0x7f85101406c0 legacy=0x7f8510124ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 shutdown_connections 2026-02-25T15:12:20.662 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 >> 10.20.193.174:0/2857917843 conn(0x7f85100588d0 msgr2=0x7f8510182e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:20.663 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 shutdown_connections 2026-02-25T15:12:20.663 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 1 -- 10.20.193.174:0/2857917843 wait complete. 2026-02-25T15:12:20.663 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.659+0000 7f8514c6a640 1 librados: shutdown 2026-02-25T15:12:20.672 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new d07f6908-52a2-4d9f-b23f-16cd4124aeeb 3 2026-02-25T15:12:20.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient: get_monmap_and_config 2026-02-25T15:12:20.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient: build_initial_monmap 2026-02-25T15:12:20.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient: monmap: 2026-02-25T15:12:20.736 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:20.736 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.737 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:20.735964+0000 2026-02-25T15:12:20.737 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:20.735964+0000 2026-02-25T15:12:20.737 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:20.737 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.737 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:20.737 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:20.737 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:20.737 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 1 Processor -- start 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 1 -- start start 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient: init 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient(hunting): picked mon.noname-a con 0x7fb55011e790 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient(hunting): picked mon.noname-c con 0x7fb5501406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient(hunting): picked mon.noname-b con 0x7fb550162250 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb550183fe0 con 0x7fb55011e790 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5501851e0 con 0x7fb550162250 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5501863e0 con 0x7fb5501406c0 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.735+0000 7fb554a13640 10 monclient(hunting): authenticate will time out at 3303.394953s 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.736+0000 7fb54ed76640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fb550162250 0x7fb5501826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.174:57332/0 (socket says 10.20.193.174:57332) 2026-02-25T15:12:20.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.736+0000 7fb54ed76640 1 -- 10.20.193.174:0/3300887910 learned_addr learned my addr 10.20.193.174:0/3300887910 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:20.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.738+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074359319 0 0) 0x7fb5501851e0 con 0x7fb550162250 2026-02-25T15:12:20.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.738+0000 7fb54d573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.738+0000 7fb54d573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.738+0000 7fb54d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.738+0000 7fb54d573640 10 monclient(hunting): my global_id is 4138 2026-02-25T15:12:20.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.738+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb53c003610 con 0x7fb550162250 2026-02-25T15:12:20.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1492129850 0 0) 0x7fb53c003610 con 0x7fb550162250 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 >> v1:10.20.193.167:6789/0 conn(0x7fb5501406c0 legacy=0x7fb550160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 >> v1:10.20.193.78:6789/0 conn(0x7fb55011e790 legacy=0x7fb55011eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 10 monclient: _finish_hunting 0 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 1 monclient: found mon.noname-b 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb550187680 con 0x7fb550162250 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 10 monclient: _finish_auth 0 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 10 monclient: _check_auth_tickets 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb554a13640 5 monclient: authenticate success, global_id 4138 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb540003170 con 0x7fb550162250 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb554a13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb54d573640 10 monclient: dump: 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.743 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.744 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.744 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.744 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.744 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.744 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.744 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.741+0000 7fb554a13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:20.766 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.762+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5400033f0 con 0x7fb550162250 2026-02-25T15:12:20.766 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.762+0000 7fb54d573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:20.766 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.762+0000 7fb54d573640 1 -- 10.20.193.174:0/3300887910 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb540003830 con 0x7fb550162250 2026-02-25T15:12:20.766 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.762+0000 7fb54d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.762+0000 7fb54d573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.762+0000 7fb54d573640 10 monclient: dump: 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.767 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.762+0000 7fb554a13640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.762+0000 7fb554a13640 4 set_mon_vals no callback set 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient: shutdown 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- 10.20.193.174:0/3300887910 >> v1:10.20.193.155:6789/0 conn(0x7fb550162250 legacy=0x7fb5501826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- 10.20.193.174:0/3300887910 shutdown_connections 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- 10.20.193.174:0/3300887910 >> 10.20.193.174:0/3300887910 conn(0x7fb5500588d0 msgr2=0x7fb550058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- 10.20.193.174:0/3300887910 shutdown_connections 2026-02-25T15:12:20.768 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- 10.20.193.174:0/3300887910 wait complete. 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient: build_initial_monmap 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient: monmap: 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:20.769 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 librados: starting msgr at 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 librados: starting objecter 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 Processor -- start 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- start start 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 librados: setting wanted keys 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 librados: calling monclient init 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient: init 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:20.770 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient(hunting): picked mon.noname-b con 0x7fb55011e790 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient(hunting): picked mon.noname-c con 0x7fb5501406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient(hunting): picked mon.noname-a con 0x7fb550162250 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5501055c0 con 0x7fb550162250 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb55010d400 con 0x7fb55011e790 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb55010e620 con 0x7fb5501406c0 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.763+0000 7fb554a13640 10 monclient(hunting): authenticate will time out at 3303.422850s 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.764+0000 7fb54e575640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fb55011e790 0x7fb5501826c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.174:57336/0 (socket says 10.20.193.174:57336) 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.764+0000 7fb54e575640 1 -- 10.20.193.174:0/2337661376 learned_addr learned my addr 10.20.193.174:0/2337661376 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:20.771 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.764+0000 7fb536ffd640 10 client.?.objecter ms_handle_connect 0x7fb55011e790 2026-02-25T15:12:20.772 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.764+0000 7fb536ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:20.774 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.765+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6225273 0 0) 0x7fb55010d400 con 0x7fb55011e790 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.765+0000 7fb536ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.765+0000 7fb536ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.765+0000 7fb536ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.765+0000 7fb536ffd640 10 monclient(hunting): my global_id is 4141 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.765+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb51c003610 con 0x7fb55011e790 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.767+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1664116868 0 0) 0x7fb51c003610 con 0x7fb55011e790 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.767+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb55010d400 con 0x7fb55011e790 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.767+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb5440040d0 con 0x7fb55011e790 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.767+0000 7fb536ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:20.775 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.767+0000 7fb536ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.767+0000 7fb536ffd640 10 monclient(hunting): dump: 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.776 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.767+0000 7fb536ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2010209872 0 0) 0x7fb55010d400 con 0x7fb55011e790 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 >> v1:10.20.193.167:6789/0 conn(0x7fb5501406c0 legacy=0x7fb550104bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 >> v1:10.20.193.78:6789/0 conn(0x7fb550162250 legacy=0x7fb550161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 1 monclient: found mon.b 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55010f8c0 con 0x7fb55011e790 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 10 monclient: _finish_auth 0 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb536ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:20.777 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 5 monclient: authenticate success, global_id 4141 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 10 monclient: _renew_subs 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb55010e850 con 0x7fb55011e790 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 10 client.4141.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 10 monclient: _renew_subs 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb55010ee90 con 0x7fb55011e790 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 1 librados: init done 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.778 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:20.779 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.769+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb550186ae0 con 0x7fb55011e790 2026-02-25T15:12:20.853 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.851+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5440044a0 con 0x7fb55011e790 2026-02-25T15:12:20.853 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.851+0000 7fb536ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:20.853 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.851+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb5440029c0 con 0x7fb55011e790 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.851+0000 7fb536ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.851+0000 7fb536ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.851+0000 7fb536ffd640 10 monclient: dump: 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:20.854 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:20.855 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:20.855 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:20.855 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:20.855 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.851+0000 7fb54cd72640 4 set_mon_vals no callback set 2026-02-25T15:12:20.855 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.852+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2172328607 0 0) 0x7fb544002ba0 con 0x7fb55011e790 2026-02-25T15:12:20.857 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.856+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 290976027 0 0) 0x7fb544012fe0 con 0x7fb55011e790 2026-02-25T15:12:20.857 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.856+0000 7fb536ffd640 10 client.4141.objecter ms_dispatch2 0x7fb550000b90 osd_map(5..5 src has 1..5) 2026-02-25T15:12:20.857 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.856+0000 7fb536ffd640 3 client.4141.objecter handle_osd_map got epochs [5,5] > 0 2026-02-25T15:12:20.858 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.856+0000 7fb536ffd640 3 client.4141.objecter handle_osd_map decoding full epoch 5 2026-02-25T15:12:20.858 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.856+0000 7fb536ffd640 20 client.4141.objecter dump_active .. 0 homeless 2026-02-25T15:12:20.858 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.856+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fb5440176d0 con 0x7fb55011e790 2026-02-25T15:12:20.858 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.856+0000 7fb536ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:20.858 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.856+0000 7fb536ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:20.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.888+0000 7fb554a13640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d07f6908-52a2-4d9f-b23f-16cd4124aeeb", "id": 3}] 2026-02-25T15:12:20.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.888+0000 7fb554a13640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d07f6908-52a2-4d9f-b23f-16cd4124aeeb", "id": 3}] 2026-02-25T15:12:20.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.888+0000 7fb554a13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:20.890 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:20.888+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d07f6908-52a2-4d9f-b23f-16cd4124aeeb", "id": 3} v 0) -- 0x7fb55010f220 con 0x7fb55011e790 2026-02-25T15:12:21.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.013+0000 7fb536ffd640 1 -- 10.20.193.174:0/2337661376 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d07f6908-52a2-4d9f-b23f-16cd4124aeeb", "id": 3}]=0 v6) ==== 112+0+2 (unknown 815671728 0 525046306) 0x7fb544016fd0 con 0x7fb55011e790 2026-02-25T15:12:21.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.013+0000 7fb536ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d07f6908-52a2-4d9f-b23f-16cd4124aeeb", "id": 3}] 2026-02-25T15:12:21.015 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.013+0000 7fb536ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:21.016 INFO:teuthology.orchestra.run.trial174.stdout:3 2026-02-25T15:12:21.017 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 10 librados: watch_flush enter 2026-02-25T15:12:21.017 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 10 librados: watch_flush exit 2026-02-25T15:12:21.017 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 20 client.4141.objecter shutdown clearing up homeless session... 2026-02-25T15:12:21.017 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 10 client.4141.objecter successfully canceled tick 2026-02-25T15:12:21.017 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 10 monclient: shutdown 2026-02-25T15:12:21.017 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.017 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 >> v1:10.20.193.155:6789/0 conn(0x7fb55011e790 legacy=0x7fb5501826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 shutdown_connections 2026-02-25T15:12:21.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 >> 10.20.193.174:0/2337661376 conn(0x7fb5500588d0 msgr2=0x7fb55011f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 shutdown_connections 2026-02-25T15:12:21.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 1 -- 10.20.193.174:0/2337661376 wait complete. 2026-02-25T15:12:21.018 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.014+0000 7fb554a13640 1 librados: shutdown 2026-02-25T15:12:21.025 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 432be5b2-4fae-4259-ba4e-f5c9383c02d7 4 2026-02-25T15:12:21.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient: get_monmap_and_config 2026-02-25T15:12:21.090 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient: build_initial_monmap 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient: monmap: 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:21.088890+0000 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:21.088890+0000 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.091 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 1 Processor -- start 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 1 -- start start 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient: init 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient(hunting): picked mon.noname-c con 0x7f0b2c11c500 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient(hunting): picked mon.noname-a con 0x7f0b2c11e420 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient(hunting): picked mon.noname-b con 0x7f0b2c11ffc0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c120d10 con 0x7f0b2c11e420 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c120f00 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c1210f0 con 0x7f0b2c11c500 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:21.092 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.088+0000 7f0b3385c640 10 monclient(hunting): authenticate will time out at 3303.747838s 2026-02-25T15:12:21.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.089+0000 7f0b30dd0640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f0b2c11e420 0x7f0b2c11e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.174:43682/0 (socket says 10.20.193.174:43682) 2026-02-25T15:12:21.093 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.089+0000 7f0b30dd0640 1 -- 10.20.193.174:0/1086343904 learned_addr learned my addr 10.20.193.174:0/1086343904 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:21.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.091+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441345901 0 0) 0x7f0b2c120d10 con 0x7f0b2c11e420 2026-02-25T15:12:21.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.091+0000 7f0b1bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.091+0000 7f0b1bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.091+0000 7f0b1bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.091+0000 7f0b1bfff640 10 monclient(hunting): my global_id is 4146 2026-02-25T15:12:21.094 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.091+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b14003610 con 0x7f0b2c11e420 2026-02-25T15:12:21.098 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3871316649 0 0) 0x7f0b14003610 con 0x7f0b2c11e420 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 >> v1:10.20.193.167:6789/0 conn(0x7f0b2c11c500 legacy=0x7f0b2c11c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 >> v1:10.20.193.155:6789/0 conn(0x7f0b2c11ffc0 legacy=0x7f0b2c120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 1 monclient: found mon.noname-a 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c121380 con 0x7f0b2c11e420 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 10 monclient: _finish_auth 0 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:12:21.099 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b3385c640 5 monclient: authenticate success, global_id 4146 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b3385c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0b20002df0 con 0x7f0b2c11e420 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b1bfff640 10 monclient: dump: 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.100 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.093+0000 7f0b3385c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b200030b0 con 0x7f0b2c11e420 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b1bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:21.101 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 4 set_mon_vals no callback set 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b1bfff640 1 -- 10.20.193.174:0/1086343904 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0b200034f0 con 0x7f0b2c11e420 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b1bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b1bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b1bfff640 10 monclient: dump: 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.102 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 10 monclient: shutdown 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 1 -- 10.20.193.174:0/1086343904 >> v1:10.20.193.78:6789/0 conn(0x7f0b2c11e420 legacy=0x7f0b2c11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 1 -- 10.20.193.174:0/1086343904 shutdown_connections 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 1 -- 10.20.193.174:0/1086343904 >> 10.20.193.174:0/1086343904 conn(0x7f0b2c0588d0 msgr2=0x7f0b2c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 1 -- 10.20.193.174:0/1086343904 shutdown_connections 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 1 -- 10.20.193.174:0/1086343904 wait complete. 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 10 monclient: build_initial_monmap 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.094+0000 7f0b3385c640 10 monclient: monmap: 2026-02-25T15:12:21.103 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 librados: starting msgr at 2026-02-25T15:12:21.104 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 librados: starting objecter 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 Processor -- start 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 -- start start 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 librados: setting wanted keys 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 librados: calling monclient init 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 10 monclient: init 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 10 monclient(hunting): picked mon.noname-b con 0x7f0b2c11c500 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 10 monclient(hunting): picked mon.noname-c con 0x7f0b2c11e420 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 10 monclient(hunting): picked mon.noname-a con 0x7f0b2c11ffc0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:21.105 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c179360 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c17a540 con 0x7f0b2c11c500 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c17b720 con 0x7f0b2c11e420 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b3385c640 10 monclient(hunting): authenticate will time out at 3303.754268s 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b31dd2640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f0b2c11ffc0 0x7f0b2c177c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.174:43684/0 (socket says 10.20.193.174:43684) 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b31dd2640 1 -- 10.20.193.174:0/2186258057 learned_addr learned my addr 10.20.193.174:0/2186258057 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b19ffb640 10 client.?.objecter ms_handle_connect 0x7f0b2c11ffc0 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.095+0000 7f0b19ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.097+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385660831 0 0) 0x7f0b2c179360 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.097+0000 7f0b19ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.106 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.097+0000 7f0b19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.107 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.097+0000 7f0b19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.107 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.097+0000 7f0b19ffb640 10 monclient(hunting): my global_id is 4149 2026-02-25T15:12:21.107 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.097+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0afc003610 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.107 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.097+0000 7f0b19ffb640 10 client.?.objecter ms_handle_connect 0x7f0b2c11e420 2026-02-25T15:12:21.107 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.097+0000 7f0b19ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.098+0000 7f0b19ffb640 10 client.?.objecter ms_handle_connect 0x7f0b2c11c500 2026-02-25T15:12:21.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.098+0000 7f0b19ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.101+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 717022829 0 0) 0x7f0afc003610 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.108 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.101+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b2c179360 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.101+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0b280032d0 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.101+0000 7f0b19ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.101+0000 7f0b19ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.101+0000 7f0b19ffb640 10 monclient(hunting): dump: 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.109 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.110 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.110 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.110 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.110 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.101+0000 7f0b19ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:21.125 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 142071670 0 0) 0x7f0b2c179360 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.125 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 >> v1:10.20.193.167:6789/0 conn(0x7f0b2c11e420 legacy=0x7f0b2c176520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.125 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 >> v1:10.20.193.155:6789/0 conn(0x7f0b2c11c500 legacy=0x7f0b2c12fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.125 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:12:21.125 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 1 monclient: found mon.a 2026-02-25T15:12:21.125 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:21.125 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c17c900 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 10 monclient: _finish_auth 0 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 5 monclient: authenticate success, global_id 4149 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 10 monclient: _renew_subs 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c17b8f0 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 10 client.4149.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 10 monclient: _renew_subs 2026-02-25T15:12:21.126 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:21.127 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0b2c17bf30 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.127 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.122+0000 7f0b3385c640 1 librados: init done 2026-02-25T15:12:21.127 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.123+0000 7f0b3385c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.127 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.123+0000 7f0b3385c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.127 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.123+0000 7f0b3385c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:21.127 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.123+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c18b730 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.127+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b28003950 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.127+0000 7f0b19ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.127+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0b28004f10 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.127+0000 7f0b19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.127+0000 7f0b19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.127+0000 7f0b1b7fe640 4 set_mon_vals no callback set 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.127+0000 7f0b19ffb640 10 monclient: dump: 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.129 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.130 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.130 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.130 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.130 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.130 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.130 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.130 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.130 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.131 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.128+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2172328607 0 0) 0x7f0b28011790 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.131 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.128+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 220454600 0 0) 0x7f0b2804d260 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.131 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.128+0000 7f0b19ffb640 10 client.4149.objecter ms_dispatch2 0x7f0b2c000b90 osd_map(6..6 src has 1..6) 2026-02-25T15:12:21.131 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.128+0000 7f0b19ffb640 3 client.4149.objecter handle_osd_map got epochs [6,6] > 0 2026-02-25T15:12:21.131 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.128+0000 7f0b19ffb640 3 client.4149.objecter handle_osd_map decoding full epoch 6 2026-02-25T15:12:21.132 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.128+0000 7f0b19ffb640 20 client.4149.objecter dump_active .. 0 homeless 2026-02-25T15:12:21.158 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.156+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f0b28017990 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.158 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.156+0000 7f0b19ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.158 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.156+0000 7f0b19ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:21.191 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.190+0000 7f0b3385c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "432be5b2-4fae-4259-ba4e-f5c9383c02d7", "id": 4}] 2026-02-25T15:12:21.192 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.190+0000 7f0b3385c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "432be5b2-4fae-4259-ba4e-f5c9383c02d7", "id": 4}] 2026-02-25T15:12:21.192 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.190+0000 7f0b3385c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:21.192 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.190+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd new", "uuid": "432be5b2-4fae-4259-ba4e-f5c9383c02d7", "id": 4} v 0) -- 0x7f0b2c17c270 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.208 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b19ffb640 1 -- 10.20.193.174:0/2186258057 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "432be5b2-4fae-4259-ba4e-f5c9383c02d7", "id": 4}]=0 v7) ==== 112+0+2 (unknown 1889718899 0 1697012583) 0x7f0b28017290 con 0x7f0b2c11ffc0 2026-02-25T15:12:21.208 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b19ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "432be5b2-4fae-4259-ba4e-f5c9383c02d7", "id": 4}] 2026-02-25T15:12:21.208 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b19ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:21.209 INFO:teuthology.orchestra.run.trial174.stdout:4 2026-02-25T15:12:21.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 10 librados: watch_flush enter 2026-02-25T15:12:21.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 10 librados: watch_flush exit 2026-02-25T15:12:21.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 20 client.4149.objecter shutdown clearing up homeless session... 2026-02-25T15:12:21.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 10 client.4149.objecter successfully canceled tick 2026-02-25T15:12:21.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 10 monclient: shutdown 2026-02-25T15:12:21.210 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 >> v1:10.20.193.78:6789/0 conn(0x7f0b2c11ffc0 legacy=0x7f0b2c177c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 shutdown_connections 2026-02-25T15:12:21.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 >> 10.20.193.174:0/2186258057 conn(0x7f0b2c0588d0 msgr2=0x7f0b2c05c940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 shutdown_connections 2026-02-25T15:12:21.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 1 -- 10.20.193.174:0/2186258057 wait complete. 2026-02-25T15:12:21.211 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.207+0000 7f0b3385c640 1 librados: shutdown 2026-02-25T15:12:21.215 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 0e76930a-01c4-4f57-ad02-e0e515ea5337 5 2026-02-25T15:12:21.279 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient: get_monmap_and_config 2026-02-25T15:12:21.279 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient: build_initial_monmap 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient: monmap: 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:21.278887+0000 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:21.278887+0000 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:21.280 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:21.281 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 1 Processor -- start 2026-02-25T15:12:21.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 1 -- start start 2026-02-25T15:12:21.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient: init 2026-02-25T15:12:21.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:21.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:12:21.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient(hunting): picked mon.noname-a con 0x7f26fc11e790 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient(hunting): picked mon.noname-c con 0x7f26fc1406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient(hunting): picked mon.noname-b con 0x7f26fc162250 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc183fe0 con 0x7f26fc11e790 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc1851e0 con 0x7f26fc162250 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc1863e0 con 0x7f26fc1406c0 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.278+0000 7f270105b640 10 monclient(hunting): authenticate will time out at 3303.937819s 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.279+0000 7f26fa575640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f26fc1406c0 0x7f26fc160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44864/0 (socket says 10.20.193.174:44864) 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.279+0000 7f26fa575640 1 -- 10.20.193.174:0/1980678517 learned_addr learned my addr 10.20.193.174:0/1980678517 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406061169 0 0) 0x7f26fc183fe0 con 0x7f26fc11e790 2026-02-25T15:12:21.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): my global_id is 4152 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26e8003610 con 0x7f26fc11e790 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266491160 0 0) 0x7f26fc1863e0 con 0x7f26fc1406c0 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): my global_id is 4154 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26fc183fe0 con 0x7f26fc1406c0 2026-02-25T15:12:21.285 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470551616 0 0) 0x7f26fc1851e0 con 0x7f26fc162250 2026-02-25T15:12:21.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 10 monclient(hunting): my global_id is 4153 2026-02-25T15:12:21.286 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.280+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26fc1863e0 con 0x7f26fc162250 2026-02-25T15:12:21.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3647485680 0 0) 0x7f26fc183fe0 con 0x7f26fc1406c0 2026-02-25T15:12:21.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 >> v1:10.20.193.155:6789/0 conn(0x7f26fc162250 legacy=0x7f26fc1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 >> v1:10.20.193.78:6789/0 conn(0x7f26fc11e790 legacy=0x7f26fc11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.293 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 10 monclient: _finish_hunting 0 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 1 monclient: found mon.noname-c 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc187680 con 0x7f26fc1406c0 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 10 monclient: _finish_auth 0 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 10 monclient: _check_auth_tickets 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f26e4002df0 con 0x7f26fc1406c0 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.294 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f26f9d74640 10 monclient: dump: 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.295 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f270105b640 5 monclient: authenticate success, global_id 4154 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.282+0000 7f270105b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26e4003030 con 0x7f26fc1406c0 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f26f9d74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f26f9d74640 1 -- 10.20.193.174:0/1980678517 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f26e4003470 con 0x7f26fc1406c0 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f26f9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f26f9d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f26f9d74640 10 monclient: dump: 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.296 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 4 set_mon_vals no callback set 2026-02-25T15:12:21.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 10 monclient: shutdown 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 1 -- 10.20.193.174:0/1980678517 >> v1:10.20.193.167:6789/0 conn(0x7f26fc1406c0 legacy=0x7f26fc160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 1 -- 10.20.193.174:0/1980678517 shutdown_connections 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 1 -- 10.20.193.174:0/1980678517 >> 10.20.193.174:0/1980678517 conn(0x7f26fc0588d0 msgr2=0x7f26fc058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 1 -- 10.20.193.174:0/1980678517 shutdown_connections 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 1 -- 10.20.193.174:0/1980678517 wait complete. 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 10 monclient: build_initial_monmap 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 10 monclient: monmap: 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:21.298 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 1 librados: starting msgr at 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.283+0000 7f270105b640 1 librados: starting objecter 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:21.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 1 Processor -- start 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 1 -- start start 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 1 librados: setting wanted keys 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 1 librados: calling monclient init 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 10 monclient: init 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 10 monclient(hunting): picked mon.noname-a con 0x7f26fc11e790 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 10 monclient(hunting): picked mon.noname-c con 0x7f26fc1406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 10 monclient(hunting): picked mon.noname-b con 0x7f26fc162250 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc125690 con 0x7f26fc11e790 2026-02-25T15:12:21.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc12d4f0 con 0x7f26fc162250 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc12e710 con 0x7f26fc1406c0 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f270105b640 10 monclient(hunting): authenticate will time out at 3303.943251s 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f26fb577640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f26fc162250 0x7f26fc161ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.174:57372/0 (socket says 10.20.193.174:57372) 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f26fb577640 1 -- 10.20.193.174:0/3398292595 learned_addr learned my addr 10.20.193.174:0/3398292595 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f26db7fe640 10 client.?.objecter ms_handle_connect 0x7f26fc11e790 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f26db7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f26db7fe640 10 client.?.objecter ms_handle_connect 0x7f26fc162250 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f26db7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.301 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f26db7fe640 10 client.?.objecter ms_handle_connect 0x7f26fc1406c0 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.284+0000 7f26db7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125050688 0 0) 0x7f26fc12d4f0 con 0x7f26fc162250 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): my global_id is 4156 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c8003610 con 0x7f26fc162250 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363430576 0 0) 0x7f26fc125690 con 0x7f26fc11e790 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.302 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): my global_id is 4155 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26fc12d4f0 con 0x7f26fc11e790 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156868216 0 0) 0x7f26fc12e710 con 0x7f26fc1406c0 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 10 monclient(hunting): my global_id is 4157 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.285+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26fc125690 con 0x7f26fc1406c0 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1138458711 0 0) 0x7f26fc125690 con 0x7f26fc1406c0 2026-02-25T15:12:21.303 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26fc12e710 con 0x7f26fc1406c0 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f26e4003380 con 0x7f26fc1406c0 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): dump: 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.304 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3928952743 0 0) 0x7f26fc12d4f0 con 0x7f26fc11e790 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26fc125690 con 0x7f26fc11e790 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f26f00030b0 con 0x7f26fc11e790 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): dump: 2026-02-25T15:12:21.305 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.306 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1578693095 0 0) 0x7f26c8003610 con 0x7f26fc162250 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26fc12d4f0 con 0x7f26fc162250 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f26ec003470 con 0x7f26fc162250 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.288+0000 7f26db7fe640 10 monclient(hunting): dump: 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.307 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 707303571 0 0) 0x7f26fc12e710 con 0x7f26fc1406c0 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 >> v1:10.20.193.155:6789/0 conn(0x7f26fc162250 legacy=0x7f26fc161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 >> v1:10.20.193.78:6789/0 conn(0x7f26fc11e790 legacy=0x7f26fc1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 1 monclient: found mon.c 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:21.308 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc12f9b0 con 0x7f26fc1406c0 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 10 monclient: _finish_auth 0 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f26db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 5 monclient: authenticate success, global_id 4157 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 10 monclient: _renew_subs 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f26fc12d720 con 0x7f26fc1406c0 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 10 client.4157.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 10 monclient: _renew_subs 2026-02-25T15:12:21.309 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f26fc12dd10 con 0x7f26fc1406c0 2026-02-25T15:12:21.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.289+0000 7f270105b640 1 librados: init done 2026-02-25T15:12:21.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.290+0000 7f270105b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.290+0000 7f270105b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.290+0000 7f270105b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.310 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.290+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26fc1846b0 con 0x7f26fc1406c0 2026-02-25T15:12:21.311 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.294+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26e4002fb0 con 0x7f26fc1406c0 2026-02-25T15:12:21.311 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.294+0000 7f26db7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.294+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f26e4004e80 con 0x7f26fc1406c0 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.294+0000 7f26db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.294+0000 7f26db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.294+0000 7f26db7fe640 10 monclient: dump: 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.312 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.294+0000 7f26f9573640 4 set_mon_vals no callback set 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.295+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2172328607 0 0) 0x7f26e4011560 con 0x7f26fc1406c0 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.295+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 735886998 0 0) 0x7f26e404cca0 con 0x7f26fc1406c0 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.295+0000 7f26db7fe640 10 client.4157.objecter ms_dispatch2 0x7f26fc000b90 osd_map(7..7 src has 1..7) 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.295+0000 7f26db7fe640 3 client.4157.objecter handle_osd_map got epochs [7,7] > 0 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.295+0000 7f26db7fe640 3 client.4157.objecter handle_osd_map decoding full epoch 7 2026-02-25T15:12:21.313 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.295+0000 7f26db7fe640 20 client.4157.objecter dump_active .. 0 homeless 2026-02-25T15:12:21.325 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.323+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f26e4017420 con 0x7f26fc1406c0 2026-02-25T15:12:21.325 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.323+0000 7f26db7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.325 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.323+0000 7f26db7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:21.357 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.356+0000 7f270105b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0e76930a-01c4-4f57-ad02-e0e515ea5337", "id": 5}] 2026-02-25T15:12:21.358 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.356+0000 7f270105b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0e76930a-01c4-4f57-ad02-e0e515ea5337", "id": 5}] 2026-02-25T15:12:21.358 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.356+0000 7f270105b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.358 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.356+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd new", "uuid": "0e76930a-01c4-4f57-ad02-e0e515ea5337", "id": 5} v 0) -- 0x7f26fc12e050 con 0x7f26fc1406c0 2026-02-25T15:12:21.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.392+0000 7f26db7fe640 1 -- 10.20.193.174:0/3398292595 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e76930a-01c4-4f57-ad02-e0e515ea5337", "id": 5}]=0 v8) ==== 112+0+2 (unknown 869284217 0 1988412176) 0x7f26e4016d20 con 0x7f26fc1406c0 2026-02-25T15:12:21.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.392+0000 7f26db7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0e76930a-01c4-4f57-ad02-e0e515ea5337", "id": 5}] 2026-02-25T15:12:21.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.392+0000 7f26db7fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:21.394 INFO:teuthology.orchestra.run.trial174.stdout:5 2026-02-25T15:12:21.395 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.392+0000 7f270105b640 10 librados: watch_flush enter 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.392+0000 7f270105b640 10 librados: watch_flush exit 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.392+0000 7f270105b640 20 client.4157.objecter shutdown clearing up homeless session... 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 10 client.4157.objecter successfully canceled tick 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 10 monclient: shutdown 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 >> v1:10.20.193.167:6789/0 conn(0x7f26fc1406c0 legacy=0x7f26fc124cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 shutdown_connections 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 >> 10.20.193.174:0/3398292595 conn(0x7f26fc0588d0 msgr2=0x7f26fc183310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 shutdown_connections 2026-02-25T15:12:21.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 1 -- 10.20.193.174:0/3398292595 wait complete. 2026-02-25T15:12:21.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.393+0000 7f270105b640 1 librados: shutdown 2026-02-25T15:12:21.402 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new cc9df2ee-02c5-41ab-9841-4bcc3839e76e 6 2026-02-25T15:12:21.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.464+0000 7f63d5ad8640 10 monclient: get_monmap_and_config 2026-02-25T15:12:21.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.464+0000 7f63d5ad8640 10 monclient: build_initial_monmap 2026-02-25T15:12:21.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.464+0000 7f63d5ad8640 10 monclient: monmap: 2026-02-25T15:12:21.466 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:21.466 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.466 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:21.465460+0000 2026-02-25T15:12:21.466 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:21.465460+0000 2026-02-25T15:12:21.467 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:21.467 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.467 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:21.467 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:21.467 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:21.467 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.469 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 1 Processor -- start 2026-02-25T15:12:21.469 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 1 -- start start 2026-02-25T15:12:21.469 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 10 monclient: init 2026-02-25T15:12:21.469 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:21.469 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:12:21.469 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 10 monclient(hunting): picked mon.noname-c con 0x7f63d011e790 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:21.469 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 10 monclient(hunting): picked mon.noname-a con 0x7f63d01406c0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:21.470 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 10 monclient(hunting): picked mon.noname-b con 0x7f63d0162250 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:21.470 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d0183fe0 con 0x7f63d01406c0 2026-02-25T15:12:21.470 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d01851e0 con 0x7f63d0162250 2026-02-25T15:12:21.470 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d01863e0 con 0x7f63d011e790 2026-02-25T15:12:21.470 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:21.470 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.465+0000 7f63d5ad8640 10 monclient(hunting): authenticate will time out at 3304.124467s 2026-02-25T15:12:21.470 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.466+0000 7f63ceffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f63d01406c0 0x7f63d0160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.174:43694/0 (socket says 10.20.193.174:43694) 2026-02-25T15:12:21.470 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.466+0000 7f63ceffd640 1 -- 10.20.193.174:0/1715717971 learned_addr learned my addr 10.20.193.174:0/1715717971 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:21.494 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.493+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309571435 0 0) 0x7f63d01851e0 con 0x7f63d0162250 2026-02-25T15:12:21.494 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.493+0000 7f63ce7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.494 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.493+0000 7f63ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.495 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.493+0000 7f63ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.495 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.493+0000 7f63ce7fc640 10 monclient(hunting): my global_id is 4159 2026-02-25T15:12:21.495 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.493+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b4003610 con 0x7f63d0162250 2026-02-25T15:12:21.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 527227553 0 0) 0x7f63b4003610 con 0x7f63d0162250 2026-02-25T15:12:21.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 >> v1:10.20.193.167:6789/0 conn(0x7f63d011e790 legacy=0x7f63d011eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 >> v1:10.20.193.78:6789/0 conn(0x7f63d01406c0 legacy=0x7f63d0160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:12:21.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 1 monclient: found mon.noname-b 2026-02-25T15:12:21.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:21.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:12:21.500 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d0187680 con 0x7f63d0162250 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: _finish_auth 0 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f63c4003170 con 0x7f63d0162250 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: dump: 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.501 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63d5ad8640 5 monclient: authenticate success, global_id 4159 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63d5ad8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63c40033f0 con 0x7f63d0162250 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:21.502 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 1 -- 10.20.193.174:0/1715717971 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f63c40037f0 con 0x7f63d0162250 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63d5ad8640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63d5ad8640 4 set_mon_vals no callback set 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.495+0000 7f63ce7fc640 10 monclient: dump: 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.503 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient: shutdown 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1715717971 >> v1:10.20.193.155:6789/0 conn(0x7f63d0162250 legacy=0x7f63d01826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1715717971 shutdown_connections 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1715717971 >> 10.20.193.174:0/1715717971 conn(0x7f63d00588d0 msgr2=0x7f63d0058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.504 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1715717971 shutdown_connections 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1715717971 wait complete. 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient: build_initial_monmap 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient: monmap: 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:21.505 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 librados: starting msgr at 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 librados: starting objecter 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 Processor -- start 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- start start 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 librados: setting wanted keys 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 librados: calling monclient init 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient: init 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:21.506 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient(hunting): picked mon.noname-a con 0x7f63d011e790 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient(hunting): picked mon.noname-c con 0x7f63d01406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient(hunting): picked mon.noname-b con 0x7f63d0162250 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d0104900 con 0x7f63d011e790 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d010c740 con 0x7f63d0162250 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d010d960 con 0x7f63d01406c0 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.496+0000 7f63d5ad8640 10 monclient(hunting): authenticate will time out at 3304.155828s 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.497+0000 7f63ceffd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f63d01406c0 0x7f63d0103f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44896/0 (socket says 10.20.193.174:44896) 2026-02-25T15:12:21.507 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.497+0000 7f63ceffd640 1 -- 10.20.193.174:0/1588347077 learned_addr learned my addr 10.20.193.174:0/1588347077 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.497+0000 7f63abfff640 10 client.?.objecter ms_handle_connect 0x7f63d01406c0 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.497+0000 7f63abfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.497+0000 7f63abfff640 10 client.?.objecter ms_handle_connect 0x7f63d0162250 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.497+0000 7f63abfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.498+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2697930564 0 0) 0x7f63d010c740 con 0x7f63d0162250 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.498+0000 7f63abfff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.498+0000 7f63abfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.498+0000 7f63abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.498+0000 7f63abfff640 10 monclient(hunting): my global_id is 4162 2026-02-25T15:12:21.508 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.498+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63a0003610 con 0x7f63d0162250 2026-02-25T15:12:21.511 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.500+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 808927848 0 0) 0x7f63a0003610 con 0x7f63d0162250 2026-02-25T15:12:21.511 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.500+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63d010c740 con 0x7f63d0162250 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.500+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f63c4003080 con 0x7f63d0162250 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.500+0000 7f63abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.500+0000 7f63abfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.500+0000 7f63abfff640 10 monclient(hunting): dump: 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.512 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.500+0000 7f63abfff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2829525774 0 0) 0x7f63d010c740 con 0x7f63d0162250 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 >> v1:10.20.193.167:6789/0 conn(0x7f63d01406c0 legacy=0x7f63d0103f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 >> v1:10.20.193.78:6789/0 conn(0x7f63d011e790 legacy=0x7f63d01826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 10 monclient: _finish_hunting 0 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 1 monclient: found mon.b 2026-02-25T15:12:21.513 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d010ec00 con 0x7f63d0162250 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 10 monclient: _finish_auth 0 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 10 monclient: _check_auth_tickets 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 5 monclient: authenticate success, global_id 4162 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 10 monclient: _renew_subs 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63d010c970 con 0x7f63d0162250 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 10 client.4162.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 10 monclient: _renew_subs 2026-02-25T15:12:21.514 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63d010cfb0 con 0x7f63d0162250 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.502+0000 7f63d5ad8640 1 librados: init done 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.503+0000 7f63d5ad8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.503+0000 7f63d5ad8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.503+0000 7f63d5ad8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.503+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d01858e0 con 0x7f63d0162250 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.507+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63c40032d0 con 0x7f63d0162250 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.507+0000 7f63abfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.507+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f63c4003f70 con 0x7f63d0162250 2026-02-25T15:12:21.515 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.507+0000 7f63abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.507+0000 7f63abfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.507+0000 7f63abfff640 10 monclient: dump: 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.516 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.517 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.507+0000 7f63cdffb640 4 set_mon_vals no callback set 2026-02-25T15:12:21.517 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.508+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2172328607 0 0) 0x7f63c40107f0 con 0x7f63d0162250 2026-02-25T15:12:21.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.537+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 1536363227 0 0) 0x7f63c4012140 con 0x7f63d0162250 2026-02-25T15:12:21.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.537+0000 7f63abfff640 10 client.4162.objecter ms_dispatch2 0x7f63d0000b90 osd_map(8..8 src has 1..8) 2026-02-25T15:12:21.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.537+0000 7f63abfff640 3 client.4162.objecter handle_osd_map got epochs [8,8] > 0 2026-02-25T15:12:21.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.537+0000 7f63abfff640 3 client.4162.objecter handle_osd_map decoding full epoch 8 2026-02-25T15:12:21.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.537+0000 7f63abfff640 20 client.4162.objecter dump_active .. 0 homeless 2026-02-25T15:12:21.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.537+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f63c40167b0 con 0x7f63d0162250 2026-02-25T15:12:21.539 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.537+0000 7f63abfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.540 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.537+0000 7f63abfff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:21.571 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.570+0000 7f63d5ad8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "cc9df2ee-02c5-41ab-9841-4bcc3839e76e", "id": 6}] 2026-02-25T15:12:21.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.570+0000 7f63d5ad8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "cc9df2ee-02c5-41ab-9841-4bcc3839e76e", "id": 6}] 2026-02-25T15:12:21.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.570+0000 7f63d5ad8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:21.572 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.570+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "cc9df2ee-02c5-41ab-9841-4bcc3839e76e", "id": 6} v 0) -- 0x7f63d010d2f0 con 0x7f63d0162250 2026-02-25T15:12:21.609 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.607+0000 7f63abfff640 1 -- 10.20.193.174:0/1588347077 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc9df2ee-02c5-41ab-9841-4bcc3839e76e", "id": 6}]=0 v9) ==== 112+0+2 (unknown 2147067917 0 1113811849) 0x7f63c40160b0 con 0x7f63d0162250 2026-02-25T15:12:21.609 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.607+0000 7f63abfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "cc9df2ee-02c5-41ab-9841-4bcc3839e76e", "id": 6}] 2026-02-25T15:12:21.609 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.607+0000 7f63abfff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:21.609 INFO:teuthology.orchestra.run.trial174.stdout:6 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 10 librados: watch_flush enter 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 10 librados: watch_flush exit 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 20 client.4162.objecter shutdown clearing up homeless session... 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 10 client.4162.objecter successfully canceled tick 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 10 monclient: shutdown 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 >> v1:10.20.193.155:6789/0 conn(0x7f63d0162250 legacy=0x7f63d0161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 shutdown_connections 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 >> 10.20.193.174:0/1588347077 conn(0x7f63d00588d0 msgr2=0x7f63d0182eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 shutdown_connections 2026-02-25T15:12:21.611 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 1 -- 10.20.193.174:0/1588347077 wait complete. 2026-02-25T15:12:21.612 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.608+0000 7f63d5ad8640 1 librados: shutdown 2026-02-25T15:12:21.617 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 9b16da96-8cc4-4b91-91cb-2ca1e6917bd6 7 2026-02-25T15:12:21.682 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient: get_monmap_and_config 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient: build_initial_monmap 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient: monmap: 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:21.680641+0000 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:21.680641+0000 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:21.683 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 1 Processor -- start 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 1 -- start start 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient: init 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient(hunting): picked mon.noname-a con 0x7f8b2811e790 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient(hunting): picked mon.noname-c con 0x7f8b281406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient(hunting): picked mon.noname-b con 0x7f8b28162250 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b28183fe0 con 0x7f8b2811e790 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b281851e0 con 0x7f8b28162250 2026-02-25T15:12:21.684 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b281863e0 con 0x7f8b281406c0 2026-02-25T15:12:21.685 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:21.685 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.680+0000 7f8b2db9b640 10 monclient(hunting): authenticate will time out at 3304.339587s 2026-02-25T15:12:21.685 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.681+0000 7f8b26ffd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f8b281406c0 0x7f8b28160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44904/0 (socket says 10.20.193.174:44904) 2026-02-25T15:12:21.685 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.681+0000 7f8b27fff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f8b28162250 0x7f8b281826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.174:57390/0 (socket says 10.20.193.174:57390) 2026-02-25T15:12:21.685 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.681+0000 7f8b26ffd640 1 -- 10.20.193.174:0/787594421 learned_addr learned my addr 10.20.193.174:0/787594421 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435387204 0 0) 0x7f8b281863e0 con 0x7f8b281406c0 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 10 monclient(hunting): my global_id is 4160 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b0c003610 con 0x7f8b281406c0 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640899137 0 0) 0x7f8b281851e0 con 0x7f8b28162250 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.691 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 10 monclient(hunting): my global_id is 4165 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.682+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b281863e0 con 0x7f8b28162250 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 370019670 0 0) 0x7f8b0c003610 con 0x7f8b281406c0 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 >> v1:10.20.193.155:6789/0 conn(0x7f8b28162250 legacy=0x7f8b281826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 >> v1:10.20.193.78:6789/0 conn(0x7f8b2811e790 legacy=0x7f8b2811eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 10 monclient: _finish_hunting 0 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 1 monclient: found mon.noname-c 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b28187680 con 0x7f8b281406c0 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 10 monclient: _finish_auth 0 2026-02-25T15:12:21.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 10 monclient: _check_auth_tickets 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8b18002df0 con 0x7f8b281406c0 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b2db9b640 5 monclient: authenticate success, global_id 4160 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b2db9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b267fc640 10 monclient: dump: 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.693 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.683+0000 7f8b2db9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.684+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8b18003030 con 0x7f8b281406c0 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.684+0000 7f8b267fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.684+0000 7f8b267fc640 1 -- 10.20.193.174:0/787594421 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8b18003470 con 0x7f8b281406c0 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.684+0000 7f8b267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.684+0000 7f8b267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:21.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.684+0000 7f8b267fc640 10 monclient: dump: 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.684+0000 7f8b2db9b640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.684+0000 7f8b2db9b640 4 set_mon_vals no callback set 2026-02-25T15:12:21.695 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient: shutdown 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- 10.20.193.174:0/787594421 >> v1:10.20.193.167:6789/0 conn(0x7f8b281406c0 legacy=0x7f8b28160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- 10.20.193.174:0/787594421 shutdown_connections 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- 10.20.193.174:0/787594421 >> 10.20.193.174:0/787594421 conn(0x7f8b280588d0 msgr2=0x7f8b28058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- 10.20.193.174:0/787594421 shutdown_connections 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- 10.20.193.174:0/787594421 wait complete. 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient: build_initial_monmap 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient: monmap: 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:21.696 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 librados: starting msgr at 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 librados: starting objecter 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 Processor -- start 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- start start 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 librados: setting wanted keys 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 librados: calling monclient init 2026-02-25T15:12:21.697 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient: init 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient(hunting): picked mon.noname-c con 0x7f8b2811e790 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient(hunting): picked mon.noname-a con 0x7f8b281406c0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient(hunting): picked mon.noname-b con 0x7f8b28162250 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b2812e470 con 0x7f8b281406c0 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b2812f670 con 0x7f8b28162250 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b28130870 con 0x7f8b2811e790 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.685+0000 7f8b2db9b640 10 monclient(hunting): authenticate will time out at 3304.344968s 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.686+0000 7f8b277fe640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f8b2811e790 0x7f8b281826a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44910/0 (socket says 10.20.193.174:44910) 2026-02-25T15:12:21.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.686+0000 7f8b277fe640 1 -- 10.20.193.174:0/71709494 learned_addr learned my addr 10.20.193.174:0/71709494 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.686+0000 7f8b03fff640 10 client.?.objecter ms_handle_connect 0x7f8b2811e790 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.686+0000 7f8b03fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.686+0000 7f8b03fff640 10 client.?.objecter ms_handle_connect 0x7f8b28162250 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.686+0000 7f8b03fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.687+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073066964 0 0) 0x7f8b28130870 con 0x7f8b2811e790 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.687+0000 7f8b03fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.687+0000 7f8b03fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.687+0000 7f8b03fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.687+0000 7f8b03fff640 10 monclient(hunting): my global_id is 4163 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.687+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af8003610 con 0x7f8b2811e790 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.688+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544412048 0 0) 0x7f8b2812f670 con 0x7f8b28162250 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.688+0000 7f8b03fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:21.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.688+0000 7f8b03fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.688+0000 7f8b03fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.688+0000 7f8b03fff640 10 monclient(hunting): my global_id is 4168 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.688+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b28130870 con 0x7f8b28162250 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.689+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 975315367 0 0) 0x7f8af8003610 con 0x7f8b2811e790 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.689+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b2812f670 con 0x7f8b2811e790 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.689+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8b14002fd0 con 0x7f8b2811e790 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.689+0000 7f8b03fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.689+0000 7f8b03fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.689+0000 7f8b03fff640 10 monclient(hunting): dump: 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.700 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.701 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.701 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.701 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.701 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.701 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.701 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.701 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.689+0000 7f8b03fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:21.703 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.690+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 393710691 0 0) 0x7f8b28130870 con 0x7f8b28162250 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.690+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8af8003610 con 0x7f8b28162250 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.690+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8b1c003540 con 0x7f8b28162250 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.690+0000 7f8b03fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.690+0000 7f8b03fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.690+0000 7f8b03fff640 10 monclient(hunting): dump: 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.704 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 966874082 0 0) 0x7f8b2812f670 con 0x7f8b2811e790 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 >> v1:10.20.193.155:6789/0 conn(0x7f8b28162250 legacy=0x7f8b2812cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 >> v1:10.20.193.78:6789/0 conn(0x7f8b281406c0 legacy=0x7f8b28160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 10 monclient: _finish_hunting 0 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 1 monclient: found mon.c 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:21.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b28131b10 con 0x7f8b2811e790 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 10 monclient: _finish_auth 0 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 10 monclient: _check_auth_tickets 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b03fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 5 monclient: authenticate success, global_id 4163 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 10 monclient: _renew_subs 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2812f8a0 con 0x7f8b2811e790 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 10 client.4163.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 10 monclient: _renew_subs 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8b2812fee0 con 0x7f8b2811e790 2026-02-25T15:12:21.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 1 librados: init done 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.691+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b28185740 con 0x7f8b2811e790 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.695+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8b140049f0 con 0x7f8b2811e790 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.695+0000 7f8b03fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.695+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8b14004ba0 con 0x7f8b2811e790 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.695+0000 7f8b03fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.695+0000 7f8b03fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.695+0000 7f8b03fff640 10 monclient: dump: 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:21.707 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.695+0000 7f8b25ffb640 4 set_mon_vals no callback set 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.696+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2172328607 0 0) 0x7f8b14011420 con 0x7f8b2811e790 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.696+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (unknown 4131314864 0 0) 0x7f8b14012ee0 con 0x7f8b2811e790 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.696+0000 7f8b03fff640 10 client.4163.objecter ms_dispatch2 0x7f8b28000b90 osd_map(9..9 src has 1..9) 2026-02-25T15:12:21.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.696+0000 7f8b03fff640 3 client.4163.objecter handle_osd_map got epochs [9,9] > 0 2026-02-25T15:12:21.709 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.696+0000 7f8b03fff640 3 client.4163.objecter handle_osd_map decoding full epoch 9 2026-02-25T15:12:21.709 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.696+0000 7f8b03fff640 20 client.4163.objecter dump_active .. 0 homeless 2026-02-25T15:12:21.727 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.725+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f8b140175f0 con 0x7f8b2811e790 2026-02-25T15:12:21.727 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.725+0000 7f8b03fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:21.727 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.725+0000 7f8b03fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:21.762 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.760+0000 7f8b2db9b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9b16da96-8cc4-4b91-91cb-2ca1e6917bd6", "id": 7}] 2026-02-25T15:12:21.762 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.760+0000 7f8b2db9b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9b16da96-8cc4-4b91-91cb-2ca1e6917bd6", "id": 7}] 2026-02-25T15:12:21.763 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.760+0000 7f8b2db9b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:21.763 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.760+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd new", "uuid": "9b16da96-8cc4-4b91-91cb-2ca1e6917bd6", "id": 7} v 0) -- 0x7f8b28185960 con 0x7f8b2811e790 2026-02-25T15:12:21.883 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.881+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 1492658893 0 0) 0x7f8b14016810 con 0x7f8b2811e790 2026-02-25T15:12:21.883 INFO:tasks.ceph.mgr.y.trial078.stderr:2026-02-25T15:12:21.881+0000 7f718bd21640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-25T15:12:21.884 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.882+0000 7f8b26ffd640 10 monclient: get_auth_request con 0x7f8af8077ec0 auth_method 0 2026-02-25T15:12:21.884 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.882+0000 7f8b03fff640 10 client.4163.objecter ms_handle_connect 0x7f8af8077ec0 2026-02-25T15:12:21.924 INFO:tasks.ceph.mgr.y.trial078.stderr:2026-02-25T15:12:21.923+0000 7f718bd21640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-25T15:12:21.957 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.955+0000 7f8b03fff640 1 -- 10.20.193.174:0/71709494 <== mon.2 v1:10.20.193.167:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b16da96-8cc4-4b91-91cb-2ca1e6917bd6", "id": 7}]=0 v10) ==== 112+0+2 (unknown 4279528374 0 1371665406) 0x7f8b14047f00 con 0x7f8b2811e790 2026-02-25T15:12:21.957 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.955+0000 7f8b03fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9b16da96-8cc4-4b91-91cb-2ca1e6917bd6", "id": 7}] 2026-02-25T15:12:21.957 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.955+0000 7f8b03fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:21.958 INFO:teuthology.orchestra.run.trial174.stdout:7 2026-02-25T15:12:21.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 10 librados: watch_flush enter 2026-02-25T15:12:21.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 10 librados: watch_flush exit 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 20 client.4163.objecter shutdown clearing up homeless session... 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 10 client.4163.objecter successfully canceled tick 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 >> v1:10.20.193.78:6800/3497602169 conn(0x7f8af8077ec0 legacy=0x7f8af80982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 10 monclient: shutdown 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 >> v1:10.20.193.167:6789/0 conn(0x7f8b2811e790 legacy=0x7f8b281826a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 shutdown_connections 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 >> 10.20.193.174:0/71709494 conn(0x7f8b280588d0 msgr2=0x7f8b281842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:21.960 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 shutdown_connections 2026-02-25T15:12:21.961 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 1 -- 10.20.193.174:0/71709494 wait complete. 2026-02-25T15:12:21.961 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:21.956+0000 7f8b2db9b640 1 librados: shutdown 2026-02-25T15:12:21.967 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new fdbfc988-e822-416b-a4a9-8479496b0a22 8 2026-02-25T15:12:22.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.029+0000 7f4d7249f640 10 monclient: get_monmap_and_config 2026-02-25T15:12:22.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.029+0000 7f4d7249f640 10 monclient: build_initial_monmap 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.029+0000 7f4d7249f640 10 monclient: monmap: 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:22.030515+0000 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:22.030515+0000 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:22.033 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 1 Processor -- start 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 1 -- start start 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 10 monclient: init 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 10 monclient(hunting): picked mon.noname-c con 0x7f4d6c11e790 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 10 monclient(hunting): picked mon.noname-b con 0x7f4d6c1406c0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 10 monclient(hunting): picked mon.noname-a con 0x7f4d6c162250 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:22.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c183fe0 con 0x7f4d6c162250 2026-02-25T15:12:22.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c1851e0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c1863e0 con 0x7f4d6c11e790 2026-02-25T15:12:22.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:22.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d7249f640 10 monclient(hunting): authenticate will time out at 3304.689500s 2026-02-25T15:12:22.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d6bfff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f4d6c11e790 0x7f4d6c11eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44920/0 (socket says 10.20.193.174:44920) 2026-02-25T15:12:22.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.030+0000 7f4d6bfff640 1 -- 10.20.193.174:0/2747138773 learned_addr learned my addr 10.20.193.174:0/2747138773 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:22.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833568757 0 0) 0x7f4d6c1851e0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): my global_id is 4171 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d50003610 con 0x7f4d6c1406c0 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602016733 0 0) 0x7f4d6c1863e0 con 0x7f4d6c11e790 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): my global_id is 4166 2026-02-25T15:12:22.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d6c1851e0 con 0x7f4d6c11e790 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294211629 0 0) 0x7f4d6c183fe0 con 0x7f4d6c162250 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 10 monclient(hunting): my global_id is 4161 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.032+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d6c1863e0 con 0x7f4d6c162250 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.033+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2726368131 0 0) 0x7f4d6c1863e0 con 0x7f4d6c162250 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.033+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 >> v1:10.20.193.167:6789/0 conn(0x7f4d6c11e790 legacy=0x7f4d6c11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.033+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 >> v1:10.20.193.155:6789/0 conn(0x7f4d6c1406c0 legacy=0x7f4d6c160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.033+0000 7f4d6affd640 10 monclient: _finish_hunting 0 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 1 monclient: found mon.noname-a 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c187680 con 0x7f4d6c162250 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: _finish_auth 0 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: _check_auth_tickets 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4d600030d0 con 0x7f4d6c162250 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: dump: 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.048 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d7249f640 5 monclient: authenticate success, global_id 4161 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d7249f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d60003310 con 0x7f4d6c162250 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 1 -- 10.20.193.174:0/2747138773 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4d60003750 con 0x7f4d6c162250 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d7249f640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d7249f640 4 set_mon_vals no callback set 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:22.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.034+0000 7f4d6affd640 10 monclient: dump: 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient: shutdown 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- 10.20.193.174:0/2747138773 >> v1:10.20.193.78:6789/0 conn(0x7f4d6c162250 legacy=0x7f4d6c1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- 10.20.193.174:0/2747138773 shutdown_connections 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- 10.20.193.174:0/2747138773 >> 10.20.193.174:0/2747138773 conn(0x7f4d6c0588d0 msgr2=0x7f4d6c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- 10.20.193.174:0/2747138773 shutdown_connections 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- 10.20.193.174:0/2747138773 wait complete. 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient: build_initial_monmap 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient: monmap: 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:22.051 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 librados: starting msgr at 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 librados: starting objecter 2026-02-25T15:12:22.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 Processor -- start 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- start start 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 librados: setting wanted keys 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 librados: calling monclient init 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient: init 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient(hunting): picked mon.noname-b con 0x7f4d6c11e790 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient(hunting): picked mon.noname-c con 0x7f4d6c1406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient(hunting): picked mon.noname-a con 0x7f4d6c162250 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:22.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c105830 con 0x7f4d6c162250 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c10d5d0 con 0x7f4d6c11e790 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c10e7f0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.035+0000 7f4d7249f640 10 monclient(hunting): authenticate will time out at 3304.694763s 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.036+0000 7f4d6b7fe640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f4d6c1406c0 0x7f4d6c104e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44928/0 (socket says 10.20.193.174:44928) 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.036+0000 7f4d6b7fe640 1 -- 10.20.193.174:0/902624495 learned_addr learned my addr 10.20.193.174:0/902624495 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.036+0000 7f4d68ff9640 10 client.?.objecter ms_handle_connect 0x7f4d6c1406c0 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.036+0000 7f4d68ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.036+0000 7f4d68ff9640 10 client.?.objecter ms_handle_connect 0x7f4d6c11e790 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.036+0000 7f4d68ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.036+0000 7f4d68ff9640 10 client.?.objecter ms_handle_connect 0x7f4d6c162250 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.036+0000 7f4d68ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153691198 0 0) 0x7f4d6c10e7f0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): my global_id is 4169 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d3c003610 con 0x7f4d6c1406c0 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837038223 0 0) 0x7f4d6c187680 con 0x7f4d6c162250 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): my global_id is 4164 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d6c10e7f0 con 0x7f4d6c162250 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153222484 0 0) 0x7f4d6c10d5d0 con 0x7f4d6c11e790 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 10 monclient(hunting): my global_id is 4174 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.037+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d6c187680 con 0x7f4d6c11e790 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4290720870 0 0) 0x7f4d3c003610 con 0x7f4d6c1406c0 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d6c10d5d0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4d5c003230 con 0x7f4d6c1406c0 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.057 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 205693515 0 0) 0x7f4d6c10e7f0 con 0x7f4d6c162250 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d3c003610 con 0x7f4d6c162250 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4d60002fe0 con 0x7f4d6c162250 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.058 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2160484638 0 0) 0x7f4d6c187680 con 0x7f4d6c11e790 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d6c10e7f0 con 0x7f4d6c11e790 2026-02-25T15:12:22.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4d58003030 con 0x7f4d6c11e790 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.039+0000 7f4d68ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.060 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1851701374 0 0) 0x7f4d6c10d5d0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 >> v1:10.20.193.155:6789/0 conn(0x7f4d6c11e790 legacy=0x7f4d6c1826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 >> v1:10.20.193.78:6789/0 conn(0x7f4d6c162250 legacy=0x7f4d6c161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 1 monclient: found mon.c 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.061 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c10fa90 con 0x7f4d6c1406c0 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 10 monclient: _finish_auth 0 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 5 monclient: authenticate success, global_id 4169 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 10 monclient: _renew_subs 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c10d800 con 0x7f4d6c1406c0 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 10 client.4169.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 10 monclient: _renew_subs 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d6c10de40 con 0x7f4d6c1406c0 2026-02-25T15:12:22.062 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 1 librados: init done 2026-02-25T15:12:22.063 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.063 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.063 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.063 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.041+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c186ab0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.045+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d5c0039b0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.045+0000 7f4d68ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.045+0000 7f4d6a7fc640 4 set_mon_vals no callback set 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.048+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4d5c003dc0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.048+0000 7f4d68ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.048+0000 7f4d68ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.048+0000 7f4d68ff9640 10 monclient: dump: 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.065 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.049+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 1492658893 0 0) 0x7f4d5c003fe0 con 0x7f4d6c1406c0 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.050+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (unknown 798097056 0 0) 0x7f4d5c093950 con 0x7f4d6c1406c0 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.050+0000 7f4d68ff9640 10 client.4169.objecter ms_dispatch2 0x7f4d6c000b90 osd_map(10..10 src has 1..10) 2026-02-25T15:12:22.066 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.050+0000 7f4d68ff9640 3 client.4169.objecter handle_osd_map got epochs [10,10] > 0 2026-02-25T15:12:22.067 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.050+0000 7f4d68ff9640 3 client.4169.objecter handle_osd_map decoding full epoch 10 2026-02-25T15:12:22.067 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.050+0000 7f4d6bfff640 10 monclient: get_auth_request con 0x7f4d3c077d20 auth_method 0 2026-02-25T15:12:22.067 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.050+0000 7f4d68ff9640 20 client.4169.objecter dump_active .. 0 homeless 2026-02-25T15:12:22.067 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.050+0000 7f4d68ff9640 10 client.4169.objecter ms_handle_connect 0x7f4d3c077d20 2026-02-25T15:12:22.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.136+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4d5c05dd10 con 0x7f4d6c1406c0 2026-02-25T15:12:22.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.136+0000 7f4d68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.138 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.136+0000 7f4d68ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:22.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.246+0000 7f4d7249f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "fdbfc988-e822-416b-a4a9-8479496b0a22", "id": 8}] 2026-02-25T15:12:22.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.246+0000 7f4d7249f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "fdbfc988-e822-416b-a4a9-8479496b0a22", "id": 8}] 2026-02-25T15:12:22.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.246+0000 7f4d7249f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.248 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.246+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd new", "uuid": "fdbfc988-e822-416b-a4a9-8479496b0a22", "id": 8} v 0) -- 0x7f4d6c10e180 con 0x7f4d6c1406c0 2026-02-25T15:12:22.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.295+0000 7f4d68ff9640 1 -- 10.20.193.174:0/902624495 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fdbfc988-e822-416b-a4a9-8479496b0a22", "id": 8}]=0 v11) ==== 112+0+2 (unknown 2662790358 0 3065575683) 0x7f4d5c05d610 con 0x7f4d6c1406c0 2026-02-25T15:12:22.296 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.295+0000 7f4d68ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "fdbfc988-e822-416b-a4a9-8479496b0a22", "id": 8}] 2026-02-25T15:12:22.297 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.295+0000 7f4d68ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:22.297 INFO:teuthology.orchestra.run.trial174.stdout:8 2026-02-25T15:12:22.298 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 10 librados: watch_flush enter 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 10 librados: watch_flush exit 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 20 client.4169.objecter shutdown clearing up homeless session... 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 10 client.4169.objecter successfully canceled tick 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 >> v1:10.20.193.78:6800/3497602169 conn(0x7f4d3c077d20 legacy=0x7f4d3c0981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 10 monclient: shutdown 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 >> v1:10.20.193.167:6789/0 conn(0x7f4d6c1406c0 legacy=0x7f4d6c104e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 shutdown_connections 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 >> 10.20.193.174:0/902624495 conn(0x7f4d6c0588d0 msgr2=0x7f4d6c058ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:22.299 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 shutdown_connections 2026-02-25T15:12:22.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 1 -- 10.20.193.174:0/902624495 wait complete. 2026-02-25T15:12:22.300 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.296+0000 7f4d7249f640 1 librados: shutdown 2026-02-25T15:12:22.305 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new c884aa7f-435f-41f7-863d-36e4bdf73113 9 2026-02-25T15:12:22.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.367+0000 7efed7a5b640 10 monclient: get_monmap_and_config 2026-02-25T15:12:22.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.367+0000 7efed7a5b640 10 monclient: build_initial_monmap 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.367+0000 7efed7a5b640 10 monclient: monmap: 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:22.368444+0000 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:22.368444+0000 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:22.371 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 1 Processor -- start 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 1 -- start start 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 10 monclient: init 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 10 monclient(hunting): picked mon.noname-a con 0x7efed005d9b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 10 monclient(hunting): picked mon.noname-b con 0x7efed005dd80 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 10 monclient(hunting): picked mon.noname-c con 0x7efed01649b0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed005e200 con 0x7efed005d9b0 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed01874c0 con 0x7efed005dd80 2026-02-25T15:12:22.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed01886a0 con 0x7efed01649b0 2026-02-25T15:12:22.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:22.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed7a5b640 10 monclient(hunting): authenticate will time out at 3305.027389s 2026-02-25T15:12:22.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed57d0640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7efed005d9b0 0x7efed011b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.174:43744/0 (socket says 10.20.193.174:43744) 2026-02-25T15:12:22.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.368+0000 7efed57d0640 1 -- 10.20.193.174:0/1169033815 learned_addr learned my addr 10.20.193.174:0/1169033815 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:22.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50873890 0 0) 0x7efed01874c0 con 0x7efed005dd80 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): my global_id is 4177 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeb8003610 con 0x7efed005dd80 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961162719 0 0) 0x7efed005e200 con 0x7efed005d9b0 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): my global_id is 4167 2026-02-25T15:12:22.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efed01874c0 con 0x7efed005d9b0 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128304171 0 0) 0x7efed01886a0 con 0x7efed01649b0 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 10 monclient(hunting): my global_id is 4172 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.370+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efed005e200 con 0x7efed01649b0 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3329901788 0 0) 0x7efeb8003610 con 0x7efed005dd80 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 >> v1:10.20.193.167:6789/0 conn(0x7efed01649b0 legacy=0x7efed0184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 >> v1:10.20.193.78:6789/0 conn(0x7efed005d9b0 legacy=0x7efed011b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 10 monclient: _finish_hunting 0 2026-02-25T15:12:22.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 1 monclient: found mon.noname-b 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed0189920 con 0x7efed005dd80 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 10 monclient: _finish_auth 0 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 10 monclient: _check_auth_tickets 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efec4002df0 con 0x7efed005dd80 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efebffff640 10 monclient: dump: 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.384 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efed7a5b640 5 monclient: authenticate success, global_id 4177 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.371+0000 7efed7a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efec4003030 con 0x7efed005dd80 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efebffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:22.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efebffff640 1 -- 10.20.193.174:0/1169033815 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efec4003470 con 0x7efed005dd80 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efebffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efebffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efebffff640 10 monclient: dump: 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.386 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 4 set_mon_vals no callback set 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 10 monclient: shutdown 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 1 -- 10.20.193.174:0/1169033815 >> v1:10.20.193.155:6789/0 conn(0x7efed005dd80 legacy=0x7efed011b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 1 -- 10.20.193.174:0/1169033815 shutdown_connections 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 1 -- 10.20.193.174:0/1169033815 >> 10.20.193.174:0/1169033815 conn(0x7efed00588d0 msgr2=0x7efed0058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 1 -- 10.20.193.174:0/1169033815 shutdown_connections 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.372+0000 7efed7a5b640 1 -- 10.20.193.174:0/1169033815 wait complete. 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient: build_initial_monmap 2026-02-25T15:12:22.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient: monmap: 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 librados: starting msgr at 2026-02-25T15:12:22.388 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 librados: starting objecter 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 Processor -- start 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 -- start start 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 librados: setting wanted keys 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 librados: calling monclient init 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient: init 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient(hunting): picked mon.noname-b con 0x7efed005d9b0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient(hunting): picked mon.noname-c con 0x7efed005dd80 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:22.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient(hunting): picked mon.noname-a con 0x7efed01649b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed0102360 con 0x7efed01649b0 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed0109240 con 0x7efed005d9b0 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed010a420 con 0x7efed005dd80 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed7a5b640 10 monclient(hunting): authenticate will time out at 3305.032386s 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed4fcf640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7efed005dd80 0x7efed0161980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44944/0 (socket says 10.20.193.174:44944) 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efed4fcf640 1 -- 10.20.193.174:0/2519315935 learned_addr learned my addr 10.20.193.174:0/2519315935 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efebdffb640 10 client.?.objecter ms_handle_connect 0x7efed01649b0 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.373+0000 7efebdffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 10 client.?.objecter ms_handle_connect 0x7efed005dd80 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 10 client.?.objecter ms_handle_connect 0x7efed005d9b0 2026-02-25T15:12:22.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481433766 0 0) 0x7efed0102360 con 0x7efed01649b0 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 10 monclient(hunting): my global_id is 4170 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.374+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efea0003610 con 0x7efed01649b0 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 613964984 0 0) 0x7efed010a420 con 0x7efed005dd80 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 10 monclient(hunting): my global_id is 4175 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efed0102360 con 0x7efed005dd80 2026-02-25T15:12:22.391 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074002699 0 0) 0x7efed0109240 con 0x7efed005d9b0 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 10 monclient(hunting): my global_id is 4180 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.375+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efed010a420 con 0x7efed005d9b0 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1103256770 0 0) 0x7efea0003610 con 0x7efed01649b0 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efed0109240 con 0x7efed01649b0 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efecc003410 con 0x7efed01649b0 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): dump: 2026-02-25T15:12:22.392 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3905896968 0 0) 0x7efed0102360 con 0x7efed005dd80 2026-02-25T15:12:22.393 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efea0003610 con 0x7efed005dd80 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efec4003380 con 0x7efed005dd80 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): dump: 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.394 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3101919449 0 0) 0x7efed010a420 con 0x7efed005d9b0 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efed0102360 con 0x7efed005d9b0 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efec0003070 con 0x7efed005d9b0 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.377+0000 7efebdffb640 10 monclient(hunting): dump: 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.395 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1147782235 0 0) 0x7efed0109240 con 0x7efed01649b0 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 >> v1:10.20.193.167:6789/0 conn(0x7efed005dd80 legacy=0x7efed0161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 >> v1:10.20.193.155:6789/0 conn(0x7efed005d9b0 legacy=0x7efed0101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 10 monclient: _finish_hunting 0 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 1 monclient: found mon.a 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:22.396 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed010b600 con 0x7efed01649b0 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 10 monclient: _finish_auth 0 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 10 monclient: _check_auth_tickets 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efebdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 5 monclient: authenticate success, global_id 4170 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 10 monclient: _renew_subs 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efed010a5f0 con 0x7efed01649b0 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 10 client.4170.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 10 monclient: _renew_subs 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efed010ab60 con 0x7efed01649b0 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.378+0000 7efed7a5b640 1 librados: init done 2026-02-25T15:12:22.397 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.379+0000 7efed7a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.398 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.379+0000 7efed7a5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.398 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.379+0000 7efed7a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:22.398 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.379+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed01869b0 con 0x7efed01649b0 2026-02-25T15:12:22.399 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.385+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efecc003a80 con 0x7efed01649b0 2026-02-25T15:12:22.399 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.385+0000 7efebdffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:22.399 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.385+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efecc003dd0 con 0x7efed01649b0 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.385+0000 7efebdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.385+0000 7efebdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.385+0000 7efebdffb640 10 monclient: dump: 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.400 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.385+0000 7efebf7fe640 4 set_mon_vals no callback set 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.386+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 1492658893 0 0) 0x7efecc01cba0 con 0x7efed01649b0 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.387+0000 7efed57d0640 10 monclient: get_auth_request con 0x7efea0077c80 auth_method 0 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.387+0000 7efebdffb640 10 client.4170.objecter ms_handle_connect 0x7efea0077c80 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.387+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(11..11 src has 1..11) ==== 1755+0+0 (unknown 2150115477 0 0) 0x7efecc058550 con 0x7efed01649b0 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.387+0000 7efebdffb640 10 client.4170.objecter ms_dispatch2 0x7efed0000b90 osd_map(11..11 src has 1..11) 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.387+0000 7efebdffb640 3 client.4170.objecter handle_osd_map got epochs [11,11] > 0 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.388+0000 7efebdffb640 3 client.4170.objecter handle_osd_map decoding full epoch 11 2026-02-25T15:12:22.401 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.388+0000 7efebdffb640 20 client.4170.objecter dump_active .. 0 homeless 2026-02-25T15:12:22.474 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.473+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7efecc05ccc0 con 0x7efed01649b0 2026-02-25T15:12:22.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.473+0000 7efebdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.475 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.473+0000 7efebdffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:22.585 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.583+0000 7efed7a5b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c884aa7f-435f-41f7-863d-36e4bdf73113", "id": 9}] 2026-02-25T15:12:22.585 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.583+0000 7efed7a5b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c884aa7f-435f-41f7-863d-36e4bdf73113", "id": 9}] 2026-02-25T15:12:22.585 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.583+0000 7efed7a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:22.585 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.583+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd new", "uuid": "c884aa7f-435f-41f7-863d-36e4bdf73113", "id": 9} v 0) -- 0x7efed010aea0 con 0x7efed01649b0 2026-02-25T15:12:22.618 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.617+0000 7efebdffb640 1 -- 10.20.193.174:0/2519315935 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c884aa7f-435f-41f7-863d-36e4bdf73113", "id": 9}]=0 v12) ==== 112+0+2 (unknown 3971738203 0 2769969524) 0x7efecc05c5c0 con 0x7efed01649b0 2026-02-25T15:12:22.619 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.617+0000 7efebdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c884aa7f-435f-41f7-863d-36e4bdf73113", "id": 9}] 2026-02-25T15:12:22.619 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.617+0000 7efebdffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:22.619 INFO:teuthology.orchestra.run.trial174.stdout:9 2026-02-25T15:12:22.621 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.618+0000 7efed7a5b640 10 librados: watch_flush enter 2026-02-25T15:12:22.621 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.618+0000 7efed7a5b640 10 librados: watch_flush exit 2026-02-25T15:12:22.621 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.618+0000 7efed7a5b640 20 client.4170.objecter shutdown clearing up homeless session... 2026-02-25T15:12:22.621 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.618+0000 7efed7a5b640 10 client.4170.objecter successfully canceled tick 2026-02-25T15:12:22.621 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.618+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 >> v1:10.20.193.78:6800/3497602169 conn(0x7efea0077c80 legacy=0x7efea0098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.621 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.618+0000 7efed7a5b640 10 monclient: shutdown 2026-02-25T15:12:22.621 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.618+0000 7efed7a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:22.621 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.618+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 >> v1:10.20.193.78:6789/0 conn(0x7efed01649b0 legacy=0x7efed01630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.622 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.619+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 shutdown_connections 2026-02-25T15:12:22.622 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.619+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 >> 10.20.193.174:0/2519315935 conn(0x7efed00588d0 msgr2=0x7efed005c010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:22.622 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.619+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 shutdown_connections 2026-02-25T15:12:22.622 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.619+0000 7efed7a5b640 1 -- 10.20.193.174:0/2519315935 wait complete. 2026-02-25T15:12:22.622 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.619+0000 7efed7a5b640 1 librados: shutdown 2026-02-25T15:12:22.628 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 8fd183a2-7025-4c41-813e-e5fa260d532c 10 2026-02-25T15:12:22.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient: get_monmap_and_config 2026-02-25T15:12:22.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient: build_initial_monmap 2026-02-25T15:12:22.692 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient: monmap: 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:22.690629+0000 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:22.690629+0000 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:22.693 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 1 Processor -- start 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 1 -- start start 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient: init 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient(hunting): picked mon.noname-c con 0x7f130c05d9b0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient(hunting): picked mon.noname-a con 0x7f130c05dd80 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient(hunting): picked mon.noname-b con 0x7f130c1649b0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c05e200 con 0x7f130c05dd80 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c1874c0 con 0x7f130c1649b0 2026-02-25T15:12:22.694 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c1886a0 con 0x7f130c05d9b0 2026-02-25T15:12:22.695 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:22.695 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.690+0000 7f13117cf640 10 monclient(hunting): authenticate will time out at 3305.349630s 2026-02-25T15:12:22.695 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.691+0000 7f130affd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f130c05d9b0 0x7f130c11b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44952/0 (socket says 10.20.193.174:44952) 2026-02-25T15:12:22.695 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.691+0000 7f130affd640 1 -- 10.20.193.174:0/90438099 learned_addr learned my addr 10.20.193.174:0/90438099 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:22.703 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974404814 0 0) 0x7f130c1874c0 con 0x7f130c1649b0 2026-02-25T15:12:22.703 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.703 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.703 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): my global_id is 4183 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12f8003610 con 0x7f130c1649b0 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1630117943 0 0) 0x7f130c1886a0 con 0x7f130c05d9b0 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): my global_id is 4178 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f130c1874c0 con 0x7f130c05d9b0 2026-02-25T15:12:22.704 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158266363 0 0) 0x7f130c05e200 con 0x7f130c05dd80 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 10 monclient(hunting): my global_id is 4173 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.692+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f130c1886a0 con 0x7f130c05dd80 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2221287401 0 0) 0x7f130c1874c0 con 0x7f130c05d9b0 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 >> v1:10.20.193.155:6789/0 conn(0x7f130c1649b0 legacy=0x7f130c184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 >> v1:10.20.193.78:6789/0 conn(0x7f130c05dd80 legacy=0x7f130c11b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 1 monclient: found mon.noname-c 2026-02-25T15:12:22.705 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c189920 con 0x7f130c05d9b0 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 10 monclient: _finish_auth 0 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1300002df0 con 0x7f130c05d9b0 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f1309ffb640 10 monclient: dump: 2026-02-25T15:12:22.706 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f13117cf640 5 monclient: authenticate success, global_id 4178 2026-02-25T15:12:22.707 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.693+0000 7f13117cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.694+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1300003030 con 0x7f130c05d9b0 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.694+0000 7f1309ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.694+0000 7f1309ffb640 1 -- 10.20.193.174:0/90438099 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1300003470 con 0x7f130c05d9b0 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.694+0000 7f13117cf640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.694+0000 7f13117cf640 4 set_mon_vals no callback set 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.694+0000 7f1309ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.694+0000 7f1309ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.694+0000 7f1309ffb640 10 monclient: dump: 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.708 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient: shutdown 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- 10.20.193.174:0/90438099 >> v1:10.20.193.167:6789/0 conn(0x7f130c05d9b0 legacy=0x7f130c11b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.709 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- 10.20.193.174:0/90438099 shutdown_connections 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- 10.20.193.174:0/90438099 >> 10.20.193.174:0/90438099 conn(0x7f130c0588d0 msgr2=0x7f130c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- 10.20.193.174:0/90438099 shutdown_connections 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- 10.20.193.174:0/90438099 wait complete. 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient: build_initial_monmap 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient: monmap: 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:22.710 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 librados: starting msgr at 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 librados: starting objecter 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 Processor -- start 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- start start 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 librados: setting wanted keys 2026-02-25T15:12:22.711 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 librados: calling monclient init 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient: init 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient(hunting): picked mon.noname-b con 0x7f130c05d9b0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient(hunting): picked mon.noname-c con 0x7f130c05dd80 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 10 monclient(hunting): picked mon.noname-a con 0x7f130c1649b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c1021c0 con 0x7f130c1649b0 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c109050 con 0x7f130c05d9b0 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.695+0000 7f13117cf640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c10a230 con 0x7f130c05dd80 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f13117cf640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f13117cf640 10 monclient(hunting): authenticate will time out at 3305.355008s 2026-02-25T15:12:22.712 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f130a7fc640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f130c05dd80 0x7f130c161980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44966/0 (socket says 10.20.193.174:44966) 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f130a7fc640 1 -- 10.20.193.174:0/907077054 learned_addr learned my addr 10.20.193.174:0/907077054 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f12eb7fe640 10 client.?.objecter ms_handle_connect 0x7f130c05d9b0 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f12eb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f12eb7fe640 10 client.?.objecter ms_handle_connect 0x7f130c05dd80 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f12eb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f12eb7fe640 10 client.?.objecter ms_handle_connect 0x7f130c1649b0 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.696+0000 7f12eb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678378608 0 0) 0x7f130c109050 con 0x7f130c05d9b0 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.713 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 10 monclient(hunting): my global_id is 4186 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12d8003610 con 0x7f130c05d9b0 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362302210 0 0) 0x7f130c10a230 con 0x7f130c05dd80 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 10 monclient(hunting): my global_id is 4181 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.697+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f130c109050 con 0x7f130c05dd80 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.698+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980791793 0 0) 0x7f130c1021c0 con 0x7f130c1649b0 2026-02-25T15:12:22.714 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.698+0000 7f12eb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.698+0000 7f12eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.698+0000 7f12eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.698+0000 7f12eb7fe640 10 monclient(hunting): my global_id is 4176 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.698+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f130c10a230 con 0x7f130c1649b0 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1488091078 0 0) 0x7f130c109050 con 0x7f130c05dd80 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f130c1021c0 con 0x7f130c05dd80 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f12f4003170 con 0x7f130c05dd80 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 10 monclient(hunting): dump: 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.715 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2958221325 0 0) 0x7f12d8003610 con 0x7f130c05d9b0 2026-02-25T15:12:22.716 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f130c109050 con 0x7f130c05d9b0 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1300003380 con 0x7f130c05d9b0 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.699+0000 7f12eb7fe640 10 monclient(hunting): dump: 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.717 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.700+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 773399529 0 0) 0x7f130c10a230 con 0x7f130c1649b0 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.700+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12d8003610 con 0x7f130c1649b0 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.700+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f12fc003430 con 0x7f130c1649b0 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.700+0000 7f12eb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.700+0000 7f12eb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.700+0000 7f12eb7fe640 10 monclient(hunting): dump: 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.718 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2094080703 0 0) 0x7f130c1021c0 con 0x7f130c05dd80 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 >> v1:10.20.193.155:6789/0 conn(0x7f130c05d9b0 legacy=0x7f130c1016b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.719 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 >> v1:10.20.193.78:6789/0 conn(0x7f130c1649b0 legacy=0x7f130c1630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 1 monclient: found mon.c 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c10b410 con 0x7f130c05dd80 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 10 monclient: _finish_auth 0 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f12eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 5 monclient: authenticate success, global_id 4181 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 10 monclient: _renew_subs 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.720 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f130c10a400 con 0x7f130c05dd80 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 10 client.4181.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 10 monclient: _renew_subs 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f130c10a9a0 con 0x7f130c05dd80 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 1 librados: init done 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.721 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.701+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f130c187b90 con 0x7f130c05dd80 2026-02-25T15:12:22.722 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.706+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12f40034e0 con 0x7f130c05dd80 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.706+0000 7f12eb7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.706+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f12f4003b50 con 0x7f130c05dd80 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.706+0000 7f12eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.706+0000 7f12eb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.706+0000 7f12eb7fe640 10 monclient: dump: 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:22.723 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.706+0000 7f13097fa640 4 set_mon_vals no callback set 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.709+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 1492658893 0 0) 0x7f12f4003b50 con 0x7f130c05dd80 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.709+0000 7f130affd640 10 monclient: get_auth_request con 0x7f12d8077d20 auth_method 0 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.709+0000 7f12eb7fe640 10 client.4181.objecter ms_handle_connect 0x7f12d8077d20 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.710+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(12..12 src has 1..12) ==== 1870+0+0 (unknown 927202224 0 0) 0x7f12f4059440 con 0x7f130c05dd80 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.710+0000 7f12eb7fe640 10 client.4181.objecter ms_dispatch2 0x7f130c000b90 osd_map(12..12 src has 1..12) 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.710+0000 7f12eb7fe640 3 client.4181.objecter handle_osd_map got epochs [12,12] > 0 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.710+0000 7f12eb7fe640 3 client.4181.objecter handle_osd_map decoding full epoch 12 2026-02-25T15:12:22.724 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.710+0000 7f12eb7fe640 20 client.4181.objecter dump_active .. 0 homeless 2026-02-25T15:12:22.794 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.792+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f12f405dbb0 con 0x7f130c05dd80 2026-02-25T15:12:22.794 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.793+0000 7f12eb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:22.794 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.793+0000 7f12eb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:22.905 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.903+0000 7f13117cf640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8fd183a2-7025-4c41-813e-e5fa260d532c", "id": 10}] 2026-02-25T15:12:22.905 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.903+0000 7f13117cf640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8fd183a2-7025-4c41-813e-e5fa260d532c", "id": 10}] 2026-02-25T15:12:22.905 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.903+0000 7f13117cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:22.905 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.903+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8fd183a2-7025-4c41-813e-e5fa260d532c", "id": 10} v 0) -- 0x7f130c10ac90 con 0x7f130c05dd80 2026-02-25T15:12:22.953 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.952+0000 7f12eb7fe640 1 -- 10.20.193.174:0/907077054 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fd183a2-7025-4c41-813e-e5fa260d532c", "id": 10}]=0 v13) ==== 113+0+3 (unknown 3858891390 0 520826459) 0x7f12f405d4b0 con 0x7f130c05dd80 2026-02-25T15:12:22.953 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.952+0000 7f12eb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8fd183a2-7025-4c41-813e-e5fa260d532c", "id": 10}] 2026-02-25T15:12:22.954 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.952+0000 7f12eb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:22.954 INFO:teuthology.orchestra.run.trial174.stdout:10 2026-02-25T15:12:22.955 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 10 librados: watch_flush enter 2026-02-25T15:12:22.955 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 10 librados: watch_flush exit 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 20 client.4181.objecter shutdown clearing up homeless session... 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 10 client.4181.objecter successfully canceled tick 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 >> v1:10.20.193.78:6800/3497602169 conn(0x7f12d8077d20 legacy=0x7f12d80981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 10 monclient: shutdown 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 >> v1:10.20.193.167:6789/0 conn(0x7f130c05dd80 legacy=0x7f130c161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 shutdown_connections 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 >> 10.20.193.174:0/907077054 conn(0x7f130c0588d0 msgr2=0x7f130c05b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 shutdown_connections 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 1 -- 10.20.193.174:0/907077054 wait complete. 2026-02-25T15:12:22.956 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:22.953+0000 7f13117cf640 1 librados: shutdown 2026-02-25T15:12:22.964 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 5102cdb4-cabf-4bf2-a0ff-fc6e20018bac 11 2026-02-25T15:12:23.028 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient: get_monmap_and_config 2026-02-25T15:12:23.028 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient: build_initial_monmap 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient: monmap: 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:23.026623+0000 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:23.026623+0000 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:23.029 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 1 Processor -- start 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 1 -- start start 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient: init 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient(hunting): picked mon.noname-b con 0x7fd8a811e790 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient(hunting): picked mon.noname-a con 0x7fd8a81406c0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient(hunting): picked mon.noname-c con 0x7fd8a8162250 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a8183fe0 con 0x7fd8a81406c0 2026-02-25T15:12:23.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a81851e0 con 0x7fd8a811e790 2026-02-25T15:12:23.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a81863e0 con 0x7fd8a8162250 2026-02-25T15:12:23.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:23.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8af4b8640 10 monclient(hunting): authenticate will time out at 3305.685556s 2026-02-25T15:12:23.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8aca2c640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd8a81406c0 0x7fd8a8160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.174:43774/0 (socket says 10.20.193.174:43774) 2026-02-25T15:12:23.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.026+0000 7fd8aca2c640 1 -- 10.20.193.174:0/1026754632 learned_addr learned my addr 10.20.193.174:0/1026754632 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:23.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521294673 0 0) 0x7fd8a8183fe0 con 0x7fd8a81406c0 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): my global_id is 4179 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd890003610 con 0x7fd8a81406c0 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953114429 0 0) 0x7fd8a81851e0 con 0x7fd8a811e790 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): my global_id is 4189 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8a8183fe0 con 0x7fd8a811e790 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1177496191 0 0) 0x7fd8a81863e0 con 0x7fd8a8162250 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 10 monclient(hunting): my global_id is 4184 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.028+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8a81851e0 con 0x7fd8a8162250 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2467149659 0 0) 0x7fd890003610 con 0x7fd8a81406c0 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 >> v1:10.20.193.167:6789/0 conn(0x7fd8a8162250 legacy=0x7fd8a81826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 >> v1:10.20.193.155:6789/0 conn(0x7fd8a811e790 legacy=0x7fd8a811eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 10 monclient: _finish_hunting 0 2026-02-25T15:12:23.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 1 monclient: found mon.noname-a 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a8187680 con 0x7fd8a81406c0 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 10 monclient: _finish_auth 0 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 10 monclient: _check_auth_tickets 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd89c002df0 con 0x7fd8a81406c0 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd897fff640 10 monclient: dump: 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.042 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd8af4b8640 5 monclient: authenticate success, global_id 4179 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.029+0000 7fd8af4b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd89c003030 con 0x7fd8a81406c0 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd897fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:23.043 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd897fff640 1 -- 10.20.193.174:0/1026754632 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd89c003470 con 0x7fd8a81406c0 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd897fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd897fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd897fff640 10 monclient: dump: 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.044 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 4 set_mon_vals no callback set 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 10 monclient: shutdown 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 1 -- 10.20.193.174:0/1026754632 >> v1:10.20.193.78:6789/0 conn(0x7fd8a81406c0 legacy=0x7fd8a8160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 1 -- 10.20.193.174:0/1026754632 shutdown_connections 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 1 -- 10.20.193.174:0/1026754632 >> 10.20.193.174:0/1026754632 conn(0x7fd8a80588d0 msgr2=0x7fd8a8058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 1 -- 10.20.193.174:0/1026754632 shutdown_connections 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.030+0000 7fd8af4b8640 1 -- 10.20.193.174:0/1026754632 wait complete. 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient: build_initial_monmap 2026-02-25T15:12:23.045 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient: monmap: 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.046 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 librados: starting msgr at 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 librados: starting objecter 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 Processor -- start 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 -- start start 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 librados: setting wanted keys 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 librados: calling monclient init 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient: init 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:23.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient(hunting): picked mon.noname-b con 0x7fd8a811e790 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient(hunting): picked mon.noname-c con 0x7fd8a81406c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient(hunting): picked mon.noname-a con 0x7fd8a8162250 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a812e790 con 0x7fd8a8162250 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a812f970 con 0x7fd8a811e790 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a8130b70 con 0x7fd8a81406c0 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8af4b8640 10 monclient(hunting): authenticate will time out at 3305.690506s 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8ad22d640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fd8a811e790 0x7fd8a81826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.174:57440/0 (socket says 10.20.193.174:57440) 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd8ad22d640 1 -- 10.20.193.174:0/3709036850 learned_addr learned my addr 10.20.193.174:0/3709036850 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd895ffb640 10 client.?.objecter ms_handle_connect 0x7fd8a811e790 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd895ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:23.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd895ffb640 10 client.?.objecter ms_handle_connect 0x7fd8a8162250 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.031+0000 7fd895ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 client.?.objecter ms_handle_connect 0x7fd8a81406c0 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857648702 0 0) 0x7fd8a812f970 con 0x7fd8a811e790 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 monclient(hunting): my global_id is 4192 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd878003610 con 0x7fd8a811e790 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317535384 0 0) 0x7fd8a812e790 con 0x7fd8a8162250 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 10 monclient(hunting): my global_id is 4182 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.032+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8a812f970 con 0x7fd8a8162250 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.033+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514291706 0 0) 0x7fd8a8130b70 con 0x7fd8a81406c0 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.033+0000 7fd895ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.033+0000 7fd895ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.033+0000 7fd895ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.033+0000 7fd895ffb640 10 monclient(hunting): my global_id is 4187 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.033+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8a812e790 con 0x7fd8a81406c0 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3857801374 0 0) 0x7fd878003610 con 0x7fd8a811e790 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8a8130b70 con 0x7fd8a811e790 2026-02-25T15:12:23.050 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd898003190 con 0x7fd8a811e790 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): dump: 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.051 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 976111892 0 0) 0x7fd8a812f970 con 0x7fd8a8162250 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd878003610 con 0x7fd8a8162250 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd8a4003490 con 0x7fd8a8162250 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): dump: 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.052 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3657396792 0 0) 0x7fd8a812e790 con 0x7fd8a81406c0 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8a812f970 con 0x7fd8a81406c0 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd89c0031e0 con 0x7fd8a81406c0 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.035+0000 7fd895ffb640 10 monclient(hunting): dump: 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.053 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2574203835 0 0) 0x7fd8a8130b70 con 0x7fd8a811e790 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 >> v1:10.20.193.167:6789/0 conn(0x7fd8a81406c0 legacy=0x7fd8a8160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 >> v1:10.20.193.78:6789/0 conn(0x7fd8a8162250 legacy=0x7fd8a812cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.054 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 1 monclient: found mon.b 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a8131e10 con 0x7fd8a811e790 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 10 monclient: _finish_auth 0 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd895ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 5 monclient: authenticate success, global_id 4192 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 10 monclient: _renew_subs 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a812e9c0 con 0x7fd8a811e790 2026-02-25T15:12:23.055 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 10 client.4192.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:23.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 10 monclient: _renew_subs 2026-02-25T15:12:23.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:23.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd8a812f000 con 0x7fd8a811e790 2026-02-25T15:12:23.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.036+0000 7fd8af4b8640 1 librados: init done 2026-02-25T15:12:23.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.037+0000 7fd8af4b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.037+0000 7fd8af4b8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.037+0000 7fd8af4b8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:23.056 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.037+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a8186940 con 0x7fd8a811e790 2026-02-25T15:12:23.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.043+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8980034e0 con 0x7fd8a811e790 2026-02-25T15:12:23.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.043+0000 7fd895ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:23.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.043+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd898003b50 con 0x7fd8a811e790 2026-02-25T15:12:23.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.043+0000 7fd895ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.043+0000 7fd895ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:23.058 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.043+0000 7fd895ffb640 10 monclient: dump: 2026-02-25T15:12:23.058 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.043+0000 7fd8977fe640 4 set_mon_vals no callback set 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.044+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 1492658893 0 0) 0x7fd898003d30 con 0x7fd8a811e790 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.045+0000 7fd8aca2c640 10 monclient: get_auth_request con 0x7fd878077c30 auth_method 0 2026-02-25T15:12:23.059 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.045+0000 7fd895ffb640 10 client.4192.objecter ms_handle_connect 0x7fd878077c30 2026-02-25T15:12:23.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.046+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(13..13 src has 1..13) ==== 1985+0+0 (unknown 1335206765 0 0) 0x7fd898059490 con 0x7fd8a811e790 2026-02-25T15:12:23.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.046+0000 7fd895ffb640 10 client.4192.objecter ms_dispatch2 0x7fd8a8000b90 osd_map(13..13 src has 1..13) 2026-02-25T15:12:23.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.046+0000 7fd895ffb640 3 client.4192.objecter handle_osd_map got epochs [13,13] > 0 2026-02-25T15:12:23.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.046+0000 7fd895ffb640 3 client.4192.objecter handle_osd_map decoding full epoch 13 2026-02-25T15:12:23.060 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.046+0000 7fd895ffb640 20 client.4192.objecter dump_active .. 0 homeless 2026-02-25T15:12:23.133 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.131+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd89805dc00 con 0x7fd8a811e790 2026-02-25T15:12:23.133 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.131+0000 7fd895ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.133 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.131+0000 7fd895ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:23.244 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.242+0000 7fd8af4b8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "5102cdb4-cabf-4bf2-a0ff-fc6e20018bac", "id": 11}] 2026-02-25T15:12:23.244 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.242+0000 7fd8af4b8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "5102cdb4-cabf-4bf2-a0ff-fc6e20018bac", "id": 11}] 2026-02-25T15:12:23.244 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.242+0000 7fd8af4b8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:23.244 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.242+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "5102cdb4-cabf-4bf2-a0ff-fc6e20018bac", "id": 11} v 0) -- 0x7fd8a812f2f0 con 0x7fd8a811e790 2026-02-25T15:12:23.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.286+0000 7fd895ffb640 1 -- 10.20.193.174:0/3709036850 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5102cdb4-cabf-4bf2-a0ff-fc6e20018bac", "id": 11}]=0 v14) ==== 113+0+3 (unknown 253505153 0 212448812) 0x7fd898003b50 con 0x7fd8a811e790 2026-02-25T15:12:23.287 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.286+0000 7fd895ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "5102cdb4-cabf-4bf2-a0ff-fc6e20018bac", "id": 11}] 2026-02-25T15:12:23.288 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.286+0000 7fd895ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:23.288 INFO:teuthology.orchestra.run.trial174.stdout:11 2026-02-25T15:12:23.289 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 10 librados: watch_flush enter 2026-02-25T15:12:23.289 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 10 librados: watch_flush exit 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 20 client.4192.objecter shutdown clearing up homeless session... 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 10 client.4192.objecter successfully canceled tick 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 >> v1:10.20.193.78:6800/3497602169 conn(0x7fd878077c30 legacy=0x7fd8780980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 10 monclient: shutdown 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 >> v1:10.20.193.155:6789/0 conn(0x7fd8a811e790 legacy=0x7fd8a81826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 shutdown_connections 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 >> 10.20.193.174:0/3709036850 conn(0x7fd8a80588d0 msgr2=0x7fd8a8058ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 shutdown_connections 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 1 -- 10.20.193.174:0/3709036850 wait complete. 2026-02-25T15:12:23.290 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.287+0000 7fd8af4b8640 1 librados: shutdown 2026-02-25T15:12:23.298 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 3491fb62-65cb-4eef-a6d6-83faec6f22dd 12 2026-02-25T15:12:23.363 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.360+0000 7fb97c009640 10 monclient: get_monmap_and_config 2026-02-25T15:12:23.363 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.360+0000 7fb97c009640 10 monclient: build_initial_monmap 2026-02-25T15:12:23.363 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.360+0000 7fb97c009640 10 monclient: monmap: 2026-02-25T15:12:23.363 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:23.363 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:23.361409+0000 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:23.361409+0000 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 1 Processor -- start 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 1 -- start start 2026-02-25T15:12:23.364 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 10 monclient: init 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 10 monclient(hunting): picked mon.noname-c con 0x7fb97405d9b0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 10 monclient(hunting): picked mon.noname-a con 0x7fb97405dd80 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 10 monclient(hunting): picked mon.noname-b con 0x7fb9741649b0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97405e200 con 0x7fb97405dd80 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9741874c0 con 0x7fb9741649b0 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9741886a0 con 0x7fb97405d9b0 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb97c009640 10 monclient(hunting): authenticate will time out at 3306.020439s 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb979d7e640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fb97405d9b0 0x7fb97411b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:44996/0 (socket says 10.20.193.174:44996) 2026-02-25T15:12:23.365 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.361+0000 7fb979d7e640 1 -- 10.20.193.174:0/1194550430 learned_addr learned my addr 10.20.193.174:0/1194550430 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:23.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.362+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 541223427 0 0) 0x7fb9741874c0 con 0x7fb9741649b0 2026-02-25T15:12:23.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.362+0000 7fb978d7c640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.362+0000 7fb978d7c640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.362+0000 7fb978d7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.362+0000 7fb978d7c640 10 monclient(hunting): my global_id is 4195 2026-02-25T15:12:23.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb95c003610 con 0x7fb9741649b0 2026-02-25T15:12:23.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833656017 0 0) 0x7fb97405e200 con 0x7fb97405dd80 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 10 monclient(hunting): my global_id is 4185 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9741874c0 con 0x7fb97405dd80 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308602466 0 0) 0x7fb9741886a0 con 0x7fb97405d9b0 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 10 monclient(hunting): my global_id is 4190 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.363+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb97405e200 con 0x7fb97405d9b0 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1141928977 0 0) 0x7fb95c003610 con 0x7fb9741649b0 2026-02-25T15:12:23.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 >> v1:10.20.193.167:6789/0 conn(0x7fb97405d9b0 legacy=0x7fb97411b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 >> v1:10.20.193.78:6789/0 conn(0x7fb97405dd80 legacy=0x7fb97411b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 10 monclient: _finish_hunting 0 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 1 monclient: found mon.noname-b 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb974189920 con 0x7fb9741649b0 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 10 monclient: _finish_auth 0 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 10 monclient: _check_auth_tickets 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb970003170 con 0x7fb9741649b0 2026-02-25T15:12:23.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb978d7c640 10 monclient: dump: 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.377 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb97c009640 5 monclient: authenticate success, global_id 4195 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.364+0000 7fb97c009640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb9700033b0 con 0x7fb9741649b0 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb978d7c640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb978d7c640 1 -- 10.20.193.174:0/1194550430 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb9700037f0 con 0x7fb9741649b0 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb978d7c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb978d7c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb978d7c640 10 monclient: dump: 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.378 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 4 set_mon_vals no callback set 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 10 monclient: shutdown 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 1 -- 10.20.193.174:0/1194550430 >> v1:10.20.193.155:6789/0 conn(0x7fb9741649b0 legacy=0x7fb974184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 1 -- 10.20.193.174:0/1194550430 shutdown_connections 2026-02-25T15:12:23.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 1 -- 10.20.193.174:0/1194550430 >> 10.20.193.174:0/1194550430 conn(0x7fb9740588d0 msgr2=0x7fb974058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 1 -- 10.20.193.174:0/1194550430 shutdown_connections 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.365+0000 7fb97c009640 1 -- 10.20.193.174:0/1194550430 wait complete. 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient: build_initial_monmap 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient: monmap: 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:23.380 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 librados: starting msgr at 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 librados: starting objecter 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 Processor -- start 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 -- start start 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 librados: setting wanted keys 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 librados: calling monclient init 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient: init 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:23.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient(hunting): picked mon.noname-a con 0x7fb97405d9b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient(hunting): picked mon.noname-b con 0x7fb97405dd80 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient(hunting): picked mon.noname-c con 0x7fb9741649b0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb974102340 con 0x7fb97405d9b0 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb974109220 con 0x7fb97405dd80 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97410a400 con 0x7fb9741649b0 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97c009640 10 monclient(hunting): authenticate will time out at 3306.025316s 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb979d7e640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb97405d9b0 0x7fb974101830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.174:43806/0 (socket says 10.20.193.174:43806) 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb979d7e640 1 -- 10.20.193.174:0/2634333103 learned_addr learned my addr 10.20.193.174:0/2634333103 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb97a57f640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fb9741649b0 0x7fb9741630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:45012/0 (socket says 10.20.193.174:45012) 2026-02-25T15:12:23.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb9627fc640 10 client.?.objecter ms_handle_connect 0x7fb97405d9b0 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb9627fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb9627fc640 10 client.?.objecter ms_handle_connect 0x7fb9741649b0 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.366+0000 7fb9627fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.367+0000 7fb9627fc640 10 client.?.objecter ms_handle_connect 0x7fb97405dd80 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.367+0000 7fb9627fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.367+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404353032 0 0) 0x7fb974102340 con 0x7fb97405d9b0 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.367+0000 7fb9627fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.367+0000 7fb9627fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.367+0000 7fb9627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.367+0000 7fb9627fc640 10 monclient(hunting): my global_id is 4188 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.367+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb944003610 con 0x7fb97405d9b0 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703343553 0 0) 0x7fb974109220 con 0x7fb97405dd80 2026-02-25T15:12:23.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 10 monclient(hunting): my global_id is 4198 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb974102340 con 0x7fb97405dd80 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970795393 0 0) 0x7fb97410a400 con 0x7fb9741649b0 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 10 monclient(hunting): my global_id is 4193 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.368+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb974109220 con 0x7fb9741649b0 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3626570486 0 0) 0x7fb944003610 con 0x7fb97405d9b0 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb97410a400 con 0x7fb97405d9b0 2026-02-25T15:12:23.384 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2261926538 0 0) 0x7fb974109220 con 0x7fb9741649b0 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb944003610 con 0x7fb9741649b0 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb970003560 con 0x7fb9741649b0 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): dump: 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.385 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb9640031e0 con 0x7fb97405d9b0 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): dump: 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.386 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2548063538 0 0) 0x7fb974102340 con 0x7fb97405dd80 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb974109220 con 0x7fb97405dd80 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb968003070 con 0x7fb97405dd80 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:23.387 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.370+0000 7fb9627fc640 10 monclient(hunting): dump: 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.388 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1172702888 0 0) 0x7fb944003610 con 0x7fb9741649b0 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 >> v1:10.20.193.155:6789/0 conn(0x7fb97405dd80 legacy=0x7fb974161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 >> v1:10.20.193.78:6789/0 conn(0x7fb97405d9b0 legacy=0x7fb974101830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 10 monclient: _finish_hunting 0 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 1 monclient: found mon.c 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97410b5e0 con 0x7fb9741649b0 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 10 monclient: _finish_auth 0 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 10 monclient: _check_auth_tickets 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb9627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:23.389 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 5 monclient: authenticate success, global_id 4193 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 10 monclient: _renew_subs 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb97410a5d0 con 0x7fb9741649b0 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 10 client.4193.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 10 monclient: _renew_subs 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb97410ac10 con 0x7fb9741649b0 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.371+0000 7fb97c009640 1 librados: init done 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.372+0000 7fb97c009640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.372+0000 7fb97c009640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.372+0000 7fb97c009640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:23.390 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.372+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb974187b90 con 0x7fb9741649b0 2026-02-25T15:12:23.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.376+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb9700033b0 con 0x7fb9741649b0 2026-02-25T15:12:23.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.376+0000 7fb9627fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:23.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.376+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb970003dd0 con 0x7fb9741649b0 2026-02-25T15:12:23.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.376+0000 7fb9627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.376+0000 7fb9627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:23.392 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.376+0000 7fb9627fc640 10 monclient: dump: 2026-02-25T15:12:23.392 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.376+0000 7fb963fff640 4 set_mon_vals no callback set 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.380+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 1492658893 0 0) 0x7fb970003dd0 con 0x7fb9741649b0 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.380+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 2100+0+0 (unknown 2729522121 0 0) 0x7fb970059460 con 0x7fb9741649b0 2026-02-25T15:12:23.393 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.380+0000 7fb9627fc640 10 client.4193.objecter ms_dispatch2 0x7fb974000b90 osd_map(14..14 src has 1..14) 2026-02-25T15:12:23.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.380+0000 7fb9627fc640 3 client.4193.objecter handle_osd_map got epochs [14,14] > 0 2026-02-25T15:12:23.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.380+0000 7fb9627fc640 3 client.4193.objecter handle_osd_map decoding full epoch 14 2026-02-25T15:12:23.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.380+0000 7fb9627fc640 20 client.4193.objecter dump_active .. 0 homeless 2026-02-25T15:12:23.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.380+0000 7fb979d7e640 10 monclient: get_auth_request con 0x7fb944077c50 auth_method 0 2026-02-25T15:12:23.394 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.380+0000 7fb9627fc640 10 client.4193.objecter ms_handle_connect 0x7fb944077c50 2026-02-25T15:12:23.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.465+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb97005dbd0 con 0x7fb9741649b0 2026-02-25T15:12:23.466 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.465+0000 7fb9627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.467 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.465+0000 7fb9627fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:23.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.576+0000 7fb97c009640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3491fb62-65cb-4eef-a6d6-83faec6f22dd", "id": 12}] 2026-02-25T15:12:23.578 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.576+0000 7fb97c009640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3491fb62-65cb-4eef-a6d6-83faec6f22dd", "id": 12}] 2026-02-25T15:12:23.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.576+0000 7fb97c009640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:23.579 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.576+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd new", "uuid": "3491fb62-65cb-4eef-a6d6-83faec6f22dd", "id": 12} v 0) -- 0x7fb97410af50 con 0x7fb9741649b0 2026-02-25T15:12:23.623 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.622+0000 7fb9627fc640 1 -- 10.20.193.174:0/2634333103 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3491fb62-65cb-4eef-a6d6-83faec6f22dd", "id": 12}]=0 v15) ==== 113+0+3 (unknown 1273543457 0 944643765) 0x7fb97410af50 con 0x7fb9741649b0 2026-02-25T15:12:23.623 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.622+0000 7fb9627fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3491fb62-65cb-4eef-a6d6-83faec6f22dd", "id": 12}] 2026-02-25T15:12:23.623 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.622+0000 7fb9627fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:23.624 INFO:teuthology.orchestra.run.trial174.stdout:12 2026-02-25T15:12:23.625 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 10 librados: watch_flush enter 2026-02-25T15:12:23.625 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 10 librados: watch_flush exit 2026-02-25T15:12:23.625 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 20 client.4193.objecter shutdown clearing up homeless session... 2026-02-25T15:12:23.625 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 10 client.4193.objecter successfully canceled tick 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 >> v1:10.20.193.78:6800/3497602169 conn(0x7fb944077c50 legacy=0x7fb944098100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 10 monclient: shutdown 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 >> v1:10.20.193.167:6789/0 conn(0x7fb9741649b0 legacy=0x7fb9741630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 shutdown_connections 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 >> 10.20.193.174:0/2634333103 conn(0x7fb9740588d0 msgr2=0x7fb97405b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 shutdown_connections 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 1 -- 10.20.193.174:0/2634333103 wait complete. 2026-02-25T15:12:23.626 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.623+0000 7fb97c009640 1 librados: shutdown 2026-02-25T15:12:23.632 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new dc55bcec-89ee-4aa0-b54c-86770272f179 13 2026-02-25T15:12:23.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient: get_monmap_and_config 2026-02-25T15:12:23.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient: build_initial_monmap 2026-02-25T15:12:23.698 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient: monmap: 2026-02-25T15:12:23.698 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:23.698 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.698 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:23.695754+0000 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:23.695754+0000 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 1 Processor -- start 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 1 -- start start 2026-02-25T15:12:23.699 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient: init 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient(hunting): picked mon.noname-c con 0x7f022811c500 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient(hunting): picked mon.noname-b con 0x7f022811e420 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient(hunting): picked mon.noname-a con 0x7f022811ffc0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0228120d10 con 0x7f022811ffc0 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0228120f00 con 0x7f022811e420 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02281210f0 con 0x7f022811c500 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.695+0000 7f022ee16640 10 monclient(hunting): authenticate will time out at 3306.354712s 2026-02-25T15:12:23.700 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.696+0000 7f021ffff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f022811e420 0x7f022811e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.174:57466/0 (socket says 10.20.193.174:57466) 2026-02-25T15:12:23.701 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.696+0000 7f021ffff640 1 -- 10.20.193.174:0/3545480515 learned_addr learned my addr 10.20.193.174:0/3545480515 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:23.701 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.696+0000 7f022cb8b640 1 --1- 10.20.193.174:0/3545480515 >> v1:10.20.193.167:6789/0 conn(0x7f022811c500 0x7f022811c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:45026/0 (socket says 10.20.193.174:45026) 2026-02-25T15:12:23.731 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.729+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868195652 0 0) 0x7f0228120d10 con 0x7f022811ffc0 2026-02-25T15:12:23.731 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.729+0000 7f021f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.731 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.729+0000 7f021f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.731 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.729+0000 7f021f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.731 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.729+0000 7f021f7fe640 10 monclient(hunting): my global_id is 4191 2026-02-25T15:12:23.731 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.729+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0214003610 con 0x7f022811ffc0 2026-02-25T15:12:23.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3456513585 0 0) 0x7f0214003610 con 0x7f022811ffc0 2026-02-25T15:12:23.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 >> v1:10.20.193.167:6789/0 conn(0x7f022811c500 legacy=0x7f022811c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 >> v1:10.20.193.155:6789/0 conn(0x7f022811e420 legacy=0x7f022811e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:12:23.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 1 monclient: found mon.noname-a 2026-02-25T15:12:23.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:23.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:23.736 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0228121380 con 0x7f022811ffc0 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0224003170 con 0x7f022811ffc0 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f021f7fe640 10 monclient: dump: 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.737 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f022ee16640 5 monclient: authenticate success, global_id 4191 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.731+0000 7f022ee16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02240033f0 con 0x7f022811ffc0 2026-02-25T15:12:23.738 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f021f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f021f7fe640 1 -- 10.20.193.174:0/3545480515 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0224003830 con 0x7f022811ffc0 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f021f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f021f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f021f7fe640 10 monclient: dump: 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.739 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 4 set_mon_vals no callback set 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 10 monclient: shutdown 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 -- 10.20.193.174:0/3545480515 >> v1:10.20.193.78:6789/0 conn(0x7f022811ffc0 legacy=0x7f0228120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 -- 10.20.193.174:0/3545480515 shutdown_connections 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 -- 10.20.193.174:0/3545480515 >> 10.20.193.174:0/3545480515 conn(0x7f02280588d0 msgr2=0x7f0228058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 -- 10.20.193.174:0/3545480515 shutdown_connections 2026-02-25T15:12:23.740 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 -- 10.20.193.174:0/3545480515 wait complete. 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 10 monclient: build_initial_monmap 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 10 monclient: monmap: 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:23.741 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 librados: starting msgr at 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 librados: starting objecter 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 Processor -- start 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 -- start start 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 librados: setting wanted keys 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 1 librados: calling monclient init 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.732+0000 7f022ee16640 10 monclient: init 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:23.742 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 10 monclient(hunting): picked mon.noname-c con 0x7f022811c500 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 10 monclient(hunting): picked mon.noname-b con 0x7f022811e420 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 10 monclient(hunting): picked mon.noname-a con 0x7f022811ffc0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0228179820 con 0x7f022811ffc0 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f022817aa00 con 0x7f022811e420 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f022817bbe0 con 0x7f022811c500 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022ee16640 10 monclient(hunting): authenticate will time out at 3306.392073s 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022d38c640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f022811ffc0 0x7f0228178100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.174:43832/0 (socket says 10.20.193.174:43832) 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f022d38c640 1 -- 10.20.193.174:0/3400647916 learned_addr learned my addr 10.20.193.174:0/3400647916 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:23.743 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f021d7fa640 10 client.?.objecter ms_handle_connect 0x7f022811ffc0 2026-02-25T15:12:23.744 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.733+0000 7f021d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:23.744 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.734+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632967444 0 0) 0x7f0228179820 con 0x7f022811ffc0 2026-02-25T15:12:23.744 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.734+0000 7f021d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:12:23.744 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.734+0000 7f021d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:23.744 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.734+0000 7f021d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:23.744 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.734+0000 7f021d7fa640 10 monclient(hunting): my global_id is 4194 2026-02-25T15:12:23.744 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.734+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01f8003610 con 0x7f022811ffc0 2026-02-25T15:12:23.747 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.737+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2608402395 0 0) 0x7f01f8003610 con 0x7f022811ffc0 2026-02-25T15:12:23.747 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.737+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0228179820 con 0x7f022811ffc0 2026-02-25T15:12:23.747 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.737+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0224003080 con 0x7f022811ffc0 2026-02-25T15:12:23.747 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.737+0000 7f021d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:23.747 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.737+0000 7f021d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:23.747 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.737+0000 7f021d7fa640 10 monclient(hunting): dump: 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.748 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.737+0000 7f021d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3160628938 0 0) 0x7f0228179820 con 0x7f022811ffc0 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 >> v1:10.20.193.167:6789/0 conn(0x7f022811c500 legacy=0x7f0228130030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 >> v1:10.20.193.155:6789/0 conn(0x7f022811e420 legacy=0x7f02281769e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 1 monclient: found mon.a 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022817cdc0 con 0x7f022811ffc0 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 10 monclient: _finish_auth 0 2026-02-25T15:12:23.749 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f021d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 5 monclient: authenticate success, global_id 4194 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 10 monclient: _renew_subs 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f022817bdb0 con 0x7f022811ffc0 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 10 client.4194.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 10 monclient: _renew_subs 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f022817c3f0 con 0x7f022811ffc0 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.738+0000 7f022ee16640 1 librados: init done 2026-02-25T15:12:23.750 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.739+0000 7f022ee16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.751 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.739+0000 7f022ee16640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.751 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.739+0000 7f022ee16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:23.751 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.739+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022818b5c0 con 0x7f022811ffc0 2026-02-25T15:12:23.828 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.827+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0224003290 con 0x7f022811ffc0 2026-02-25T15:12:23.828 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.827+0000 7f021d7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.827+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0224003fb0 con 0x7f022811ffc0 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.827+0000 7f021d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.827+0000 7f021d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.827+0000 7f021d7fa640 10 monclient: dump: 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:23.829 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:23.830 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:23.830 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:23.830 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:23.830 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.827+0000 7f021effd640 4 set_mon_vals no callback set 2026-02-25T15:12:23.831 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.827+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 2381894596 0 0) 0x7f0224004190 con 0x7f022811ffc0 2026-02-25T15:12:23.831 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.828+0000 7f022cb8b640 10 monclient: get_auth_request con 0x7f01f8077b60 auth_method 0 2026-02-25T15:12:23.831 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.828+0000 7f021d7fa640 10 client.4194.objecter ms_handle_connect 0x7f01f8077b60 2026-02-25T15:12:23.833 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.831+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 2215+0+0 (unknown 567691915 0 0) 0x7f02240599e0 con 0x7f022811ffc0 2026-02-25T15:12:23.833 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.831+0000 7f021d7fa640 10 client.4194.objecter ms_dispatch2 0x7f0228000b90 osd_map(15..15 src has 1..15) 2026-02-25T15:12:23.833 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.831+0000 7f021d7fa640 3 client.4194.objecter handle_osd_map got epochs [15,15] > 0 2026-02-25T15:12:23.833 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.831+0000 7f021d7fa640 3 client.4194.objecter handle_osd_map decoding full epoch 15 2026-02-25T15:12:23.833 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.831+0000 7f021d7fa640 20 client.4194.objecter dump_active .. 0 homeless 2026-02-25T15:12:23.833 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.831+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f022405e150 con 0x7f022811ffc0 2026-02-25T15:12:23.833 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.831+0000 7f021d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:23.833 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.831+0000 7f021d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:23.943 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.941+0000 7f022ee16640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "dc55bcec-89ee-4aa0-b54c-86770272f179", "id": 13}] 2026-02-25T15:12:23.943 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.941+0000 7f022ee16640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "dc55bcec-89ee-4aa0-b54c-86770272f179", "id": 13}] 2026-02-25T15:12:23.943 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.941+0000 7f022ee16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:23.943 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.941+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd new", "uuid": "dc55bcec-89ee-4aa0-b54c-86770272f179", "id": 13} v 0) -- 0x7f022817c730 con 0x7f022811ffc0 2026-02-25T15:12:23.958 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.957+0000 7f021d7fa640 1 -- 10.20.193.174:0/3400647916 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc55bcec-89ee-4aa0-b54c-86770272f179", "id": 13}]=0 v16) ==== 113+0+3 (unknown 279054007 0 736921282) 0x7f022817c730 con 0x7f022811ffc0 2026-02-25T15:12:23.958 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.957+0000 7f021d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "dc55bcec-89ee-4aa0-b54c-86770272f179", "id": 13}] 2026-02-25T15:12:23.958 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.957+0000 7f021d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:23.958 INFO:teuthology.orchestra.run.trial174.stdout:13 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.957+0000 7f022ee16640 10 librados: watch_flush enter 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.957+0000 7f022ee16640 10 librados: watch_flush exit 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.957+0000 7f022ee16640 20 client.4194.objecter shutdown clearing up homeless session... 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.957+0000 7f022ee16640 10 client.4194.objecter successfully canceled tick 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 >> v1:10.20.193.78:6800/3497602169 conn(0x7f01f8077b60 legacy=0x7f01f8098010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 10 monclient: shutdown 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 >> v1:10.20.193.78:6789/0 conn(0x7f022811ffc0 legacy=0x7f0228178100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 shutdown_connections 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 >> 10.20.193.174:0/3400647916 conn(0x7f02280588d0 msgr2=0x7f0228059490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 shutdown_connections 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 1 -- 10.20.193.174:0/3400647916 wait complete. 2026-02-25T15:12:23.959 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:23.958+0000 7f022ee16640 1 librados: shutdown 2026-02-25T15:12:23.966 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 18e46ea0-0a65-4b4d-af19-79bacdd9a385 14 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient: get_monmap_and_config 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient: build_initial_monmap 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient: monmap: 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:24.028764+0000 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:24.028764+0000 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:24.029 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 1 Processor -- start 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 1 -- start start 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient: init 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient(hunting): picked mon.noname-a con 0x7f7bdc11c500 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient(hunting): picked mon.noname-b con 0x7f7bdc11e420 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient(hunting): picked mon.noname-c con 0x7f7bdc11ffc0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc120d10 con 0x7f7bdc11c500 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc120f00 con 0x7f7bdc11e420 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc1210f0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.028+0000 7f7be18cd640 10 monclient(hunting): authenticate will time out at 3306.687720s 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.029+0000 7f7bda7fc640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f7bdc11e420 0x7f7bdc11e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.174:57472/0 (socket says 10.20.193.174:57472) 2026-02-25T15:12:24.030 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.029+0000 7f7bda7fc640 1 -- 10.20.193.174:0/3306557711 learned_addr learned my addr 10.20.193.174:0/3306557711 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621205659 0 0) 0x7f7bdc120f00 con 0x7f7bdc11e420 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): my global_id is 4201 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bc8003610 con 0x7f7bdc11e420 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166315513 0 0) 0x7f7bdc120d10 con 0x7f7bdc11c500 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.031 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): my global_id is 4197 2026-02-25T15:12:24.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bdc120f00 con 0x7f7bdc11c500 2026-02-25T15:12:24.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109221704 0 0) 0x7f7bdc1210f0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 10 monclient(hunting): my global_id is 4196 2026-02-25T15:12:24.032 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.030+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bdc120d10 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2554199295 0 0) 0x7f7bc8003610 con 0x7f7bdc11e420 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 >> v1:10.20.193.167:6789/0 conn(0x7f7bdc11ffc0 legacy=0x7f7bdc120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 >> v1:10.20.193.78:6789/0 conn(0x7f7bdc11c500 legacy=0x7f7bdc11c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 1 monclient: found mon.noname-b 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc121380 con 0x7f7bdc11e420 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bc4002df0 con 0x7f7bdc11e420 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7bd9ffb640 10 monclient: dump: 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7be18cd640 5 monclient: authenticate success, global_id 4201 2026-02-25T15:12:24.033 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.031+0000 7f7be18cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bc4003030 con 0x7f7bdc11e420 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7bd9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7bd9ffb640 1 -- 10.20.193.174:0/3306557711 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bc4003470 con 0x7f7bdc11e420 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7bd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7bd9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7bd9ffb640 10 monclient: dump: 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7be18cd640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7be18cd640 4 set_mon_vals no callback set 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7be18cd640 10 monclient: shutdown 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7be18cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.032+0000 7f7be18cd640 1 -- 10.20.193.174:0/3306557711 >> v1:10.20.193.155:6789/0 conn(0x7f7bdc11e420 legacy=0x7f7bdc11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 -- 10.20.193.174:0/3306557711 shutdown_connections 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 -- 10.20.193.174:0/3306557711 >> 10.20.193.174:0/3306557711 conn(0x7f7bdc0588d0 msgr2=0x7f7bdc058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 -- 10.20.193.174:0/3306557711 shutdown_connections 2026-02-25T15:12:24.034 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 -- 10.20.193.174:0/3306557711 wait complete. 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient: build_initial_monmap 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient: monmap: 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 librados: starting msgr at 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 librados: starting objecter 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:24.035 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 Processor -- start 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 -- start start 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 librados: setting wanted keys 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 librados: calling monclient init 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient: init 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient(hunting): picked mon.noname-c con 0x7f7bdc11c500 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient(hunting): picked mon.noname-b con 0x7f7bdc11e420 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient(hunting): picked mon.noname-a con 0x7f7bdc11ffc0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc1029b0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc10b8e0 con 0x7f7bdc11e420 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc10cac0 con 0x7f7bdc11c500 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7be18cd640 10 monclient(hunting): authenticate will time out at 3306.692631s 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7bdaffd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f7bdc11c500 0x7f7bdc101f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:45056/0 (socket says 10.20.193.174:45056) 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.033+0000 7f7bdaffd640 1 -- 10.20.193.174:0/569014490 learned_addr learned my addr 10.20.193.174:0/569014490 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.034+0000 7f7bb3fff640 10 client.?.objecter ms_handle_connect 0x7f7bdc11ffc0 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.034+0000 7f7bb3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.034+0000 7f7bb3fff640 10 client.?.objecter ms_handle_connect 0x7f7bdc11e420 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.034+0000 7f7bb3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.034+0000 7f7bb3fff640 10 client.?.objecter ms_handle_connect 0x7f7bdc11c500 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.034+0000 7f7bb3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579658427 0 0) 0x7f7bdc1029b0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.036 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): my global_id is 4200 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bac003610 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22197057 0 0) 0x7f7bdc10cac0 con 0x7f7bdc11c500 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): my global_id is 4199 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bdc1029b0 con 0x7f7bdc11c500 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1889776008 0 0) 0x7f7bdc10b8e0 con 0x7f7bdc11e420 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 10 monclient(hunting): my global_id is 4204 2026-02-25T15:12:24.037 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.035+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bdc10cac0 con 0x7f7bdc11e420 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4072659732 0 0) 0x7f7bac003610 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bdc10b8e0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bcc003410 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 10 monclient(hunting): dump: 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.038 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2405845003 0 0) 0x7f7bdc10cac0 con 0x7f7bdc11e420 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bac003610 con 0x7f7bdc11e420 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bc40031e0 con 0x7f7bdc11e420 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.037+0000 7f7bb3fff640 10 monclient(hunting): dump: 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3352827282 0 0) 0x7f7bdc1029b0 con 0x7f7bdc11c500 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bdc10cac0 con 0x7f7bdc11c500 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bd0003170 con 0x7f7bdc11c500 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 10 monclient(hunting): dump: 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.039 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3903774885 0 0) 0x7f7bdc10b8e0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 >> v1:10.20.193.167:6789/0 conn(0x7f7bdc11c500 legacy=0x7f7bdc101f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 >> v1:10.20.193.155:6789/0 conn(0x7f7bdc11e420 legacy=0x7f7bdc18a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 1 monclient: found mon.a 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc10dca0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 10 monclient: _finish_auth 0 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7bb3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7be18cd640 5 monclient: authenticate success, global_id 4200 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7be18cd640 10 monclient: _renew_subs 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7be18cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.038+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc10bab0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.040 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 10 client.4200.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:24.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 10 monclient: _renew_subs 2026-02-25T15:12:24.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:24.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7bdc10c070 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 1 librados: init done 2026-02-25T15:12:24.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:24.041 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.039+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc18b560 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.043+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bcc003a80 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.043+0000 7f7bb3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.043+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bcc003dd0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.043+0000 7f7bb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.043+0000 7f7bb3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.043+0000 7f7bd97fa640 4 set_mon_vals no callback set 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.043+0000 7f7bb3fff640 10 monclient: dump: 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.044 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.047 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.046+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 2381894596 0 0) 0x7f7bcc01ca60 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.047+0000 7f7bdaffd640 10 monclient: get_auth_request con 0x7f7bac077d90 auth_method 0 2026-02-25T15:12:24.048 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.047+0000 7f7bb3fff640 10 client.4200.objecter ms_handle_connect 0x7f7bac077d90 2026-02-25T15:12:24.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.048+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 2330+0+0 (unknown 3447143298 0 0) 0x7f7bcc0585c0 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.048+0000 7f7bb3fff640 10 client.4200.objecter ms_dispatch2 0x7f7bdc000b90 osd_map(16..16 src has 1..16) 2026-02-25T15:12:24.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.048+0000 7f7bb3fff640 3 client.4200.objecter handle_osd_map got epochs [16,16] > 0 2026-02-25T15:12:24.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.048+0000 7f7bb3fff640 3 client.4200.objecter handle_osd_map decoding full epoch 16 2026-02-25T15:12:24.049 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.048+0000 7f7bb3fff640 20 client.4200.objecter dump_active .. 0 homeless 2026-02-25T15:12:24.131 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.130+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7bcc05cd30 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.131 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.130+0000 7f7bb3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.131 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.130+0000 7f7bb3fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:24.243 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.241+0000 7f7be18cd640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "18e46ea0-0a65-4b4d-af19-79bacdd9a385", "id": 14}] 2026-02-25T15:12:24.243 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.241+0000 7f7be18cd640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "18e46ea0-0a65-4b4d-af19-79bacdd9a385", "id": 14}] 2026-02-25T15:12:24.243 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.241+0000 7f7be18cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:24.243 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.241+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd new", "uuid": "18e46ea0-0a65-4b4d-af19-79bacdd9a385", "id": 14} v 0) -- 0x7f7bdc10c360 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.279+0000 7f7bb3fff640 1 -- 10.20.193.174:0/569014490 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "18e46ea0-0a65-4b4d-af19-79bacdd9a385", "id": 14}]=0 v17) ==== 113+0+3 (unknown 3531807101 0 1367428999) 0x7f7bcc05c630 con 0x7f7bdc11ffc0 2026-02-25T15:12:24.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.279+0000 7f7bb3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "18e46ea0-0a65-4b4d-af19-79bacdd9a385", "id": 14}] 2026-02-25T15:12:24.281 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.279+0000 7f7bb3fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:24.281 INFO:teuthology.orchestra.run.trial174.stdout:14 2026-02-25T15:12:24.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 10 librados: watch_flush enter 2026-02-25T15:12:24.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 10 librados: watch_flush exit 2026-02-25T15:12:24.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 20 client.4200.objecter shutdown clearing up homeless session... 2026-02-25T15:12:24.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 10 client.4200.objecter successfully canceled tick 2026-02-25T15:12:24.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7bac077d90 legacy=0x7f7bac098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 10 monclient: shutdown 2026-02-25T15:12:24.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:24.283 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 >> v1:10.20.193.78:6789/0 conn(0x7f7bdc11ffc0 legacy=0x7f7bdc18aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 shutdown_connections 2026-02-25T15:12:24.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 >> 10.20.193.174:0/569014490 conn(0x7f7bdc0588d0 msgr2=0x7f7bdc0591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:24.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 shutdown_connections 2026-02-25T15:12:24.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 1 -- 10.20.193.174:0/569014490 wait complete. 2026-02-25T15:12:24.284 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.281+0000 7f7be18cd640 1 librados: shutdown 2026-02-25T15:12:24.290 DEBUG:teuthology.orchestra.run.trial174:> sudo ceph --cluster ceph osd new 2dad930d-8547-4360-a38d-cc0d02d6d263 15 2026-02-25T15:12:24.354 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient: get_monmap_and_config 2026-02-25T15:12:24.354 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient: build_initial_monmap 2026-02-25T15:12:24.354 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient: monmap: 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:12:24.352658+0000 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:12:24.352658+0000 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:24.355 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 1 Processor -- start 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 1 -- start start 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient: init 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient(hunting): picked mon.noname-c con 0x7fd03405d9b0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient(hunting): picked mon.noname-b con 0x7fd03405dd80 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient(hunting): picked mon.noname-a con 0x7fd0341649b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03405e200 con 0x7fd0341649b0 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0341874c0 con 0x7fd03405dd80 2026-02-25T15:12:24.356 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0341886a0 con 0x7fd03405d9b0 2026-02-25T15:12:24.357 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:24.357 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.352+0000 7fd03b145640 10 monclient(hunting): authenticate will time out at 3307.011636s 2026-02-25T15:12:24.357 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.353+0000 7fd038eba640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fd03405d9b0 0x7fd03411b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:45064/0 (socket says 10.20.193.174:45064) 2026-02-25T15:12:24.357 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.353+0000 7fd038eba640 1 -- 10.20.193.174:0/3881044470 learned_addr learned my addr 10.20.193.174:0/3881044470 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:24.366 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066882697 0 0) 0x7fd0341886a0 con 0x7fd03405d9b0 2026-02-25T15:12:24.366 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.366 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.366 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.366 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): my global_id is 4202 2026-02-25T15:12:24.366 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd020003610 con 0x7fd03405d9b0 2026-02-25T15:12:24.366 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451282653 0 0) 0x7fd0341874c0 con 0x7fd03405dd80 2026-02-25T15:12:24.366 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): my global_id is 4207 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0341886a0 con 0x7fd03405dd80 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684687763 0 0) 0x7fd03405e200 con 0x7fd0341649b0 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 10 monclient(hunting): my global_id is 4203 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.354+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0341874c0 con 0x7fd0341649b0 2026-02-25T15:12:24.367 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 197072152 0 0) 0x7fd0341886a0 con 0x7fd03405dd80 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 >> v1:10.20.193.167:6789/0 conn(0x7fd03405d9b0 legacy=0x7fd03411b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 >> v1:10.20.193.78:6789/0 conn(0x7fd0341649b0 legacy=0x7fd034184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 1 monclient: found mon.noname-b 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd034189920 con 0x7fd03405dd80 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd01c002d70 con 0x7fd03405dd80 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.368 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd02b7fe640 10 monclient: dump: 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.369 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd03b145640 5 monclient: authenticate success, global_id 4207 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.355+0000 7fd03b145640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd01c002fb0 con 0x7fd03405dd80 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd02b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd02b7fe640 1 -- 10.20.193.174:0/3881044470 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd01c0033f0 con 0x7fd03405dd80 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd03b145640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd03b145640 4 set_mon_vals no callback set 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd02b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd02b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd02b7fe640 10 monclient: dump: 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.370 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd03b145640 10 monclient: shutdown 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd03b145640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd03b145640 1 -- 10.20.193.174:0/3881044470 >> v1:10.20.193.155:6789/0 conn(0x7fd03405dd80 legacy=0x7fd03411b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.371 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd03b145640 1 -- 10.20.193.174:0/3881044470 shutdown_connections 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd03b145640 1 -- 10.20.193.174:0/3881044470 >> 10.20.193.174:0/3881044470 conn(0x7fd0340588d0 msgr2=0x7fd034058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.356+0000 7fd03b145640 1 -- 10.20.193.174:0/3881044470 shutdown_connections 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 -- 10.20.193.174:0/3881044470 wait complete. 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient: build_initial_monmap 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient: monmap: 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:epoch 0 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 0.000000 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:created 0.000000 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:24.372 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 1 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 librados: starting msgr at 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 librados: starting objecter 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 Processor -- start 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 -- start start 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 librados: setting wanted keys 2026-02-25T15:12:24.373 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 librados: calling monclient init 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient: init 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient(hunting): picked mon.noname-a con 0x7fd03405d9b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient(hunting): picked mon.noname-c con 0x7fd03405dd80 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient(hunting): picked mon.noname-b con 0x7fd0341649b0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03416c660 con 0x7fd03405d9b0 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0341734b0 con 0x7fd0341649b0 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd034174690 con 0x7fd03405dd80 2026-02-25T15:12:24.374 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.357+0000 7fd03b145640 10 monclient(hunting): authenticate will time out at 3307.016644s 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.358+0000 7fd02bfff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fd03405dd80 0x7fd034161980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:45076/0 (socket says 10.20.193.174:45076) 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.358+0000 7fd02bfff640 1 -- 10.20.193.174:0/1972173205 learned_addr learned my addr 10.20.193.174:0/1972173205 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.358+0000 7fd0297fa640 10 client.?.objecter ms_handle_connect 0x7fd03405d9b0 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.358+0000 7fd0297fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.358+0000 7fd0297fa640 10 client.?.objecter ms_handle_connect 0x7fd0341649b0 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.358+0000 7fd0297fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.358+0000 7fd0297fa640 10 client.?.objecter ms_handle_connect 0x7fd03405dd80 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.358+0000 7fd0297fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421381410 0 0) 0x7fd03416c660 con 0x7fd03405d9b0 2026-02-25T15:12:24.375 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): my global_id is 4206 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd004003610 con 0x7fd03405d9b0 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933356190 0 0) 0x7fd0341734b0 con 0x7fd0341649b0 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): my global_id is 4210 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd03416c660 con 0x7fd0341649b0 2026-02-25T15:12:24.376 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923748267 0 0) 0x7fd034174690 con 0x7fd03405dd80 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 10 monclient(hunting): my global_id is 4205 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.359+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0341734b0 con 0x7fd03405dd80 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1959462783 0 0) 0x7fd03416c660 con 0x7fd0341649b0 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd034174690 con 0x7fd0341649b0 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd030003390 con 0x7fd0341649b0 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:24.377 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 10 monclient(hunting): dump: 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:24.378 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 717353644 0 0) 0x7fd004003610 con 0x7fd03405d9b0 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd03416c660 con 0x7fd03405d9b0 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd0240030b0 con 0x7fd03405d9b0 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.361+0000 7fd0297fa640 10 monclient(hunting): dump: 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.379 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.362+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3420770986 0 0) 0x7fd0341734b0 con 0x7fd03405dd80 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.362+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd004003610 con 0x7fd03405dd80 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.362+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd01c002d40 con 0x7fd03405dd80 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.362+0000 7fd0297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.362+0000 7fd0297fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.362+0000 7fd0297fa640 10 monclient(hunting): dump: 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.380 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 718996396 0 0) 0x7fd034174690 con 0x7fd0341649b0 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 >> v1:10.20.193.167:6789/0 conn(0x7fd03405dd80 legacy=0x7fd034161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 >> v1:10.20.193.78:6789/0 conn(0x7fd03405d9b0 legacy=0x7fd03416bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 10 monclient: _finish_hunting 0 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 1 monclient: found mon.b 2026-02-25T15:12:24.381 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd034175870 con 0x7fd0341649b0 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 10 monclient: _finish_auth 0 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 10 monclient: _check_auth_tickets 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd0297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 5 monclient: authenticate success, global_id 4210 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 10 monclient: _renew_subs 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd034173680 con 0x7fd0341649b0 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 10 client.4210.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:24.382 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 10 monclient: _renew_subs 2026-02-25T15:12:24.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd034173c20 con 0x7fd0341649b0 2026-02-25T15:12:24.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 1 librados: init done 2026-02-25T15:12:24.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.383 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.363+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0341869b0 con 0x7fd0341649b0 2026-02-25T15:12:24.452 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.450+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd030003a80 con 0x7fd0341649b0 2026-02-25T15:12:24.452 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.450+0000 7fd0297fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:24.452 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.450+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd030003dd0 con 0x7fd0341649b0 2026-02-25T15:12:24.452 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.450+0000 7fd0297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.452 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.450+0000 7fd0297fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:24.452 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.450+0000 7fd0297fa640 10 monclient: dump: 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:epoch 1 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:election_strategy: 3 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:12:24.453 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.450+0000 7fd02affd640 4 set_mon_vals no callback set 2026-02-25T15:12:24.454 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.451+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 2381894596 0 0) 0x7fd03001cc00 con 0x7fd0341649b0 2026-02-25T15:12:24.454 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.452+0000 7fd038eba640 10 monclient: get_auth_request con 0x7fd004077e40 auth_method 0 2026-02-25T15:12:24.454 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.452+0000 7fd0297fa640 10 client.4210.objecter ms_handle_connect 0x7fd004077e40 2026-02-25T15:12:24.455 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.454+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 2445+0+0 (unknown 1603067447 0 0) 0x7fd0300584c0 con 0x7fd0341649b0 2026-02-25T15:12:24.456 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.454+0000 7fd0297fa640 10 client.4210.objecter ms_dispatch2 0x7fd034000b90 osd_map(17..17 src has 1..17) 2026-02-25T15:12:24.456 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.454+0000 7fd0297fa640 3 client.4210.objecter handle_osd_map got epochs [17,17] > 0 2026-02-25T15:12:24.456 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.454+0000 7fd0297fa640 3 client.4210.objecter handle_osd_map decoding full epoch 17 2026-02-25T15:12:24.456 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.454+0000 7fd0297fa640 20 client.4210.objecter dump_active .. 0 homeless 2026-02-25T15:12:24.456 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.454+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd03005cc30 con 0x7fd0341649b0 2026-02-25T15:12:24.456 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.454+0000 7fd0297fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.456 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.454+0000 7fd0297fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:24.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.563+0000 7fd03b145640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "2dad930d-8547-4360-a38d-cc0d02d6d263", "id": 15}] 2026-02-25T15:12:24.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.563+0000 7fd03b145640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "2dad930d-8547-4360-a38d-cc0d02d6d263", "id": 15}] 2026-02-25T15:12:24.565 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.563+0000 7fd03b145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.566 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.563+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd new", "uuid": "2dad930d-8547-4360-a38d-cc0d02d6d263", "id": 15} v 0) -- 0x7fd034173f60 con 0x7fd0341649b0 2026-02-25T15:12:24.603 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.602+0000 7fd0297fa640 1 -- 10.20.193.174:0/1972173205 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2dad930d-8547-4360-a38d-cc0d02d6d263", "id": 15}]=0 v18) ==== 113+0+3 (unknown 2725761107 0 1109645296) 0x7fd03005c530 con 0x7fd0341649b0 2026-02-25T15:12:24.604 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.602+0000 7fd0297fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "2dad930d-8547-4360-a38d-cc0d02d6d263", "id": 15}] 2026-02-25T15:12:24.604 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.602+0000 7fd0297fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:24.604 INFO:teuthology.orchestra.run.trial174.stdout:15 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 10 librados: watch_flush enter 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 10 librados: watch_flush exit 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 20 client.4210.objecter shutdown clearing up homeless session... 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 10 client.4210.objecter successfully canceled tick 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 >> v1:10.20.193.78:6800/3497602169 conn(0x7fd004077e40 legacy=0x7fd0040982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 10 monclient: shutdown 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 >> v1:10.20.193.155:6789/0 conn(0x7fd0341649b0 legacy=0x7fd0341630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.606 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 shutdown_connections 2026-02-25T15:12:24.607 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.603+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 >> 10.20.193.174:0/1972173205 conn(0x7fd0340588d0 msgr2=0x7fd03405bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:24.607 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.604+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 shutdown_connections 2026-02-25T15:12:24.607 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.604+0000 7fd03b145640 1 -- 10.20.193.174:0/1972173205 wait complete. 2026-02-25T15:12:24.607 INFO:teuthology.orchestra.run.trial174.stderr:2026-02-25T15:12:24.604+0000 7fd03b145640 1 librados: shutdown 2026-02-25T15:12:24.614 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.615 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-25T15:12:24.615 DEBUG:teuthology.orchestra.run.trial078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-25T15:12:24.617 INFO:tasks.ceph.osd.0:Started 2026-02-25T15:12:24.618 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.618 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-25T15:12:24.618 DEBUG:teuthology.orchestra.run.trial078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-25T15:12:24.620 INFO:tasks.ceph.osd.4:Started 2026-02-25T15:12:24.621 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.621 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-25T15:12:24.621 DEBUG:teuthology.orchestra.run.trial078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-25T15:12:24.623 INFO:tasks.ceph.osd.8:Started 2026-02-25T15:12:24.623 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.624 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-25T15:12:24.624 DEBUG:teuthology.orchestra.run.trial078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-25T15:12:24.626 INFO:tasks.ceph.osd.12:Started 2026-02-25T15:12:24.627 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.627 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-25T15:12:24.627 DEBUG:teuthology.orchestra.run.trial155:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-25T15:12:24.629 INFO:tasks.ceph.osd.1:Started 2026-02-25T15:12:24.630 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.630 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-25T15:12:24.630 DEBUG:teuthology.orchestra.run.trial155:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-25T15:12:24.632 INFO:tasks.ceph.osd.5:Started 2026-02-25T15:12:24.633 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.633 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-25T15:12:24.633 DEBUG:teuthology.orchestra.run.trial155:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-25T15:12:24.636 INFO:tasks.ceph.osd.9:Started 2026-02-25T15:12:24.636 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.636 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-25T15:12:24.636 DEBUG:teuthology.orchestra.run.trial155:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-25T15:12:24.639 INFO:tasks.ceph.osd.13:Started 2026-02-25T15:12:24.639 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.639 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-25T15:12:24.639 DEBUG:teuthology.orchestra.run.trial167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-25T15:12:24.642 INFO:tasks.ceph.osd.2:Started 2026-02-25T15:12:24.642 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.643 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-25T15:12:24.643 DEBUG:teuthology.orchestra.run.trial167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-25T15:12:24.645 INFO:tasks.ceph.osd.6:Started 2026-02-25T15:12:24.646 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.646 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-25T15:12:24.646 DEBUG:teuthology.orchestra.run.trial167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-25T15:12:24.648 INFO:tasks.ceph.osd.10:Started 2026-02-25T15:12:24.648 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.649 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-25T15:12:24.649 DEBUG:teuthology.orchestra.run.trial167:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-25T15:12:24.651 INFO:tasks.ceph.osd.14:Started 2026-02-25T15:12:24.651 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.651 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-25T15:12:24.652 DEBUG:teuthology.orchestra.run.trial174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-25T15:12:24.654 INFO:tasks.ceph.osd.3:Started 2026-02-25T15:12:24.654 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.655 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-25T15:12:24.655 DEBUG:teuthology.orchestra.run.trial174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-25T15:12:24.657 INFO:tasks.ceph.osd.7:Started 2026-02-25T15:12:24.657 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.658 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-25T15:12:24.658 DEBUG:teuthology.orchestra.run.trial174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-25T15:12:24.660 INFO:tasks.ceph.osd.11:Started 2026-02-25T15:12:24.660 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:12:24.661 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-25T15:12:24.661 DEBUG:teuthology.orchestra.run.trial174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-25T15:12:24.663 INFO:tasks.ceph.osd.15:Started 2026-02-25T15:12:24.664 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T15:12:24.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.735+0000 7f7a3bbe0640 10 monclient: get_monmap_and_config 2026-02-25T15:12:24.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.735+0000 7f7a3bbe0640 10 monclient: build_initial_monmap 2026-02-25T15:12:24.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.735+0000 7f7a3bbe0640 10 monclient: monmap: 2026-02-25T15:12:24.737 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:24.737 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.737 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:12:24.735987+0000 2026-02-25T15:12:24.737 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:12:24.735987+0000 2026-02-25T15:12:24.737 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:24.738 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:24.738 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:24.738 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:24.738 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:24.738 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.735+0000 7f7a3bbe0640 1 Processor -- start 2026-02-25T15:12:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.735+0000 7f7a3bbe0640 1 -- start start 2026-02-25T15:12:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.735+0000 7f7a3bbe0640 10 monclient: init 2026-02-25T15:12:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:12:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 10 monclient(hunting): picked mon.noname-b con 0x7f7a34155ae0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 10 monclient(hunting): picked mon.noname-a con 0x7f7a34057900 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 10 monclient(hunting): picked mon.noname-c con 0x7f7a34163020 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340b5a30 con 0x7f7a34057900 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340b5d10 con 0x7f7a34155ae0 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340b5ff0 con 0x7f7a34163020 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a3bbe0640 10 monclient(hunting): authenticate will time out at 3314.325254s 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a39154640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7a34057900 0x7f7a34162910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:49480/0 (socket says 10.20.193.78:49480) 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.736+0000 7f7a39154640 1 -- 10.20.193.78:0/2166229449 learned_addr learned my addr 10.20.193.78:0/2166229449 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512096868 0 0) 0x7f7a340b5a30 con 0x7f7a34057900 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): my global_id is 4209 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a1c003610 con 0x7f7a34057900 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90704631 0 0) 0x7f7a340b5ff0 con 0x7f7a34163020 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): my global_id is 4208 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a340b5a30 con 0x7f7a34163020 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244698403 0 0) 0x7f7a340b5d10 con 0x7f7a34155ae0 2026-02-25T15:12:24.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 10 monclient(hunting): my global_id is 4213 2026-02-25T15:12:24.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.738+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a340b5ff0 con 0x7f7a34155ae0 2026-02-25T15:12:24.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3391200642 0 0) 0x7f7a1c003610 con 0x7f7a34057900 2026-02-25T15:12:24.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 >> v1:10.20.193.167:6789/0 conn(0x7f7a34163020 legacy=0x7f7a340b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 >> v1:10.20.193.155:6789/0 conn(0x7f7a34155ae0 legacy=0x7f7a340571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 10 monclient: _finish_hunting 0 2026-02-25T15:12:24.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 1 monclient: found mon.noname-a 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340b62d0 con 0x7f7a34057900 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 10 monclient: _finish_auth 0 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 10 monclient: _check_auth_tickets 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a28002df0 con 0x7f7a34057900 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a3bbe0640 5 monclient: authenticate success, global_id 4209 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a3bbe0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:24.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a38953640 10 monclient: dump: 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.750 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.740+0000 7f7a3bbe0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a28002fc0 con 0x7f7a34057900 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a38953640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a38953640 1 -- 10.20.193.78:0/2166229449 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a28003400 con 0x7f7a34057900 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a38953640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a38953640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a38953640 10 monclient: dump: 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:24.751 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 4 set_mon_vals no callback set 2026-02-25T15:12:24.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 10 monclient: shutdown 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/2166229449 >> v1:10.20.193.78:6789/0 conn(0x7f7a34057900 legacy=0x7f7a34162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/2166229449 shutdown_connections 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/2166229449 >> 10.20.193.78:0/2166229449 conn(0x7f7a340b3830 msgr2=0x7f7a340b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/2166229449 shutdown_connections 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.743+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/2166229449 wait complete. 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 10 monclient: build_initial_monmap 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 10 monclient: monmap: 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:24.753 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 1 librados: starting msgr at 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 1 librados: starting objecter 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 1 Processor -- start 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 1 -- start start 2026-02-25T15:12:24.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 1 librados: setting wanted keys 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 1 librados: calling monclient init 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.744+0000 7f7a3bbe0640 10 monclient: init 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 10 monclient(hunting): picked mon.noname-a con 0x7f7a34057900 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 10 monclient(hunting): picked mon.noname-b con 0x7f7a34155ae0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 10 monclient(hunting): picked mon.noname-c con 0x7f7a34163020 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a34131dd0 con 0x7f7a34057900 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340afef0 con 0x7f7a34155ae0 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340aea30 con 0x7f7a34163020 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a3bbe0640 10 monclient(hunting): authenticate will time out at 3314.334425s 2026-02-25T15:12:24.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a39154640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f7a34155ae0 0x7f7a34132b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:52756/0 (socket says 10.20.193.78:52756) 2026-02-25T15:12:24.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.745+0000 7f7a39154640 1 -- 10.20.193.78:0/3110320304 learned_addr learned my addr 10.20.193.78:0/3110320304 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:24.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.746+0000 7f7a227fc640 10 client.?.objecter ms_handle_connect 0x7f7a34155ae0 2026-02-25T15:12:24.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.746+0000 7f7a227fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.746+0000 7f7a227fc640 10 client.?.objecter ms_handle_connect 0x7f7a34163020 2026-02-25T15:12:24.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.746+0000 7f7a227fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963638106 0 0) 0x7f7a340afef0 con 0x7f7a34155ae0 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 10 monclient(hunting): my global_id is 4216 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a04003610 con 0x7f7a34155ae0 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958245562 0 0) 0x7f7a340aea30 con 0x7f7a34163020 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 10 monclient(hunting): my global_id is 4211 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.747+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a340afef0 con 0x7f7a34163020 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1743594818 0 0) 0x7f7a04003610 con 0x7f7a34155ae0 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a340aea30 con 0x7f7a34155ae0 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a28003310 con 0x7f7a34155ae0 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 10 monclient(hunting): dump: 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.761 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 10 client.?.objecter ms_handle_connect 0x7f7a34057900 2026-02-25T15:12:24.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.749+0000 7f7a227fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.750+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1181341169 0 0) 0x7f7a340afef0 con 0x7f7a34163020 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.750+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a04003610 con 0x7f7a34163020 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.750+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a300032f0 con 0x7f7a34163020 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.750+0000 7f7a227fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.750+0000 7f7a227fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.750+0000 7f7a227fc640 10 monclient(hunting): dump: 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.763 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.751+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171907428 0 0) 0x7f7a34131dd0 con 0x7f7a34057900 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.751+0000 7f7a227fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.751+0000 7f7a227fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.751+0000 7f7a227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.751+0000 7f7a227fc640 10 monclient(hunting): my global_id is 4212 2026-02-25T15:12:24.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.751+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a340afef0 con 0x7f7a34057900 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3095701945 0 0) 0x7f7a340aea30 con 0x7f7a34155ae0 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 >> v1:10.20.193.167:6789/0 conn(0x7f7a34163020 legacy=0x7f7a341f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 >> v1:10.20.193.78:6789/0 conn(0x7f7a34057900 legacy=0x7f7a340ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 10 monclient: _finish_hunting 0 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 1 monclient: found mon.b 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340b01b0 con 0x7f7a34155ae0 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 10 monclient: _finish_auth 0 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 10 monclient: _check_auth_tickets 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 5 monclient: authenticate success, global_id 4216 2026-02-25T15:12:24.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 10 monclient: _renew_subs 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a34132070 con 0x7f7a34155ae0 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 10 client.4216.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 10 monclient: _renew_subs 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a340b0490 con 0x7f7a34155ae0 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 1 librados: init done 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.752+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a34133f50 con 0x7f7a34155ae0 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.759+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a28002fc0 con 0x7f7a34155ae0 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.759+0000 7f7a227fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.759+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a28004b80 con 0x7f7a34155ae0 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.759+0000 7f7a227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.759+0000 7f7a227fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.759+0000 7f7a227fc640 10 monclient: dump: 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:24.768 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.759+0000 7f7a23fff640 4 set_mon_vals no callback set 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.760+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 2381894596 0 0) 0x7f7a28004d60 con 0x7f7a34155ae0 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.760+0000 7f7a39955640 10 monclient: get_auth_request con 0x7f7a04077d20 auth_method 0 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.760+0000 7f7a227fc640 10 client.4216.objecter ms_handle_connect 0x7f7a04077d20 2026-02-25T15:12:24.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.762+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 2549112883 0 0) 0x7f7a280595e0 con 0x7f7a34155ae0 2026-02-25T15:12:24.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.762+0000 7f7a227fc640 10 client.4216.objecter ms_dispatch2 0x7f7a34000b90 osd_map(18..18 src has 1..18) 2026-02-25T15:12:24.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.762+0000 7f7a227fc640 3 client.4216.objecter handle_osd_map got epochs [18,18] > 0 2026-02-25T15:12:24.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.762+0000 7f7a227fc640 3 client.4216.objecter handle_osd_map decoding full epoch 18 2026-02-25T15:12:24.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.762+0000 7f7a227fc640 20 client.4216.objecter dump_active .. 0 homeless 2026-02-25T15:12:24.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.846+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7a2805dd50 con 0x7f7a34155ae0 2026-02-25T15:12:24.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.846+0000 7f7a227fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:24.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.846+0000 7f7a227fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:24.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.963+0000 7f7a3bbe0640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:24.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.963+0000 7f7a3bbe0640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:24.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.963+0000 7f7a3bbe0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:24.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.963+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a34133c70 con 0x7f7a34155ae0 2026-02-25T15:12:24.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.984+0000 7f7a227fc640 1 -- 10.20.193.78:0/3110320304 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 2560615050) 0x7f7a2805d650 con 0x7f7a34155ae0 2026-02-25T15:12:24.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.984+0000 7f7a227fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:24.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.984+0000 7f7a227fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:24.987 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:12:24.987 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":18,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:12:24.570919+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:12:24.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 10 librados: watch_flush enter 2026-02-25T15:12:24.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 10 librados: watch_flush exit 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 20 client.4216.objecter shutdown clearing up homeless session... 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 10 client.4216.objecter successfully canceled tick 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7a04077d20 legacy=0x7f7a040981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 10 monclient: shutdown 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 >> v1:10.20.193.155:6789/0 conn(0x7f7a34155ae0 legacy=0x7f7a34132b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 shutdown_connections 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 >> 10.20.193.78:0/3110320304 conn(0x7f7a340b3830 msgr2=0x7f7a340b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:24.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 shutdown_connections 2026-02-25T15:12:24.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 1 -- 10.20.193.78:0/3110320304 wait complete. 2026-02-25T15:12:24.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:24.987+0000 7f7a3bbe0640 1 librados: shutdown 2026-02-25T15:12:24.998 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-25T15:12:24.999 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-25T15:12:26.613 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:12:26.673 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.671+0000 7f7a4d27b640 10 monclient: get_monmap_and_config 2026-02-25T15:12:26.673 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.671+0000 7f7a4d27b640 10 monclient: build_initial_monmap 2026-02-25T15:12:26.673 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.671+0000 7f7a4d27b640 10 monclient: monmap: 2026-02-25T15:12:26.673 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:12:26.672014+0000 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:12:26.672014+0000 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.671+0000 7f7a4d27b640 1 Processor -- start 2026-02-25T15:12:26.674 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.671+0000 7f7a4d27b640 1 -- start start 2026-02-25T15:12:26.675 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.671+0000 7f7a4d27b640 10 monclient: init 2026-02-25T15:12:26.677 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:26.677 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:12:26.677 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 10 monclient(hunting): picked mon.noname-c con 0x7f7a48058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:26.677 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 10 monclient(hunting): picked mon.noname-a con 0x7f7a480b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:26.677 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 10 monclient(hunting): picked mon.noname-b con 0x7f7a481626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:26.677 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a481655c0 con 0x7f7a480b0410 2026-02-25T15:12:26.677 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a480b12b0 con 0x7f7a481626a0 2026-02-25T15:12:26.677 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a480b1590 con 0x7f7a48058da0 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a4d27b640 10 monclient(hunting): authenticate will time out at 3316.261150s 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a46575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7a480b0410 0x7f7a48164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:49508/0 (socket says 10.20.193.78:49508) 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.672+0000 7f7a46575640 1 -- 10.20.193.78:0/491492671 learned_addr learned my addr 10.20.193.78:0/491492671 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.673+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250252520 0 0) 0x7f7a481655c0 con 0x7f7a480b0410 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.673+0000 7f7a45d74640 10 monclient(hunting): _negotiate 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.673+0000 7f7a45d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.673+0000 7f7a45d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.673+0000 7f7a45d74640 10 monclient(hunting): my global_id is 4215 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.673+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a34003610 con 0x7f7a480b0410 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524934036 0 0) 0x7f7a480b1590 con 0x7f7a48058da0 2026-02-25T15:12:26.678 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 10 monclient(hunting): _negotiate 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 10 monclient(hunting): my global_id is 4214 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a481655c0 con 0x7f7a48058da0 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380701393 0 0) 0x7f7a480b12b0 con 0x7f7a481626a0 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 10 monclient(hunting): _negotiate 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 10 monclient(hunting): my global_id is 4219 2026-02-25T15:12:26.679 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.674+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a480b1590 con 0x7f7a481626a0 2026-02-25T15:12:26.684 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3190415564 0 0) 0x7f7a34003610 con 0x7f7a480b0410 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 >> v1:10.20.193.167:6789/0 conn(0x7f7a48058da0 legacy=0x7f7a481647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 >> v1:10.20.193.155:6789/0 conn(0x7f7a481626a0 legacy=0x7f7a481c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 10 monclient: _finish_hunting 0 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 1 monclient: found mon.noname-a 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a480b1870 con 0x7f7a480b0410 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 10 monclient: _finish_auth 0 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 10 monclient: _check_auth_tickets 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:26.685 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a30002df0 con 0x7f7a480b0410 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a45d74640 10 monclient: dump: 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:26.686 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a4d27b640 5 monclient: authenticate success, global_id 4215 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.675+0000 7f7a4d27b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a30002fc0 con 0x7f7a480b0410 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a45d74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a45d74640 1 -- 10.20.193.78:0/491492671 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a30003400 con 0x7f7a480b0410 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a45d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a45d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a45d74640 10 monclient: dump: 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:26.687 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 4 set_mon_vals no callback set 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 10 monclient: shutdown 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:26.688 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 1 -- 10.20.193.78:0/491492671 >> v1:10.20.193.78:6789/0 conn(0x7f7a480b0410 legacy=0x7f7a48164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 1 -- 10.20.193.78:0/491492671 shutdown_connections 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 1 -- 10.20.193.78:0/491492671 >> 10.20.193.78:0/491492671 conn(0x7f7a480b65f0 msgr2=0x7f7a480b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 1 -- 10.20.193.78:0/491492671 shutdown_connections 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.676+0000 7f7a4d27b640 1 -- 10.20.193.78:0/491492671 wait complete. 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 10 monclient: build_initial_monmap 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 10 monclient: monmap: 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:created 0.000000 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 1 2026-02-25T15:12:26.689 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 1 librados: starting msgr at 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 1 librados: starting objecter 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 1 Processor -- start 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 1 -- start start 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 1 librados: setting wanted keys 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 1 librados: calling monclient init 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.677+0000 7f7a4d27b640 10 monclient: init 2026-02-25T15:12:26.690 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 10 monclient(hunting): picked mon.noname-b con 0x7f7a48058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 10 monclient(hunting): picked mon.noname-a con 0x7f7a480b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 10 monclient(hunting): picked mon.noname-c con 0x7f7a481626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a480a8880 con 0x7f7a480b0410 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a481634a0 con 0x7f7a48058da0 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a480a7d00 con 0x7f7a481626a0 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a4d27b640 10 monclient(hunting): authenticate will time out at 3316.267075s 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a46575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7a480b0410 0x7f7a4805bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:49514/0 (socket says 10.20.193.78:49514) 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a46575640 1 -- 10.20.193.78:0/2634972242 learned_addr learned my addr 10.20.193.78:0/2634972242 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a277fe640 10 client.?.objecter ms_handle_connect 0x7f7a480b0410 2026-02-25T15:12:26.691 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a277fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a277fe640 10 client.?.objecter ms_handle_connect 0x7f7a481626a0 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.678+0000 7f7a277fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474499104 0 0) 0x7f7a480a8880 con 0x7f7a480b0410 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 monclient(hunting): my global_id is 4218 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a14003610 con 0x7f7a480b0410 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 client.?.objecter ms_handle_connect 0x7f7a48058da0 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088633227 0 0) 0x7f7a480a7d00 con 0x7f7a481626a0 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:26.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 10 monclient(hunting): my global_id is 4217 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.679+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a480a8880 con 0x7f7a481626a0 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.680+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430905568 0 0) 0x7f7a481634a0 con 0x7f7a48058da0 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.680+0000 7f7a277fe640 10 monclient(hunting): _negotiate 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.680+0000 7f7a277fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.680+0000 7f7a277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.680+0000 7f7a277fe640 10 monclient(hunting): my global_id is 4222 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.680+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a480a7d00 con 0x7f7a48058da0 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.681+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1070489973 0 0) 0x7f7a14003610 con 0x7f7a480b0410 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.681+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a481634a0 con 0x7f7a480b0410 2026-02-25T15:12:26.693 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.681+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a30003310 con 0x7f7a480b0410 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 10 monclient(hunting): dump: 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:26.694 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2097740826 0 0) 0x7f7a480a8880 con 0x7f7a481626a0 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a14003610 con 0x7f7a481626a0 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a38003330 con 0x7f7a481626a0 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.682+0000 7f7a277fe640 10 monclient(hunting): dump: 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:26.695 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:26.696 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:26.696 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:26.696 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:26.696 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:26.698 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2453440318 0 0) 0x7f7a481634a0 con 0x7f7a480b0410 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 >> v1:10.20.193.167:6789/0 conn(0x7f7a481626a0 legacy=0x7f7a48124e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 >> v1:10.20.193.155:6789/0 conn(0x7f7a48058da0 legacy=0x7f7a48162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 10 monclient: _finish_hunting 0 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 1 monclient: found mon.a 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a480a7fe0 con 0x7f7a480b0410 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 10 monclient: _finish_auth 0 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 10 monclient: _check_auth_tickets 2026-02-25T15:12:26.699 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 5 monclient: authenticate success, global_id 4218 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 10 monclient: _renew_subs 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a480a82c0 con 0x7f7a480b0410 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 10 client.4218.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 10 monclient: _renew_subs 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a4805b790 con 0x7f7a480b0410 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.683+0000 7f7a4d27b640 1 librados: init done 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.684+0000 7f7a4d27b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.684+0000 7f7a4d27b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.684+0000 7f7a4d27b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:26.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.684+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a48163990 con 0x7f7a480b0410 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.692+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a30002f30 con 0x7f7a480b0410 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.692+0000 7f7a277fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.692+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a30004d20 con 0x7f7a480b0410 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.692+0000 7f7a277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.692+0000 7f7a277fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.692+0000 7f7a45573640 4 set_mon_vals no callback set 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.692+0000 7f7a277fe640 10 monclient: dump: 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:26.701 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.692+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 2381894596 0 0) 0x7f7a3001db50 con 0x7f7a480b0410 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.693+0000 7f7a46d76640 10 monclient: get_auth_request con 0x7f7a14077c70 auth_method 0 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.693+0000 7f7a277fe640 10 client.4218.objecter ms_handle_connect 0x7f7a14077c70 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.695+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 2549112883 0 0) 0x7f7a300595b0 con 0x7f7a480b0410 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.695+0000 7f7a277fe640 10 client.4218.objecter ms_dispatch2 0x7f7a48000b90 osd_map(18..18 src has 1..18) 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.695+0000 7f7a277fe640 3 client.4218.objecter handle_osd_map got epochs [18,18] > 0 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.695+0000 7f7a277fe640 3 client.4218.objecter handle_osd_map decoding full epoch 18 2026-02-25T15:12:26.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.695+0000 7f7a277fe640 20 client.4218.objecter dump_active .. 0 homeless 2026-02-25T15:12:26.783 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.781+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7a3005dd20 con 0x7f7a480b0410 2026-02-25T15:12:26.783 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.781+0000 7f7a277fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:26.784 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.781+0000 7f7a277fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:26.895 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.892+0000 7f7a4d27b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:26.895 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.892+0000 7f7a4d27b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:26.895 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.892+0000 7f7a4d27b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:26.895 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.892+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a480b6e40 con 0x7f7a480b0410 2026-02-25T15:12:26.917 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.914+0000 7f7a277fe640 1 -- 10.20.193.78:0/2634972242 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 2560615050) 0x7f7a3005d620 con 0x7f7a480b0410 2026-02-25T15:12:26.917 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.914+0000 7f7a277fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:26.917 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.914+0000 7f7a277fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:26.917 INFO:teuthology.misc.health.trial078.stdout: 2026-02-25T15:12:26.917 INFO:teuthology.misc.health.trial078.stdout:{"epoch":18,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:12:24.570919+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:12:26.920 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.917+0000 7f7a4d27b640 10 librados: watch_flush enter 2026-02-25T15:12:26.920 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.917+0000 7f7a4d27b640 10 librados: watch_flush exit 2026-02-25T15:12:26.920 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.917+0000 7f7a4d27b640 20 client.4218.objecter shutdown clearing up homeless session... 2026-02-25T15:12:26.920 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.917+0000 7f7a4d27b640 10 client.4218.objecter successfully canceled tick 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.917+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7a14077c70 legacy=0x7f7a14098120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.917+0000 7f7a4d27b640 10 monclient: shutdown 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.917+0000 7f7a4d27b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.917+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 >> v1:10.20.193.78:6789/0 conn(0x7f7a480b0410 legacy=0x7f7a4805bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.918+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 shutdown_connections 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.918+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 >> 10.20.193.78:0/2634972242 conn(0x7f7a480b65f0 msgr2=0x7f7a4805dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.918+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 shutdown_connections 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.918+0000 7f7a4d27b640 1 -- 10.20.193.78:0/2634972242 wait complete. 2026-02-25T15:12:26.921 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:26.918+0000 7f7a4d27b640 1 librados: shutdown 2026-02-25T15:12:26.928 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-25T15:12:34.540 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:12:34.602 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.600+0000 7f8e7de46640 10 monclient: get_monmap_and_config 2026-02-25T15:12:34.602 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.600+0000 7f8e7de46640 10 monclient: build_initial_monmap 2026-02-25T15:12:34.602 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.600+0000 7f8e7de46640 10 monclient: monmap: 2026-02-25T15:12:34.602 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:12:34.601006+0000 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:12:34.601006+0000 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.600+0000 7f8e7de46640 1 Processor -- start 2026-02-25T15:12:34.603 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.600+0000 7f8e7de46640 1 -- start start 2026-02-25T15:12:34.604 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.600+0000 7f8e7de46640 10 monclient: init 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 10 monclient(hunting): picked mon.noname-b con 0x7f8e78058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 10 monclient(hunting): picked mon.noname-c con 0x7f8e780b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 10 monclient(hunting): picked mon.noname-a con 0x7f8e781626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e781655c0 con 0x7f8e781626a0 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e780b12b0 con 0x7f8e78058da0 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e780b1590 con 0x7f8e780b0410 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:34.606 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e7de46640 10 monclient(hunting): authenticate will time out at 3324.190091s 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e77fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f8e781626a0 0x7f8e781c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50154/0 (socket says 10.20.193.78:50154) 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.601+0000 7f8e77fff640 1 -- 10.20.193.78:0/1843482933 learned_addr learned my addr 10.20.193.78:0/1843482933 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648485767 0 0) 0x7f8e780b1590 con 0x7f8e780b0410 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): my global_id is 4220 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e5c003610 con 0x7f8e780b0410 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294751634 0 0) 0x7f8e780b12b0 con 0x7f8e78058da0 2026-02-25T15:12:34.607 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:34.608 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:34.608 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:34.608 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): my global_id is 4225 2026-02-25T15:12:34.608 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e780b1590 con 0x7f8e78058da0 2026-02-25T15:12:34.608 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1290744934 0 0) 0x7f8e781655c0 con 0x7f8e781626a0 2026-02-25T15:12:34.608 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _negotiate 2026-02-25T15:12:34.608 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:34.609 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:34.609 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 10 monclient(hunting): my global_id is 4221 2026-02-25T15:12:34.609 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.603+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e780b12b0 con 0x7f8e781626a0 2026-02-25T15:12:34.613 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4275658319 0 0) 0x7f8e5c003610 con 0x7f8e780b0410 2026-02-25T15:12:34.613 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 >> v1:10.20.193.155:6789/0 conn(0x7f8e78058da0 legacy=0x7f8e781647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:34.613 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 >> v1:10.20.193.78:6789/0 conn(0x7f8e781626a0 legacy=0x7f8e781c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:34.613 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 10 monclient: _finish_hunting 0 2026-02-25T15:12:34.613 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 1 monclient: found mon.noname-c 2026-02-25T15:12:34.613 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:34.613 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e780b1870 con 0x7f8e780b0410 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 10 monclient: _finish_auth 0 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 10 monclient: _check_auth_tickets 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8e68002df0 con 0x7f8e780b0410 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e767fc640 10 monclient: dump: 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.614 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e7de46640 5 monclient: authenticate success, global_id 4220 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.605+0000 7f8e7de46640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e68002fc0 con 0x7f8e780b0410 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e767fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e767fc640 1 -- 10.20.193.78:0/1843482933 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8e68003400 con 0x7f8e780b0410 2026-02-25T15:12:34.615 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e767fc640 10 monclient: dump: 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:34.616 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 4 set_mon_vals no callback set 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 10 monclient: shutdown 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 1 -- 10.20.193.78:0/1843482933 >> v1:10.20.193.167:6789/0 conn(0x7f8e780b0410 legacy=0x7f8e78164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 1 -- 10.20.193.78:0/1843482933 shutdown_connections 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 1 -- 10.20.193.78:0/1843482933 >> 10.20.193.78:0/1843482933 conn(0x7f8e780b65f0 msgr2=0x7f8e780b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 1 -- 10.20.193.78:0/1843482933 shutdown_connections 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 1 -- 10.20.193.78:0/1843482933 wait complete. 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 10 monclient: build_initial_monmap 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 10 monclient: monmap: 2026-02-25T15:12:34.617 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:created 0.000000 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 1 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 1 librados: starting msgr at 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 1 librados: starting objecter 2026-02-25T15:12:34.618 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.606+0000 7f8e7de46640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 1 Processor -- start 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 1 -- start start 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 1 librados: setting wanted keys 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 1 librados: calling monclient init 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 10 monclient: init 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 10 monclient(hunting): picked mon.noname-b con 0x7f8e78058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:34.619 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 10 monclient(hunting): picked mon.noname-a con 0x7f8e780b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 10 monclient(hunting): picked mon.noname-c con 0x7f8e781626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e78136930 con 0x7f8e780b0410 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e78136c10 con 0x7f8e78058da0 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e78136ef0 con 0x7f8e781626a0 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.607+0000 7f8e7de46640 10 monclient(hunting): authenticate will time out at 3324.196784s 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.608+0000 7f8e777fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f8e78058da0 0x7f8e7815b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:34958/0 (socket says 10.20.193.78:34958) 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.608+0000 7f8e777fe640 1 -- 10.20.193.78:0/2135579357 learned_addr learned my addr 10.20.193.78:0/2135579357 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.608+0000 7f8e53fff640 10 client.?.objecter ms_handle_connect 0x7f8e78058da0 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.608+0000 7f8e53fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:34.620 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.609+0000 7f8e53fff640 10 client.?.objecter ms_handle_connect 0x7f8e781626a0 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.609+0000 7f8e53fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.609+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310789364 0 0) 0x7f8e78136c10 con 0x7f8e78058da0 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.609+0000 7f8e53fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.609+0000 7f8e53fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.609+0000 7f8e53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.609+0000 7f8e53fff640 10 monclient(hunting): my global_id is 4228 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.609+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e48003610 con 0x7f8e78058da0 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.610+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844476531 0 0) 0x7f8e78136ef0 con 0x7f8e781626a0 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.610+0000 7f8e53fff640 10 monclient(hunting): _negotiate 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.610+0000 7f8e53fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.610+0000 7f8e53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:34.621 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.610+0000 7f8e53fff640 10 monclient(hunting): my global_id is 4223 2026-02-25T15:12:34.622 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.610+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e78136c10 con 0x7f8e781626a0 2026-02-25T15:12:34.624 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 client.?.objecter ms_handle_connect 0x7f8e780b0410 2026-02-25T15:12:34.624 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 877449597 0 0) 0x7f8e78136c10 con 0x7f8e781626a0 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8e78136ef0 con 0x7f8e781626a0 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8e6c003330 con 0x7f8e781626a0 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 monclient(hunting): dump: 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.625 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1827959819 0 0) 0x7f8e48003610 con 0x7f8e78058da0 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8e78136c10 con 0x7f8e78058da0 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8e64003190 con 0x7f8e78058da0 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:34.626 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.612+0000 7f8e53fff640 10 monclient(hunting): dump: 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:34.627 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3666654495 0 0) 0x7f8e78136ef0 con 0x7f8e781626a0 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 >> v1:10.20.193.155:6789/0 conn(0x7f8e78058da0 legacy=0x7f8e7815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 >> v1:10.20.193.78:6789/0 conn(0x7f8e780b0410 legacy=0x7f8e781379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 10 monclient: _finish_hunting 0 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 1 monclient: found mon.c 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e781371d0 con 0x7f8e781626a0 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 10 monclient: _finish_auth 0 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 10 monclient: _check_auth_tickets 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e53fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 5 monclient: authenticate success, global_id 4223 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 10 monclient: _renew_subs 2026-02-25T15:12:34.628 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8e781380e0 con 0x7f8e781626a0 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 10 client.4223.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 10 monclient: _renew_subs 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8e78164d20 con 0x7f8e781626a0 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.614+0000 7f8e7de46640 1 librados: init done 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.615+0000 7f8e7de46640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.615+0000 7f8e7de46640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.615+0000 7f8e7de46640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.615+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e781364e0 con 0x7f8e781626a0 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.620+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e6c003870 con 0x7f8e781626a0 2026-02-25T15:12:34.629 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.620+0000 7f8e53fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.620+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8e6c004df0 con 0x7f8e781626a0 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.620+0000 7f8e53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.620+0000 7f8e53fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.620+0000 7f8e53fff640 10 monclient: dump: 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:34.630 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:34.631 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:34.631 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:34.631 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:34.631 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:34.631 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:34.631 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.620+0000 7f8e75ffb640 4 set_mon_vals no callback set 2026-02-25T15:12:34.631 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.623+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 2381894596 0 0) 0x7f8e6c004f90 con 0x7f8e781626a0 2026-02-25T15:12:34.632 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.623+0000 7f8e777fe640 10 monclient: get_auth_request con 0x7f8e48077bf0 auth_method 0 2026-02-25T15:12:34.632 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.623+0000 7f8e53fff640 10 client.4223.objecter ms_handle_connect 0x7f8e48077bf0 2026-02-25T15:12:34.632 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.624+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 2549112883 0 0) 0x7f8e6c059850 con 0x7f8e781626a0 2026-02-25T15:12:34.632 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.624+0000 7f8e53fff640 10 client.4223.objecter ms_dispatch2 0x7f8e78000b90 osd_map(18..18 src has 1..18) 2026-02-25T15:12:34.632 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.624+0000 7f8e53fff640 3 client.4223.objecter handle_osd_map got epochs [18,18] > 0 2026-02-25T15:12:34.632 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.624+0000 7f8e53fff640 3 client.4223.objecter handle_osd_map decoding full epoch 18 2026-02-25T15:12:34.633 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.624+0000 7f8e53fff640 20 client.4223.objecter dump_active .. 0 homeless 2026-02-25T15:12:34.712 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.710+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8e6c05dfc0 con 0x7f8e781626a0 2026-02-25T15:12:34.712 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.710+0000 7f8e53fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:34.712 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.710+0000 7f8e53fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:34.824 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.822+0000 7f8e7de46640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:34.824 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.822+0000 7f8e7de46640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:34.824 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.822+0000 7f8e7de46640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:12:34.824 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.822+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e7813c500 con 0x7f8e781626a0 2026-02-25T15:12:34.848 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.846+0000 7f8e53fff640 1 -- 10.20.193.78:0/2135579357 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 2560615050) 0x7f8e6c024e20 con 0x7f8e781626a0 2026-02-25T15:12:34.848 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.846+0000 7f8e53fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:34.848 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.846+0000 7f8e53fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:34.848 INFO:teuthology.misc.health.trial078.stdout: 2026-02-25T15:12:34.848 INFO:teuthology.misc.health.trial078.stdout:{"epoch":18,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:12:24.570919+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:12:34.851 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 10 librados: watch_flush enter 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 10 librados: watch_flush exit 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 20 client.4223.objecter shutdown clearing up homeless session... 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 10 client.4223.objecter successfully canceled tick 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 >> v1:10.20.193.78:6800/3497602169 conn(0x7f8e48077bf0 legacy=0x7f8e480980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 10 monclient: shutdown 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 >> v1:10.20.193.167:6789/0 conn(0x7f8e781626a0 legacy=0x7f8e78164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 shutdown_connections 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 >> 10.20.193.78:0/2135579357 conn(0x7f8e780b65f0 msgr2=0x7f8e78165360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:34.852 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 shutdown_connections 2026-02-25T15:12:34.853 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 1 -- 10.20.193.78:0/2135579357 wait complete. 2026-02-25T15:12:34.853 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:34.849+0000 7f8e7de46640 1 librados: shutdown 2026-02-25T15:12:34.859 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-25T15:12:35.119 INFO:tasks.ceph.osd.9.trial155.stderr:--00:00:00:10.437 44353-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.122 INFO:tasks.ceph.osd.5.trial155.stderr:--00:00:00:10.445 44352-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.128 INFO:tasks.ceph.osd.13.trial155.stderr:--00:00:00:10.444 44354-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.167 INFO:tasks.ceph.osd.0.trial078.stderr:--00:00:00:10.503 45248-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.167 INFO:tasks.ceph.osd.4.trial078.stderr:--00:00:00:10.499 45249-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.179 INFO:tasks.ceph.osd.11.trial174.stderr:--00:00:00:10.471 44110-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.179 INFO:tasks.ceph.osd.3.trial174.stderr:--00:00:00:10.472 44109-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.203 INFO:tasks.ceph.osd.14.trial167.stderr:--00:00:00:10.505 44128-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.204 INFO:tasks.ceph.osd.10.trial167.stderr:--00:00:00:10.508 44127-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.205 INFO:tasks.ceph.osd.2.trial167.stderr:--00:00:00:10.513 44126-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.206 INFO:tasks.ceph.osd.7.trial174.stderr:--00:00:00:10.498 44108-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.206 INFO:tasks.ceph.osd.15.trial174.stderr:--00:00:00:10.497 44111-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.210 INFO:tasks.ceph.osd.1.trial155.stderr:--00:00:00:10.535 44351-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.245 INFO:tasks.ceph.osd.8.trial078.stderr:--00:00:00:10.575 45250-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.246 INFO:tasks.ceph.osd.12.trial078.stderr:--00:00:00:10.574 45252-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:35.295 INFO:tasks.ceph.osd.6.trial167.stderr:--00:00:00:10.604 44125-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-25T15:12:37.247 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:12.570 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.258 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:12.576 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.265 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:12.581 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.290 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:12.626 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.313 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:12.636 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.319 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:12.652 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.320 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:12.622 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.321 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:12.614 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.330 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:12.648 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.330 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:12.646 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.330 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:12.655 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.333 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:12.625 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.336 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:12.641 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.344 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:12.666 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.358 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:12.674 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.360 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:12.668 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.362 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:12.653 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.362 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:12.680 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.375 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:12.697 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.377 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:12.713 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.382 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:12.674 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.383 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:12.699 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.383 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:12.685 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.390 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:12.683 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.394 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:12.726 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.395 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:12.713 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.398 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:12.723 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.399 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:12.704 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.400 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:12.727 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.402 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:12.738 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.402 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:12.695 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.403 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:12.725 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.403 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:12.719 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.405 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:12.714 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.412 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:12.714 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.414 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:12.707 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.415 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:12.733 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.416 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:12.746 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.419 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:12.744 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.419 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:12.727 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.424 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:12.728 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.428 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:12.720 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.428 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:12.761 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.429 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:12.751 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.429 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:12.745 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.430 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:12.766 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.437 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:12.729 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.443 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:12.759 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.444 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:12.766 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.446 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:12.738 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.446 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:12.748 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.449 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:12.757 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.449 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:12.741 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.451 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:12.776 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.452 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:12.744 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.453 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:12.771 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.457 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:12.761 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.458 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:12.750 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.461 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:12.794 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.468 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:12.786 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.468 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:12.804 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.469 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:12.778 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.471 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:12.763 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.471 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:12.763 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.473 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:12.775 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.473 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:12.801 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.477 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:12.768 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.478 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:12.786 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.484 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:12.814 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.485 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:12.789 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.486 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:12.778 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.492 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:12.825 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.493 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:12.802 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.494 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:12.830 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.495 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:12.820 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.495 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:12.797 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.497 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:12.825 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.499 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:12.791 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.500 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:12.830 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.507 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:12.798 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.508 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:12.816 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.508 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:12.813 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.509 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:12.801 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.509 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:12.846 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.510 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:12.813 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.517 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:12.809 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.519 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:12.811 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.522 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:12.846 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.522 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:12.855 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.523 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:12.815 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.523 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:12.828 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.531 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:12.840 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.532 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:12.860 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.533 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:12.825 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.535 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:12.826 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.537 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:12.862 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.537 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:12.867 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.538 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:12.846 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.538 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:12.871 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.550 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:12.841 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.551 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:12.843 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.552 INFO:tasks.ceph.osd.13.trial155.stderr:2026-02-25T15:12:37.547+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.554 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:12.862 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.554 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:12.863 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.561 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-25T15:12:37.556+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.562 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:12.892 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.564 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-25T15:12:37.558+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.565 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:12.857 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.572 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:12.900 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.589 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:12.898 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.595 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:12.925 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.599 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:12.926 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.603 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:12.912 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.612 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:12.941 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.612 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-25T15:12:37.608+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.614 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:12.942 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.633 INFO:tasks.ceph.osd.14.trial167.stderr:2026-02-25T15:12:37.628+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.636 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-25T15:12:37.632+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.639 INFO:tasks.ceph.osd.10.trial167.stderr:2026-02-25T15:12:37.634+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.647 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-25T15:12:37.642+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.648 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-25T15:12:37.644+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.658 INFO:tasks.ceph.osd.2.trial167.stderr:2026-02-25T15:12:37.652+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.659 INFO:tasks.ceph.osd.4.trial078.stderr:2026-02-25T15:12:37.655+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.666 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-25T15:12:37.662+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.667 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-25T15:12:37.664+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.706 INFO:tasks.ceph.osd.6.trial167.stderr:2026-02-25T15:12:37.701+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.750 INFO:tasks.ceph.osd.12.trial078.stderr:2026-02-25T15:12:37.745+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.751 INFO:tasks.ceph.osd.8.trial078.stderr:2026-02-25T15:12:37.746+0000 787f4c0 -1 Falling back to public interface 2026-02-25T15:12:37.824 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.140 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.832 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.154 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.837 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.155 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.881 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.217 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.906 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.208 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.907 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.211 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.909 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.225 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.912 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.204 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.920 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.238 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.920 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.244 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.922 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.244 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.925 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.217 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.932 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.265 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.933 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.241 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.945 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.237 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.945 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.236 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.969 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.305 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.973 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.290 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.978 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.300 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.980 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.288 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.994 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.299 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:37.996 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.298 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.001 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.317 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.003 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.321 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.004 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.296 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.006 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.299 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.013 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.338 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.015 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.338 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.024 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.340 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.026 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.359 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.027 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.363 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.027 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.355 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.028 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.358 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.036 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.354 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.037 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.345 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.040 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.362 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.040 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.333 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.041 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.333 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.044 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.360 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.058 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.394 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.062 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.354 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.072 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.394 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.074 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.379 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.081 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.397 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.083 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.392 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.084 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.376 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.084 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.420 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.086 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.388 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.088 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.406 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.089 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.414 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.091 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.384 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.093 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.385 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.094 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.385 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.104 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.436 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.109 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.431 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.113 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.440 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.114 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.422 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.115 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.432 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.117 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.447 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.119 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.455 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.119 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.412 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.121 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.426 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.122 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.414 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.123 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.415 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.126 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.418 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.132 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.457 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.132 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.450 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.133 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.435 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.140 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.462 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.143 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.476 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.145 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.461 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.152 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.488 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.153 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.461 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.156 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.449 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.159 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.451 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.162 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.471 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.163 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.455 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.164 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.456 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.164 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.469 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.167 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.492 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.171 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.493 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.171 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.500 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.173 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.475 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.175 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.468 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.178 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.514 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.179 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.497 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.182 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.510 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.183 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.476 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.184 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.475 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.192 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.485 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.193 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.526 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.199 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.507 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.203 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.496 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.209 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.514 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.209 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.539 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.210 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.518 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.211 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.504 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.212 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.503 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.221 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.546 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.222 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.558 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.225 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.517 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.225 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.527 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.228 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.521 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.229 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.547 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.232 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.524 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.234 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.562 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.235 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.567 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.237 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.529 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.241 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.546 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.241 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.549 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.245 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.554 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.249 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.574 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.250 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.580 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.257 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.550 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.262 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.564 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.266 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.558 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.266 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.558 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.270 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.588 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.274 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.590 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.281 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.586 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.282 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.610 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.283 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.615 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.287 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.595 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.288 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.597 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.290 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.620 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.299 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.601 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.306 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.631 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.309 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.631 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.310 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.643 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.320 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.612 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.322 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.650 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.323 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.652 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.328 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.633 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.333 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.649 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.333 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.641 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.338 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.647 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.341 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.643 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.350 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.643 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.352 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.689 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.354 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.679 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.364 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.694 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.365 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.697 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.367 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.683 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.371 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.679 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.375 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.667 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.377 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.704 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.377 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.700 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.379 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.688 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.394 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.711 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.396 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.726 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.397 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.688 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.400 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.736 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.400 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:13.716 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.406 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.729 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.413 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.740 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.413 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.705 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.423 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.732 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.425 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.762 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.426 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.743 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.440 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.732 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.441 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.764 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.446 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:13.769 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.447 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.775 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.456 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.748 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.457 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.748 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.457 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.793 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.462 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:13.799 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.469 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.762 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.473 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.778 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.481 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.773 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.485 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.787 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.492 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.784 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.493 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.785 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.494 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.812 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.495 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.820 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.496 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:13.789 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.512 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.844 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.517 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.809 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.518 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.848 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.520 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.828 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.522 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:13.814 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.530 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.832 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.531 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.835 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.532 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.824 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.534 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.852 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.535 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.827 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.538 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:13.829 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.551 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.876 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.562 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.881 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.565 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.873 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.567 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.871 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.567 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.869 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.568 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:13.886 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.568 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.901 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.568 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.861 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.571 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.879 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.575 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.905 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.575 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.900 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.591 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.893 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.596 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.923 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.597 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:13.899 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.600 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.905 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.601 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.894 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.604 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.937 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.605 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:13.910 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.606 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:13.899 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.606 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.931 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.610 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.940 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.612 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.920 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.612 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:13.937 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.631 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.940 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.641 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.950 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.643 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.975 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.646 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:13.954 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.647 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.976 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.648 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:13.980 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.649 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:13.977 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.652 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:13.981 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.672 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:13.981 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.687 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:14.015 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.698 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:14.007 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.703 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:14.012 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.729 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:14.056 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:38.734 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:14.062 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.650 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:15.965 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.694 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:16.016 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.750 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:16.086 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.811 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:16.104 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.824 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:16.142 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.828 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:16.120 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.846 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:16.138 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.862 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:16.164 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.865 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:16.170 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.875 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:16.200 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.893 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:16.201 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.928 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:16.221 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.934 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:16.263 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.950 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:16.283 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:40.968 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:16.277 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:41.029 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:16.356 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:42.470 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:12:42.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.531+0000 7f6e92824640 10 monclient: get_monmap_and_config 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.531+0000 7f6e92824640 10 monclient: build_initial_monmap 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.531+0000 7f6e92824640 10 monclient: monmap: 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:12:42.531968+0000 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:12:42.531968+0000 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:42.533 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:42.534 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:42.534 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:42.534 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:42.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.531+0000 7f6e92824640 1 Processor -- start 2026-02-25T15:12:42.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.531+0000 7f6e92824640 1 -- start start 2026-02-25T15:12:42.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.531+0000 7f6e92824640 10 monclient: init 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 10 monclient(hunting): picked mon.noname-c con 0x7f6e8c059fe0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 10 monclient(hunting): picked mon.noname-b con 0x7f6e8c0b6700 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 10 monclient(hunting): picked mon.noname-a con 0x7f6e8c160480 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8c1635f0 con 0x7f6e8c160480 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8c057860 con 0x7f6e8c0b6700 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8c057b40 con 0x7f6e8c059fe0 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e92824640 10 monclient(hunting): authenticate will time out at 3332.121444s 2026-02-25T15:12:42.536 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e90d9a640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6e8c160480 0x7f6e8c1608e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50202/0 (socket says 10.20.193.78:50202) 2026-02-25T15:12:42.537 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.532+0000 7f6e90d9a640 1 -- 10.20.193.78:0/1524350543 learned_addr learned my addr 10.20.193.78:0/1524350543 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:42.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063925850 0 0) 0x7f6e8c1635f0 con 0x7f6e8c160480 2026-02-25T15:12:42.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:42.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:42.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:42.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): my global_id is 4275 2026-02-25T15:12:42.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e70003610 con 0x7f6e8c160480 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096645725 0 0) 0x7f6e8c057860 con 0x7f6e8c0b6700 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): my global_id is 4279 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8c1635f0 con 0x7f6e8c0b6700 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628501343 0 0) 0x7f6e8c057b40 con 0x7f6e8c059fe0 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 10 monclient(hunting): my global_id is 4274 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.534+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8c057860 con 0x7f6e8c059fe0 2026-02-25T15:12:42.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4081262506 0 0) 0x7f6e70003610 con 0x7f6e8c160480 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 >> v1:10.20.193.167:6789/0 conn(0x7f6e8c059fe0 legacy=0x7f6e8c058600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 >> v1:10.20.193.155:6789/0 conn(0x7f6e8c0b6700 legacy=0x7f6e8c05a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 10 monclient: _finish_hunting 0 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 1 monclient: found mon.noname-a 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c057e20 con 0x7f6e8c160480 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 10 monclient: _finish_auth 0 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 10 monclient: _check_auth_tickets 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e80003170 con 0x7f6e8c160480 2026-02-25T15:12:42.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e8affd640 10 monclient: dump: 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:42.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e92824640 5 monclient: authenticate success, global_id 4275 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.536+0000 7f6e92824640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e80003340 con 0x7f6e8c160480 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e8affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e8affd640 1 -- 10.20.193.78:0/1524350543 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e80003780 con 0x7f6e8c160480 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e8affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e8affd640 10 monclient: dump: 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.544 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 4 set_mon_vals no callback set 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 10 monclient: shutdown 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 1 -- 10.20.193.78:0/1524350543 >> v1:10.20.193.78:6789/0 conn(0x7f6e8c160480 legacy=0x7f6e8c1608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 1 -- 10.20.193.78:0/1524350543 shutdown_connections 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 1 -- 10.20.193.78:0/1524350543 >> 10.20.193.78:0/1524350543 conn(0x7f6e8c0b5280 msgr2=0x7f6e8c0b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:42.545 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 1 -- 10.20.193.78:0/1524350543 shutdown_connections 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.537+0000 7f6e92824640 1 -- 10.20.193.78:0/1524350543 wait complete. 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 10 monclient: build_initial_monmap 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 10 monclient: monmap: 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:created 0.000000 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 1 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:42.546 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 1 librados: starting msgr at 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 1 librados: starting objecter 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 1 Processor -- start 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 1 -- start start 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 1 librados: setting wanted keys 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 1 librados: calling monclient init 2026-02-25T15:12:42.547 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 10 monclient: init 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 10 monclient(hunting): picked mon.noname-b con 0x7f6e8c059fe0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 10 monclient(hunting): picked mon.noname-c con 0x7f6e8c0b6700 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 10 monclient(hunting): picked mon.noname-a con 0x7f6e8c160480 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8c139bb0 con 0x7f6e8c160480 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.538+0000 7f6e92824640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8c139e90 con 0x7f6e8c059fe0 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e92824640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8c13a170 con 0x7f6e8c0b6700 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e92824640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e92824640 10 monclient(hunting): authenticate will time out at 3332.128017s 2026-02-25T15:12:42.552 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e90d9a640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6e8c160480 0x7f6e8c15d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50208/0 (socket says 10.20.193.78:50208) 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e90d9a640 1 -- 10.20.193.78:0/818708713 learned_addr learned my addr 10.20.193.78:0/818708713 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e88ff9640 10 client.?.objecter ms_handle_connect 0x7f6e8c160480 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e88ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e88ff9640 10 client.?.objecter ms_handle_connect 0x7f6e8c0b6700 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e88ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e88ff9640 10 client.?.objecter ms_handle_connect 0x7f6e8c059fe0 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.539+0000 7f6e88ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283994586 0 0) 0x7f6e8c139bb0 con 0x7f6e8c160480 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:42.553 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 10 monclient(hunting): my global_id is 4278 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e5c003610 con 0x7f6e8c160480 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985551132 0 0) 0x7f6e8c139e90 con 0x7f6e8c059fe0 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 10 monclient(hunting): my global_id is 4282 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.540+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8c139bb0 con 0x7f6e8c059fe0 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.541+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826384769 0 0) 0x7f6e8c13a170 con 0x7f6e8c0b6700 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.541+0000 7f6e88ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.541+0000 7f6e88ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.541+0000 7f6e88ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.541+0000 7f6e88ff9640 10 monclient(hunting): my global_id is 4277 2026-02-25T15:12:42.554 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.541+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8c139e90 con 0x7f6e8c0b6700 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.542+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3702875532 0 0) 0x7f6e5c003610 con 0x7f6e8c160480 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.542+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e8c13a170 con 0x7f6e8c160480 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.542+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e80003690 con 0x7f6e8c160480 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.542+0000 7f6e88ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.542+0000 7f6e88ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.542+0000 7f6e88ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:42.555 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.542+0000 7f6e88ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.543+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1801897300 0 0) 0x7f6e8c139bb0 con 0x7f6e8c059fe0 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.543+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e5c003610 con 0x7f6e8c059fe0 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.543+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e78003060 con 0x7f6e8c059fe0 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.543+0000 7f6e88ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.543+0000 7f6e88ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.543+0000 7f6e88ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:42.556 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3224133946 0 0) 0x7f6e8c139e90 con 0x7f6e8c0b6700 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e8c139bb0 con 0x7f6e8c0b6700 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e7c003080 con 0x7f6e8c0b6700 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:42.557 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:42.558 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 935419363 0 0) 0x7f6e8c13a170 con 0x7f6e8c160480 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 >> v1:10.20.193.167:6789/0 conn(0x7f6e8c0b6700 legacy=0x7f6e8c1fc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 >> v1:10.20.193.155:6789/0 conn(0x7f6e8c059fe0 legacy=0x7f6e8c1fbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 1 monclient: found mon.a 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c13a450 con 0x7f6e8c160480 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 10 monclient: _finish_auth 0 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:12:42.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e88ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 5 monclient: authenticate success, global_id 4278 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 10 monclient: _renew_subs 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8c13a730 con 0x7f6e8c160480 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 10 client.4278.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 10 monclient: _renew_subs 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e8c15dc80 con 0x7f6e8c160480 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.544+0000 7f6e92824640 1 librados: init done 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.545+0000 7f6e92824640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.545+0000 7f6e92824640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:42.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.545+0000 7f6e92824640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:42.561 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.545+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8c05b010 con 0x7f6e8c160480 2026-02-25T15:12:42.562 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.552+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e800032f0 con 0x7f6e8c160480 2026-02-25T15:12:42.562 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.552+0000 7f6e88ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:42.562 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.552+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e80004f00 con 0x7f6e8c160480 2026-02-25T15:12:42.562 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.552+0000 7f6e88ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:42.562 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.552+0000 7f6e88ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:42.562 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.552+0000 7f6e8a7fc640 4 set_mon_vals no callback set 2026-02-25T15:12:42.562 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.552+0000 7f6e88ff9640 10 monclient: dump: 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.553+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 2381894596 0 0) 0x7f6e8001dd30 con 0x7f6e8c160480 2026-02-25T15:12:42.563 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.554+0000 7f6e8bfff640 10 monclient: get_auth_request con 0x7f6e5c077d40 auth_method 0 2026-02-25T15:12:42.564 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.554+0000 7f6e88ff9640 10 client.4278.objecter ms_handle_connect 0x7f6e5c077d40 2026-02-25T15:12:42.564 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.555+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 2549112883 0 0) 0x7f6e80059620 con 0x7f6e8c160480 2026-02-25T15:12:42.564 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.555+0000 7f6e88ff9640 10 client.4278.objecter ms_dispatch2 0x7f6e8c000b90 osd_map(18..18 src has 1..18) 2026-02-25T15:12:42.564 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.555+0000 7f6e88ff9640 3 client.4278.objecter handle_osd_map got epochs [18,18] > 0 2026-02-25T15:12:42.564 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.555+0000 7f6e88ff9640 3 client.4278.objecter handle_osd_map decoding full epoch 18 2026-02-25T15:12:42.564 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.555+0000 7f6e88ff9640 20 client.4278.objecter dump_active .. 0 homeless 2026-02-25T15:12:42.649 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.648+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6e8005dd90 con 0x7f6e8c160480 2026-02-25T15:12:42.650 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.648+0000 7f6e88ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:42.650 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.648+0000 7f6e88ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:42.764 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.762+0000 7f6e92824640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:42.764 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.762+0000 7f6e92824640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:42.764 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.762+0000 7f6e92824640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:42.764 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.762+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e8c052a40 con 0x7f6e8c160480 2026-02-25T15:12:42.772 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.770+0000 7f6e88ff9640 1 -- 10.20.193.78:0/818708713 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 2560615050) 0x7f6e8005d690 con 0x7f6e8c160480 2026-02-25T15:12:42.772 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.770+0000 7f6e88ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:42.773 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.770+0000 7f6e88ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:42.773 INFO:teuthology.misc.health.trial078.stdout: 2026-02-25T15:12:42.773 INFO:teuthology.misc.health.trial078.stdout:{"epoch":18,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:12:24.570919+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:12:42.776 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 10 librados: watch_flush enter 2026-02-25T15:12:42.776 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 10 librados: watch_flush exit 2026-02-25T15:12:42.776 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 20 client.4278.objecter shutdown clearing up homeless session... 2026-02-25T15:12:42.776 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 10 client.4278.objecter successfully canceled tick 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6e5c077d40 legacy=0x7f6e5c0981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 10 monclient: shutdown 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 >> v1:10.20.193.78:6789/0 conn(0x7f6e8c160480 legacy=0x7f6e8c15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 shutdown_connections 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 >> 10.20.193.78:0/818708713 conn(0x7f6e8c0b5280 msgr2=0x7f6e8c0b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.773+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 shutdown_connections 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.774+0000 7f6e92824640 1 -- 10.20.193.78:0/818708713 wait complete. 2026-02-25T15:12:42.777 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:42.774+0000 7f6e92824640 1 librados: shutdown 2026-02-25T15:12:42.786 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-25T15:12:42.849 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:18.165 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:42.880 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:18.196 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:42.883 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:18.199 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:42.886 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:18.209 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:42.906 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:18.228 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:42.909 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:18.231 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:42.997 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:18.315 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.038 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:18.356 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.041 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:18.359 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.043 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:18.379 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.052 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:18.377 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.060 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:18.362 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.072 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:18.408 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.075 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:18.411 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.076 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:18.368 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.091 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:18.415 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.093 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:18.418 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.095 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:18.397 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.096 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:18.400 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.097 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:18.399 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.102 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:18.395 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.103 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:18.395 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.105 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:18.398 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.111 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:18.403 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.131 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:18.439 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.132 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:18.424 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.136 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:18.427 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.141 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:18.434 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.142 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:18.446 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.144 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:18.449 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.144 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:18.437 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.161 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:18.469 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.163 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:18.472 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.179 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:18.488 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.188 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:18.481 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.205 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:18.537 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.208 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:18.516 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.211 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:18.519 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.218 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:18.510 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.221 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:18.513 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.230 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:18.560 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.239 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:18.572 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.242 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:18.575 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.256 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:18.585 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.259 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:18.588 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.270 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:18.597 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.313 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:18.640 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:43.316 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:18.643 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.456 INFO:tasks.ceph.osd.13.trial155.stderr:==00:00:00:19.772 44354== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.507 INFO:tasks.ceph.osd.5.trial155.stderr:==00:00:00:19.830 44352== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.635 INFO:tasks.ceph.osd.9.trial155.stderr:==00:00:00:19.953 44353== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.675 INFO:tasks.ceph.osd.0.trial078.stderr:==00:00:00:20.011 45248== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.689 INFO:tasks.ceph.osd.1.trial155.stderr:==00:00:00:20.014 44351== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.715 INFO:tasks.ceph.osd.14.trial167.stderr:==00:00:00:20.017 44128== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.741 INFO:tasks.ceph.osd.3.trial174.stderr:==00:00:00:20.033 44109== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.757 INFO:tasks.ceph.osd.10.trial167.stderr:==00:00:00:20.062 44127== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.765 INFO:tasks.ceph.osd.2.trial167.stderr:==00:00:00:20.073 44126== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.783 INFO:tasks.ceph.osd.15.trial174.stderr:==00:00:00:20.074 44111== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.787 INFO:tasks.ceph.osd.7.trial174.stderr:==00:00:00:20.079 44108== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.828 INFO:tasks.ceph.osd.6.trial167.stderr:==00:00:00:20.137 44125== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.871 INFO:tasks.ceph.osd.11.trial174.stderr:==00:00:00:20.164 44110== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.880 INFO:tasks.ceph.osd.8.trial078.stderr:==00:00:00:20.209 45250== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.880 INFO:tasks.ceph.osd.4.trial078.stderr:==00:00:00:20.212 45249== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:44.960 INFO:tasks.ceph.osd.12.trial078.stderr:==00:00:00:20.287 45252== Warning: unimplemented fcntl command: 1038 2026-02-25T15:12:47.212 INFO:tasks.ceph.osd.13.trial155.stderr:2026-02-25T15:12:47.208+0000 787f4c0 -1 osd.13 0 log_to_monitors true 2026-02-25T15:12:47.265 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-25T15:12:47.261+0000 787f4c0 -1 osd.5 0 log_to_monitors true 2026-02-25T15:12:47.399 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-25T15:12:47.395+0000 787f4c0 -1 osd.9 0 log_to_monitors true 2026-02-25T15:12:47.463 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-25T15:12:47.459+0000 787f4c0 -1 osd.1 0 log_to_monitors true 2026-02-25T15:12:47.470 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-25T15:12:47.467+0000 787f4c0 -1 osd.0 0 log_to_monitors true 2026-02-25T15:12:47.517 INFO:tasks.ceph.osd.10.trial167.stderr:2026-02-25T15:12:47.514+0000 787f4c0 -1 osd.10 0 log_to_monitors true 2026-02-25T15:12:47.517 INFO:tasks.ceph.osd.2.trial167.stderr:2026-02-25T15:12:47.514+0000 787f4c0 -1 osd.2 0 log_to_monitors true 2026-02-25T15:12:47.521 INFO:tasks.ceph.osd.14.trial167.stderr:2026-02-25T15:12:47.518+0000 787f4c0 -1 osd.14 0 log_to_monitors true 2026-02-25T15:12:47.578 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-25T15:12:47.574+0000 787f4c0 -1 osd.3 0 log_to_monitors true 2026-02-25T15:12:47.580 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-25T15:12:47.576+0000 787f4c0 -1 osd.7 0 log_to_monitors true 2026-02-25T15:12:47.607 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-25T15:12:47.603+0000 787f4c0 -1 osd.15 0 log_to_monitors true 2026-02-25T15:12:47.628 INFO:tasks.ceph.osd.6.trial167.stderr:2026-02-25T15:12:47.624+0000 787f4c0 -1 osd.6 0 log_to_monitors true 2026-02-25T15:12:47.671 INFO:tasks.ceph.osd.4.trial078.stderr:2026-02-25T15:12:47.667+0000 787f4c0 -1 osd.4 0 log_to_monitors true 2026-02-25T15:12:47.673 INFO:tasks.ceph.osd.8.trial078.stderr:2026-02-25T15:12:47.669+0000 787f4c0 -1 osd.8 0 log_to_monitors true 2026-02-25T15:12:47.686 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-25T15:12:47.682+0000 787f4c0 -1 osd.11 0 log_to_monitors true 2026-02-25T15:12:47.786 INFO:tasks.ceph.osd.12.trial078.stderr:2026-02-25T15:12:47.783+0000 787f4c0 -1 osd.12 0 log_to_monitors true 2026-02-25T15:12:49.131 INFO:tasks.ceph.osd.13.trial155.stderr:2026-02-25T15:12:49.128+0000 df79640 -1 osd.13 0 waiting for initial osdmap 2026-02-25T15:12:49.134 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-25T15:12:49.132+0000 df79640 -1 osd.5 0 waiting for initial osdmap 2026-02-25T15:12:49.342 INFO:tasks.ceph.osd.13.trial155.stderr:2026-02-25T15:12:49.333+0000 12561640 -1 osd.13 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:49.349 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-25T15:12:49.340+0000 12561640 -1 osd.5 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.217 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-25T15:12:50.213+0000 df79640 -1 osd.1 0 waiting for initial osdmap 2026-02-25T15:12:50.218 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-25T15:12:50.214+0000 df79640 -1 osd.9 0 waiting for initial osdmap 2026-02-25T15:12:50.221 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-25T15:12:50.218+0000 cf66640 -1 osd.15 0 waiting for initial osdmap 2026-02-25T15:12:50.223 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-25T15:12:50.220+0000 df79640 -1 osd.0 0 waiting for initial osdmap 2026-02-25T15:12:50.234 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-25T15:12:50.230+0000 df79640 -1 osd.3 0 waiting for initial osdmap 2026-02-25T15:12:50.240 INFO:tasks.ceph.osd.14.trial167.stderr:2026-02-25T15:12:50.237+0000 df79640 -1 osd.14 0 waiting for initial osdmap 2026-02-25T15:12:50.242 INFO:tasks.ceph.osd.6.trial167.stderr:2026-02-25T15:12:50.238+0000 df79640 -1 osd.6 0 waiting for initial osdmap 2026-02-25T15:12:50.245 INFO:tasks.ceph.osd.2.trial167.stderr:2026-02-25T15:12:50.243+0000 cf66640 -1 osd.2 0 waiting for initial osdmap 2026-02-25T15:12:50.259 INFO:tasks.ceph.osd.10.trial167.stderr:2026-02-25T15:12:50.257+0000 df79640 -1 osd.10 0 waiting for initial osdmap 2026-02-25T15:12:50.259 INFO:tasks.ceph.osd.12.trial078.stderr:2026-02-25T15:12:50.257+0000 cf66640 -1 osd.12 0 waiting for initial osdmap 2026-02-25T15:12:50.261 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-25T15:12:50.254+0000 df79640 -1 osd.7 0 waiting for initial osdmap 2026-02-25T15:12:50.281 INFO:tasks.ceph.osd.8.trial078.stderr:2026-02-25T15:12:50.279+0000 cf66640 -1 osd.8 0 waiting for initial osdmap 2026-02-25T15:12:50.283 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-25T15:12:50.279+0000 df79640 -1 osd.11 0 waiting for initial osdmap 2026-02-25T15:12:50.290 INFO:tasks.ceph.osd.4.trial078.stderr:2026-02-25T15:12:50.288+0000 cf66640 -1 osd.4 0 waiting for initial osdmap 2026-02-25T15:12:50.398 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:12:50.438 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-25T15:12:50.430+0000 16969640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.442 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-25T15:12:50.434+0000 12561640 -1 osd.15 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.449 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-25T15:12:50.441+0000 12561640 -1 osd.0 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.459 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.457+0000 7f2a6a48a640 10 monclient: get_monmap_and_config 2026-02-25T15:12:50.459 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.457+0000 7f2a6a48a640 10 monclient: build_initial_monmap 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.457+0000 7f2a6a48a640 10 monclient: monmap: 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:12:50.458736+0000 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:12:50.458736+0000 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:50.460 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:50.462 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.458+0000 7f2a6a48a640 1 Processor -- start 2026-02-25T15:12:50.462 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.458+0000 7f2a6a48a640 1 -- start start 2026-02-25T15:12:50.462 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.458+0000 7f2a6a48a640 10 monclient: init 2026-02-25T15:12:50.462 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:50.462 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 10 monclient(hunting): picked mon.noname-c con 0x7f2a64058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 10 monclient(hunting): picked mon.noname-a con 0x7f2a640b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 10 monclient(hunting): picked mon.noname-b con 0x7f2a641626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a641655c0 con 0x7f2a640b0410 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a640b12b0 con 0x7f2a641626a0 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a640b1590 con 0x7f2a64058da0 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a6a48a640 10 monclient(hunting): authenticate will time out at 3340.048145s 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a68a00640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f2a641626a0 0x7f2a641c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:41194/0 (socket says 10.20.193.78:41194) 2026-02-25T15:12:50.463 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.459+0000 7f2a68a00640 1 -- 10.20.193.78:0/2394915993 learned_addr learned my addr 10.20.193.78:0/2394915993 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.461+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131068242 0 0) 0x7f2a640b1590 con 0x7f2a64058da0 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.461+0000 7f2a62ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.461+0000 7f2a62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.461+0000 7f2a62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.461+0000 7f2a62ffd640 10 monclient(hunting): my global_id is 4316 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.461+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a48003610 con 0x7f2a64058da0 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338862234 0 0) 0x7f2a640b12b0 con 0x7f2a641626a0 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:50.465 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 10 monclient(hunting): my global_id is 4333 2026-02-25T15:12:50.466 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a640b1590 con 0x7f2a641626a0 2026-02-25T15:12:50.466 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393992387 0 0) 0x7f2a641655c0 con 0x7f2a640b0410 2026-02-25T15:12:50.466 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:50.466 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:50.466 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:50.466 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 10 monclient(hunting): my global_id is 4320 2026-02-25T15:12:50.466 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.462+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a640b12b0 con 0x7f2a640b0410 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2909048711 0 0) 0x7f2a48003610 con 0x7f2a64058da0 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 >> v1:10.20.193.155:6789/0 conn(0x7f2a641626a0 legacy=0x7f2a641c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 >> v1:10.20.193.78:6789/0 conn(0x7f2a640b0410 legacy=0x7f2a64164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 1 monclient: found mon.noname-c 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a640b1870 con 0x7f2a64058da0 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 10 monclient: _finish_auth 0 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:12:50.471 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2a50002df0 con 0x7f2a64058da0 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a62ffd640 10 monclient: dump: 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:50.472 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a6a48a640 5 monclient: authenticate success, global_id 4316 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.463+0000 7f2a6a48a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.464+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a50002fc0 con 0x7f2a64058da0 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.464+0000 7f2a62ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.464+0000 7f2a62ffd640 1 -- 10.20.193.78:0/2394915993 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2a50003400 con 0x7f2a64058da0 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.464+0000 7f2a62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.464+0000 7f2a62ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.464+0000 7f2a62ffd640 10 monclient: dump: 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:50.473 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.464+0000 7f2a6a48a640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.464+0000 7f2a6a48a640 4 set_mon_vals no callback set 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 10 monclient: shutdown 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 1 -- 10.20.193.78:0/2394915993 >> v1:10.20.193.167:6789/0 conn(0x7f2a64058da0 legacy=0x7f2a641647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:50.474 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 1 -- 10.20.193.78:0/2394915993 shutdown_connections 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 1 -- 10.20.193.78:0/2394915993 >> 10.20.193.78:0/2394915993 conn(0x7f2a640b65f0 msgr2=0x7f2a640b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 1 -- 10.20.193.78:0/2394915993 shutdown_connections 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 1 -- 10.20.193.78:0/2394915993 wait complete. 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 10 monclient: build_initial_monmap 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.465+0000 7f2a6a48a640 10 monclient: monmap: 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:created 0.000000 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 1 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:50.475 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 librados: starting msgr at 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 librados: starting objecter 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 Processor -- start 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 -- start start 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 librados: setting wanted keys 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 librados: calling monclient init 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 10 monclient: init 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:50.476 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 10 monclient(hunting): picked mon.noname-c con 0x7f2a64058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 10 monclient(hunting): picked mon.noname-b con 0x7f2a640b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 10 monclient(hunting): picked mon.noname-a con 0x7f2a641626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a641fb820 con 0x7f2a641626a0 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6413d3b0 con 0x7f2a640b0410 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6413d690 con 0x7f2a64058da0 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.466+0000 7f2a6a48a640 10 monclient(hunting): authenticate will time out at 3340.055692s 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.467+0000 7f2a63fff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f2a64058da0 0x7f2a6413fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50706/0 (socket says 10.20.193.78:50706) 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.467+0000 7f2a63fff640 1 -- 10.20.193.78:0/400984823 learned_addr learned my addr 10.20.193.78:0/400984823 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.467+0000 7f2a60ff9640 10 client.?.objecter ms_handle_connect 0x7f2a64058da0 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.467+0000 7f2a60ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:50.477 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.467+0000 7f2a60ff9640 10 client.?.objecter ms_handle_connect 0x7f2a640b0410 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.467+0000 7f2a60ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.467+0000 7f2a60ff9640 10 client.?.objecter ms_handle_connect 0x7f2a641626a0 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.467+0000 7f2a60ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753178414 0 0) 0x7f2a6413d690 con 0x7f2a64058da0 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 10 monclient(hunting): my global_id is 4319 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a34003610 con 0x7f2a64058da0 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049468532 0 0) 0x7f2a641fb820 con 0x7f2a641626a0 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:50.478 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:50.479 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 10 monclient(hunting): my global_id is 4323 2026-02-25T15:12:50.479 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.468+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a6413d690 con 0x7f2a641626a0 2026-02-25T15:12:50.479 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.469+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209210536 0 0) 0x7f2a6413d3b0 con 0x7f2a640b0410 2026-02-25T15:12:50.479 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.469+0000 7f2a60ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:12:50.479 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.469+0000 7f2a60ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:50.479 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.469+0000 7f2a60ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:50.479 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.469+0000 7f2a60ff9640 10 monclient(hunting): my global_id is 4336 2026-02-25T15:12:50.479 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.469+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a641fb820 con 0x7f2a640b0410 2026-02-25T15:12:50.480 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-25T15:12:50.470+0000 16969640 -1 osd.9 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.480 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-25T15:12:50.466+0000 12561640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.481 INFO:tasks.ceph.osd.14.trial167.stderr:2026-02-25T15:12:50.459+0000 16569640 -1 osd.14 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.481 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-25T15:12:50.471+0000 12561640 -1 osd.7 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.481 INFO:tasks.ceph.osd.6.trial167.stderr:2026-02-25T15:12:50.460+0000 16569640 -1 osd.6 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.482 INFO:tasks.ceph.osd.2.trial167.stderr:2026-02-25T15:12:50.460+0000 16569640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.484 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4002518552 0 0) 0x7f2a6413d690 con 0x7f2a641626a0 2026-02-25T15:12:50.484 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a6413d3b0 con 0x7f2a641626a0 2026-02-25T15:12:50.484 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2a58003370 con 0x7f2a641626a0 2026-02-25T15:12:50.484 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:50.484 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:50.484 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:50.484 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3265844844 0 0) 0x7f2a34003610 con 0x7f2a64058da0 2026-02-25T15:12:50.485 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a6413d690 con 0x7f2a64058da0 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2a50003310 con 0x7f2a64058da0 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.471+0000 7f2a60ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:50.486 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.472+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2903088003 0 0) 0x7f2a641fb820 con 0x7f2a640b0410 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.472+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a34003610 con 0x7f2a640b0410 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.472+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2a54003060 con 0x7f2a640b0410 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.472+0000 7f2a60ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.472+0000 7f2a60ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.472+0000 7f2a60ff9640 10 monclient(hunting): dump: 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:50.487 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3858452754 0 0) 0x7f2a6413d3b0 con 0x7f2a641626a0 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 >> v1:10.20.193.167:6789/0 conn(0x7f2a64058da0 legacy=0x7f2a6413fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 >> v1:10.20.193.155:6789/0 conn(0x7f2a640b0410 legacy=0x7f2a640afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 1 monclient: found mon.a 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:50.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6413d970 con 0x7f2a641626a0 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 10 monclient: _finish_auth 0 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a60ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 5 monclient: authenticate success, global_id 4323 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 10 monclient: _renew_subs 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6413dc50 con 0x7f2a641626a0 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 10 client.4323.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 10 monclient: _renew_subs 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2a640aea30 con 0x7f2a641626a0 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 1 librados: init done 2026-02-25T15:12:50.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.473+0000 7f2a6a48a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.474+0000 7f2a6a48a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.474+0000 7f2a6a48a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.474+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a64163ee0 con 0x7f2a641626a0 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.481+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a580038b0 con 0x7f2a641626a0 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.481+0000 7f2a60ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.481+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2a58004df0 con 0x7f2a641626a0 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.481+0000 7f2a60ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.481+0000 7f2a60ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.481+0000 7f2a627fc640 4 set_mon_vals no callback set 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.481+0000 7f2a60ff9640 10 monclient: dump: 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:50.490 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:50.491 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.482+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 2381894596 0 0) 0x7f2a5801dc20 con 0x7f2a641626a0 2026-02-25T15:12:50.491 INFO:tasks.ceph.osd.12.trial078.stderr:2026-02-25T15:12:50.476+0000 16969640 -1 osd.12 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.492 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.482+0000 7f2a63fff640 10 monclient: get_auth_request con 0x7f2a34077e60 auth_method 0 2026-02-25T15:12:50.492 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.482+0000 7f2a60ff9640 10 client.4323.objecter ms_handle_connect 0x7f2a34077e60 2026-02-25T15:12:50.492 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.484+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 5408+0+0 (unknown 1291165137 0 0) 0x7f2a58080fd0 con 0x7f2a641626a0 2026-02-25T15:12:50.492 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.484+0000 7f2a60ff9640 10 client.4323.objecter ms_dispatch2 0x7f2a64000b90 osd_map(21..21 src has 1..21) 2026-02-25T15:12:50.492 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.484+0000 7f2a60ff9640 3 client.4323.objecter handle_osd_map got epochs [21,21] > 0 2026-02-25T15:12:50.493 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.484+0000 7f2a60ff9640 3 client.4323.objecter handle_osd_map decoding full epoch 21 2026-02-25T15:12:50.493 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.484+0000 7f2a60ff9640 20 client.4323.objecter dump_active .. 0 homeless 2026-02-25T15:12:50.499 INFO:tasks.ceph.osd.10.trial167.stderr:2026-02-25T15:12:50.496+0000 16569640 -1 osd.10 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.505 INFO:tasks.ceph.osd.8.trial078.stderr:2026-02-25T15:12:50.497+0000 12561640 -1 osd.8 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.508 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-25T15:12:50.500+0000 16569640 -1 osd.11 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.513 INFO:tasks.ceph.osd.4.trial078.stderr:2026-02-25T15:12:50.505+0000 16569640 -1 osd.4 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:12:50.581 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.579+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2a5805de60 con 0x7f2a641626a0 2026-02-25T15:12:50.581 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.579+0000 7f2a60ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:50.581 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.579+0000 7f2a60ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:50.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.690+0000 7f2a6a48a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:50.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.690+0000 7f2a6a48a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:50.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.690+0000 7f2a6a48a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:50.692 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.690+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a640b6d90 con 0x7f2a641626a0 2026-02-25T15:12:50.700 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.698+0000 7f2a60ff9640 1 -- 10.20.193.78:0/400984823 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+13384 (unknown 898900276 0 1883020306) 0x7f2a5805d760 con 0x7f2a641626a0 2026-02-25T15:12:50.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.698+0000 7f2a60ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:50.701 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.698+0000 7f2a60ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:50.701 INFO:teuthology.misc.health.trial078.stdout: 2026-02-25T15:12:50.701 INFO:teuthology.misc.health.trial078.stdout:{"epoch":21,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:12:49.988090+0000","last_up_change":"2026-02-25T15:12:49.988090+0000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":3530698425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":3530698425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":3530698425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":3530698425}]},"public_addr":"10.20.193.155:6804/3530698425","cluster_addr":"10.20.193.155:6806/3530698425","heartbeat_back_addr":"10.20.193.155:6808/3530698425","heartbeat_front_addr":"10.20.193.155:6807/3530698425","state":["exists","up"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6800","nonce":4105183277}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":4105183277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":4105183277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":4105183277}]},"public_addr":"10.20.193.155:6800/4105183277","cluster_addr":"10.20.193.155:6801/4105183277","heartbeat_back_addr":"10.20.193.155:6803/4105183277","heartbeat_front_addr":"10.20.193.155:6802/4105183277","state":["exists","up"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:12:50.702 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 10 librados: watch_flush enter 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 10 librados: watch_flush exit 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 20 client.4323.objecter shutdown clearing up homeless session... 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 10 client.4323.objecter successfully canceled tick 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 >> v1:10.20.193.78:6800/3497602169 conn(0x7f2a34077e60 legacy=0x7f2a34098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 10 monclient: shutdown 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 >> v1:10.20.193.78:6789/0 conn(0x7f2a641626a0 legacy=0x7f2a640ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 shutdown_connections 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 >> 10.20.193.78:0/400984823 conn(0x7f2a640b65f0 msgr2=0x7f2a64059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:50.703 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 shutdown_connections 2026-02-25T15:12:50.704 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 1 -- 10.20.193.78:0/400984823 wait complete. 2026-02-25T15:12:50.704 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:50.700+0000 7f2a6a48a640 1 librados: shutdown 2026-02-25T15:12:50.709 DEBUG:teuthology.misc:2 of 16 OSDs are up 2026-02-25T15:12:58.323 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.381+0000 7f47aca88640 10 monclient: get_monmap_and_config 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.381+0000 7f47aca88640 10 monclient: build_initial_monmap 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.381+0000 7f47aca88640 10 monclient: monmap: 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:12:58.382042+0000 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:12:58.382042+0000 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:58.383 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:58.384 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:58.384 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:58.384 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:58.384 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:58.385 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.381+0000 7f47aca88640 1 Processor -- start 2026-02-25T15:12:58.385 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.381+0000 7f47aca88640 1 -- start start 2026-02-25T15:12:58.385 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.381+0000 7f47aca88640 10 monclient: init 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 10 monclient(hunting): picked mon.noname-c con 0x7f47a815d1f0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 10 monclient(hunting): picked mon.noname-b con 0x7f47a815d5c0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 10 monclient(hunting): picked mon.noname-a con 0x7f47a80b5cf0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a80b84c0 con 0x7f47a80b5cf0 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a80b1060 con 0x7f47a815d5c0 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a80b2770 con 0x7f47a815d1f0 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47aca88640 10 monclient(hunting): authenticate will time out at 3347.971152s 2026-02-25T15:12:58.386 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47a5d74640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f47a815d5c0 0x7f47a80b76a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58066/0 (socket says 10.20.193.78:58066) 2026-02-25T15:12:58.387 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.382+0000 7f47a5d74640 1 -- 10.20.193.78:0/1880678885 learned_addr learned my addr 10.20.193.78:0/1880678885 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:58.388 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104956778 0 0) 0x7f47a80b2770 con 0x7f47a815d1f0 2026-02-25T15:12:58.388 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:58.388 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:58.388 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 10 monclient(hunting): my global_id is 4328 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4794003610 con 0x7f47a815d1f0 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172482388 0 0) 0x7f47a80b1060 con 0x7f47a815d5c0 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 10 monclient(hunting): my global_id is 4345 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.384+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a80b2770 con 0x7f47a815d5c0 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1179725414 0 0) 0x7f47a80b2770 con 0x7f47a815d5c0 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 >> v1:10.20.193.167:6789/0 conn(0x7f47a815d1f0 legacy=0x7f47a80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 >> v1:10.20.193.78:6789/0 conn(0x7f47a80b5cf0 legacy=0x7f47a80b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:58.389 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 10 monclient: _finish_hunting 0 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 1 monclient: found mon.noname-b 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a80b2a50 con 0x7f47a815d5c0 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 10 monclient: _finish_auth 0 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 10 monclient: _check_auth_tickets 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4790002df0 con 0x7f47a815d5c0 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47a5573640 10 monclient: dump: 2026-02-25T15:12:58.390 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47aca88640 5 monclient: authenticate success, global_id 4345 2026-02-25T15:12:58.391 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.386+0000 7f47aca88640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:58.397 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4790003000 con 0x7f47a815d5c0 2026-02-25T15:12:58.397 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47a5573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:58.397 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47a5573640 1 -- 10.20.193.78:0/1880678885 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4790003440 con 0x7f47a815d5c0 2026-02-25T15:12:58.397 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 4 set_mon_vals no callback set 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47a5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47a5573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47a5573640 10 monclient: dump: 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:58.398 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 10 monclient: shutdown 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 1 -- 10.20.193.78:0/1880678885 >> v1:10.20.193.155:6789/0 conn(0x7f47a815d5c0 legacy=0x7f47a80b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 1 -- 10.20.193.78:0/1880678885 shutdown_connections 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 1 -- 10.20.193.78:0/1880678885 >> 10.20.193.78:0/1880678885 conn(0x7f47a80b5210 msgr2=0x7f47a80b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 1 -- 10.20.193.78:0/1880678885 shutdown_connections 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 1 -- 10.20.193.78:0/1880678885 wait complete. 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 10 monclient: build_initial_monmap 2026-02-25T15:12:58.399 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 10 monclient: monmap: 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:created 0.000000 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 1 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:58.400 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 1 librados: starting msgr at 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.387+0000 7f47aca88640 1 librados: starting objecter 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 1 Processor -- start 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 1 -- start start 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 1 librados: setting wanted keys 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 1 librados: calling monclient init 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 10 monclient: init 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:58.401 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 10 monclient(hunting): picked mon.noname-a con 0x7f47a80b5cf0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 10 monclient(hunting): picked mon.noname-b con 0x7f47a815d1f0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 10 monclient(hunting): picked mon.noname-c con 0x7f47a815d5c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a814d370 con 0x7f47a80b5cf0 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a815f440 con 0x7f47a815d1f0 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a815f720 con 0x7f47a815d5c0 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47aca88640 10 monclient(hunting): authenticate will time out at 3347.977473s 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47a6d76640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f47a815d5c0 0x7f47a811aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:54716/0 (socket says 10.20.193.78:54716) 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.388+0000 7f47a6d76640 1 -- 10.20.193.78:0/3294588450 learned_addr learned my addr 10.20.193.78:0/3294588450 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 10 client.?.objecter ms_handle_connect 0x7f47a815d5c0 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:58.402 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 10 client.?.objecter ms_handle_connect 0x7f47a815d1f0 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858552191 0 0) 0x7f47a815f720 con 0x7f47a815d5c0 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.389+0000 7f478effd640 10 monclient(hunting): my global_id is 4331 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.390+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4774003610 con 0x7f47a815d5c0 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.390+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43032016 0 0) 0x7f47a815f440 con 0x7f47a815d1f0 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.390+0000 7f478effd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.390+0000 7f478effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.390+0000 7f478effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.390+0000 7f478effd640 10 monclient(hunting): my global_id is 4348 2026-02-25T15:12:58.403 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.390+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a815f720 con 0x7f47a815d1f0 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1179460429 0 0) 0x7f4774003610 con 0x7f47a815d5c0 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47a815f440 con 0x7f47a815d5c0 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f47980033c0 con 0x7f47a815d5c0 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 10 monclient(hunting): dump: 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:58.404 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4216705154 0 0) 0x7f47a815f720 con 0x7f47a815d1f0 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4774003610 con 0x7f47a815d1f0 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4790003350 con 0x7f47a815d1f0 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:58.405 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.392+0000 7f478effd640 10 monclient(hunting): dump: 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2903337949 0 0) 0x7f4774003610 con 0x7f47a815d1f0 2026-02-25T15:12:58.406 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 >> v1:10.20.193.167:6789/0 conn(0x7f47a815d5c0 legacy=0x7f47a811aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 >> v1:10.20.193.78:6789/0 conn(0x7f47a80b5cf0 legacy=0x7f47a811c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 10 monclient: _finish_hunting 0 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 1 monclient: found mon.b 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a815fa00 con 0x7f47a815d1f0 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 10 monclient: _finish_auth 0 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 10 monclient: _check_auth_tickets 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f478effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:58.407 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 5 monclient: authenticate success, global_id 4348 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 10 monclient: _renew_subs 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47a815fce0 con 0x7f47a815d1f0 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 10 client.4348.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 10 monclient: _renew_subs 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47a814cbd0 con 0x7f47a815d1f0 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 1 librados: init done 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:58.408 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.394+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a814ce60 con 0x7f47a815d1f0 2026-02-25T15:12:58.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.485+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4790002fb0 con 0x7f47a815d1f0 2026-02-25T15:12:58.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.485+0000 7f478effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:58.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.485+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4790004d20 con 0x7f47a815d1f0 2026-02-25T15:12:58.488 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.485+0000 7f478effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:58.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.485+0000 7f478effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:58.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.485+0000 7f47a4d72640 4 set_mon_vals no callback set 2026-02-25T15:12:58.489 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.485+0000 7f478effd640 10 monclient: dump: 2026-02-25T15:12:58.489 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-25T15:12:58.489 INFO:teuthology.misc.health.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:58.489 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.490 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:58.490 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:58.490 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-25T15:12:58.490 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:58.490 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:58.490 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:58.491 INFO:teuthology.misc.health.trial078.stderr: 2026-02-25T15:12:58.491 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.486+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f479001db90 con 0x7f47a815d1f0 2026-02-25T15:12:58.493 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.486+0000 7f47a6575640 10 monclient: get_auth_request con 0x7f4774077c40 auth_method 0 2026-02-25T15:12:58.493 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.486+0000 7f478effd640 10 client.4348.objecter ms_handle_connect 0x7f4774077c40 2026-02-25T15:12:58.493 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.487+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(24..24 src has 1..24) ==== 7757+0+0 (unknown 161676074 0 0) 0x7f47900931e0 con 0x7f47a815d1f0 2026-02-25T15:12:58.494 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.487+0000 7f478effd640 10 client.4348.objecter ms_dispatch2 0x7f47a8000b90 osd_map(24..24 src has 1..24) 2026-02-25T15:12:58.494 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.487+0000 7f478effd640 3 client.4348.objecter handle_osd_map got epochs [24,24] > 0 2026-02-25T15:12:58.494 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.487+0000 7f478effd640 3 client.4348.objecter handle_osd_map decoding full epoch 24 2026-02-25T15:12:58.494 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.487+0000 7f478effd640 20 client.4348.objecter dump_active .. 0 homeless 2026-02-25T15:12:58.494 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.489+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f479005dc10 con 0x7f47a815d1f0 2026-02-25T15:12:58.494 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.489+0000 7f478effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:58.495 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.489+0000 7f478effd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:58.597 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.595+0000 7f47aca88640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:58.598 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.595+0000 7f47aca88640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:58.598 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.595+0000 7f47aca88640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:12:58.598 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:58.595+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47a8160b20 con 0x7f47a815d1f0 2026-02-25T15:12:59.187 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.185+0000 7f478effd640 1 -- 10.20.193.78:0/3294588450 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18957 (unknown 3496218867 0 2542288948) 0x7f479005d510 con 0x7f47a815d1f0 2026-02-25T15:12:59.187 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.185+0000 7f478effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:12:59.187 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.185+0000 7f478effd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:12:59.187 INFO:teuthology.misc.health.trial078.stdout: 2026-02-25T15:12:59.187 INFO:teuthology.misc.health.trial078.stdout:{"epoch":24,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:12:53.318964+0000","last_up_change":"2026-02-25T15:12:51.067937+0000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T15:12:50.860144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":3604255984}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":3604255984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":3604255984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":3604255984}]},"public_addr":"10.20.193.78:6801/3604255984","cluster_addr":"10.20.193.78:6802/3604255984","heartbeat_back_addr":"10.20.193.78:6804/3604255984","heartbeat_front_addr":"10.20.193.78:6803/3604255984","state":["exists","up"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6812","nonce":2301996681}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6813","nonce":2301996681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6815","nonce":2301996681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6814","nonce":2301996681}]},"public_addr":"10.20.193.155:6812/2301996681","cluster_addr":"10.20.193.155:6813/2301996681","heartbeat_back_addr":"10.20.193.155:6815/2301996681","heartbeat_front_addr":"10.20.193.155:6814/2301996681","state":["exists","up"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6808","nonce":3985671893}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6809","nonce":3985671893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6811","nonce":3985671893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6810","nonce":3985671893}]},"public_addr":"10.20.193.167:6808/3985671893","cluster_addr":"10.20.193.167:6809/3985671893","heartbeat_back_addr":"10.20.193.167:6811/3985671893","heartbeat_front_addr":"10.20.193.167:6810/3985671893","state":["exists","up"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6804","nonce":3507256265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6805","nonce":3507256265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6807","nonce":3507256265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6806","nonce":3507256265}]},"public_addr":"10.20.193.174:6804/3507256265","cluster_addr":"10.20.193.174:6805/3507256265","heartbeat_back_addr":"10.20.193.174:6807/3507256265","heartbeat_front_addr":"10.20.193.174:6806/3507256265","state":["exists","up"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":2928350245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":2928350245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2928350245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":2928350245}]},"public_addr":"10.20.193.78:6805/2928350245","cluster_addr":"10.20.193.78:6806/2928350245","heartbeat_back_addr":"10.20.193.78:6808/2928350245","heartbeat_front_addr":"10.20.193.78:6807/2928350245","state":["exists","up"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":3530698425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":3530698425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":3530698425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":3530698425}]},"public_addr":"10.20.193.155:6804/3530698425","cluster_addr":"10.20.193.155:6806/3530698425","heartbeat_back_addr":"10.20.193.155:6808/3530698425","heartbeat_front_addr":"10.20.193.155:6807/3530698425","state":["exists","up"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6812","nonce":762620751}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6813","nonce":762620751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6815","nonce":762620751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6814","nonce":762620751}]},"public_addr":"10.20.193.167:6812/762620751","cluster_addr":"10.20.193.167:6813/762620751","heartbeat_back_addr":"10.20.193.167:6815/762620751","heartbeat_front_addr":"10.20.193.167:6814/762620751","state":["exists","up"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6809","nonce":463709274}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6811","nonce":463709274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6815","nonce":463709274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6813","nonce":463709274}]},"public_addr":"10.20.193.174:6809/463709274","cluster_addr":"10.20.193.174:6811/463709274","heartbeat_back_addr":"10.20.193.174:6815/463709274","heartbeat_front_addr":"10.20.193.174:6813/463709274","state":["exists","up"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":1740746686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":1740746686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":1740746686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":1740746686}]},"public_addr":"10.20.193.78:6810/1740746686","cluster_addr":"10.20.193.78:6812/1740746686","heartbeat_back_addr":"10.20.193.78:6816/1740746686","heartbeat_front_addr":"10.20.193.78:6814/1740746686","state":["exists","up"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6805","nonce":976780597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6809","nonce":976780597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6811","nonce":976780597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6810","nonce":976780597}]},"public_addr":"10.20.193.155:6805/976780597","cluster_addr":"10.20.193.155:6809/976780597","heartbeat_back_addr":"10.20.193.155:6811/976780597","heartbeat_front_addr":"10.20.193.155:6810/976780597","state":["exists","up"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6804","nonce":601461155}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6805","nonce":601461155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6807","nonce":601461155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6806","nonce":601461155}]},"public_addr":"10.20.193.167:6804/601461155","cluster_addr":"10.20.193.167:6805/601461155","heartbeat_back_addr":"10.20.193.167:6807/601461155","heartbeat_front_addr":"10.20.193.167:6806/601461155","state":["exists","up"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6800","nonce":1887691036}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6801","nonce":1887691036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6803","nonce":1887691036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6802","nonce":1887691036}]},"public_addr":"10.20.193.174:6800/1887691036","cluster_addr":"10.20.193.174:6801/1887691036","heartbeat_back_addr":"10.20.193.174:6803/1887691036","heartbeat_front_addr":"10.20.193.174:6802/1887691036","state":["exists","up"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3800864779}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3800864779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":3800864779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":3800864779}]},"public_addr":"10.20.193.78:6809/3800864779","cluster_addr":"10.20.193.78:6811/3800864779","heartbeat_back_addr":"10.20.193.78:6815/3800864779","heartbeat_front_addr":"10.20.193.78:6813/3800864779","state":["exists","up"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6800","nonce":4105183277}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":4105183277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":4105183277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":4105183277}]},"public_addr":"10.20.193.155:6800/4105183277","cluster_addr":"10.20.193.155:6801/4105183277","heartbeat_back_addr":"10.20.193.155:6803/4105183277","heartbeat_front_addr":"10.20.193.155:6802/4105183277","state":["exists","up"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6800","nonce":376081176}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6801","nonce":376081176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6803","nonce":376081176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6802","nonce":376081176}]},"public_addr":"10.20.193.167:6800/376081176","cluster_addr":"10.20.193.167:6801/376081176","heartbeat_back_addr":"10.20.193.167:6803/376081176","heartbeat_front_addr":"10.20.193.167:6802/376081176","state":["exists","up"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6808","nonce":2760611848}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6810","nonce":2760611848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6814","nonce":2760611848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6812","nonce":2760611848}]},"public_addr":"10.20.193.174:6808/2760611848","cluster_addr":"10.20.193.174:6810/2760611848","heartbeat_back_addr":"10.20.193.174:6814/2760611848","heartbeat_front_addr":"10.20.193.174:6812/2760611848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.914877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.866863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.870323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.920826+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.103405+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.622662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.967538+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.005082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.055253+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.755804+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.863220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.094171+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.145637+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.608452+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.864615+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.980094+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 10 librados: watch_flush enter 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 10 librados: watch_flush exit 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 20 client.4348.objecter shutdown clearing up homeless session... 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 10 client.4348.objecter successfully canceled tick 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 >> v1:10.20.193.78:6800/3497602169 conn(0x7f4774077c40 legacy=0x7f47740980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 10 monclient: shutdown 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 >> v1:10.20.193.155:6789/0 conn(0x7f47a815d1f0 legacy=0x7f47a814c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 shutdown_connections 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 >> 10.20.193.78:0/3294588450 conn(0x7f47a80b5210 msgr2=0x7f47a81644f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 shutdown_connections 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 1 -- 10.20.193.78:0/3294588450 wait complete. 2026-02-25T15:12:59.190 INFO:teuthology.misc.health.trial078.stderr:2026-02-25T15:12:59.188+0000 7f47aca88640 1 librados: shutdown 2026-02-25T15:12:59.197 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-25T15:12:59.198 INFO:tasks.ceph:Creating RBD pool 2026-02-25T15:12:59.198 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-25T15:12:59.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.263+0000 7f6cc8d08640 10 monclient: get_monmap_and_config 2026-02-25T15:12:59.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.263+0000 7f6cc8d08640 10 monclient: build_initial_monmap 2026-02-25T15:12:59.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.263+0000 7f6cc8d08640 10 monclient: monmap: 2026-02-25T15:12:59.265 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:59.265 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.265 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:12:59.264241+0000 2026-02-25T15:12:59.266 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:12:59.264241+0000 2026-02-25T15:12:59.266 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:59.266 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.266 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:59.266 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:59.266 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:59.266 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.263+0000 7f6cc8d08640 1 Processor -- start 2026-02-25T15:12:59.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.263+0000 7f6cc8d08640 1 -- start start 2026-02-25T15:12:59.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.263+0000 7f6cc8d08640 10 monclient: init 2026-02-25T15:12:59.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:59.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 10 monclient(hunting): picked mon.noname-a con 0x7f6cc415afd0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 10 monclient(hunting): picked mon.noname-c con 0x7f6cc415b3a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 10 monclient(hunting): picked mon.noname-b con 0x7f6cc4163890 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc4162380 con 0x7f6cc415afd0 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc40b1c30 con 0x7f6cc4163890 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc40b1f10 con 0x7f6cc415b3a0 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc8d08640 10 monclient(hunting): authenticate will time out at 3348.853362s 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc2575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6cc415afd0 0x7f6cc4059be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:53072/0 (socket says 10.20.193.78:53072) 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.264+0000 7f6cc2575640 1 -- 10.20.193.78:0/53326600 learned_addr learned my addr 10.20.193.78:0/53326600 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:59.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855629194 0 0) 0x7f6cc40b1c30 con 0x7f6cc4163890 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 10 monclient(hunting): my global_id is 4354 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cb0003610 con 0x7f6cc4163890 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400814526 0 0) 0x7f6cc4162380 con 0x7f6cc415afd0 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 10 monclient(hunting): my global_id is 4335 2026-02-25T15:12:59.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.266+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cc40b1c30 con 0x7f6cc415afd0 2026-02-25T15:12:59.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.267+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 303553331 0 0) 0x7f6cb0003610 con 0x7f6cc4163890 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.267+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 >> v1:10.20.193.167:6789/0 conn(0x7f6cc415b3a0 legacy=0x7f6cc405d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.267+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 >> v1:10.20.193.78:6789/0 conn(0x7f6cc415afd0 legacy=0x7f6cc4059be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.267+0000 7f6cc1573640 10 monclient: _finish_hunting 0 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.267+0000 7f6cc1573640 1 monclient: found mon.noname-b 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.267+0000 7f6cc1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.267+0000 7f6cc1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc40b21f0 con 0x7f6cc4163890 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: _finish_auth 0 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: _check_auth_tickets 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6cb4003170 con 0x7f6cc4163890 2026-02-25T15:12:59.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: dump: 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.276 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc8d08640 5 monclient: authenticate success, global_id 4354 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc8d08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6cb4003380 con 0x7f6cc4163890 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 1 -- 10.20.193.78:0/53326600 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6cb40037c0 con 0x7f6cc4163890 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc1573640 10 monclient: dump: 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.277 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc8d08640 10 monclient: get_monmap_and_config success 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.268+0000 7f6cc8d08640 4 set_mon_vals no callback set 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 10 monclient: shutdown 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 -- 10.20.193.78:0/53326600 >> v1:10.20.193.155:6789/0 conn(0x7f6cc4163890 legacy=0x7f6cc4164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 -- 10.20.193.78:0/53326600 shutdown_connections 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 -- 10.20.193.78:0/53326600 >> 10.20.193.78:0/53326600 conn(0x7f6cc40b2f10 msgr2=0x7f6cc40b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 -- 10.20.193.78:0/53326600 shutdown_connections 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 -- 10.20.193.78:0/53326600 wait complete. 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 10 monclient: build_initial_monmap 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 10 monclient: monmap: 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:59.279 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 librados: starting msgr at 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 librados: starting objecter 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 Processor -- start 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 -- start start 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 librados: setting wanted keys 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 1 librados: calling monclient init 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.269+0000 7f6cc8d08640 10 monclient: init 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 10 monclient: _reopen_session rank -1 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:59.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 10 monclient(hunting): picked mon.noname-a con 0x7f6cc415afd0 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 10 monclient(hunting): picked mon.noname-b con 0x7f6cc415b3a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 10 monclient(hunting): picked mon.noname-c con 0x7f6cc4163890 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc405c160 con 0x7f6cc415afd0 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc405c440 con 0x7f6cc415b3a0 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc405c720 con 0x7f6cc4163890 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 10 monclient(hunting): _renew_subs 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc8d08640 10 monclient(hunting): authenticate will time out at 3348.859376s 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc2575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6cc415afd0 0x7f6cc414c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:53076/0 (socket says 10.20.193.78:53076) 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6cc2575640 1 -- 10.20.193.78:0/421102535 learned_addr learned my addr 10.20.193.78:0/421102535 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6caaffd640 10 client.?.objecter ms_handle_connect 0x7f6cc415afd0 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.270+0000 7f6caaffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:59.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 10 client.?.objecter ms_handle_connect 0x7f6cc4163890 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 10 client.?.objecter ms_handle_connect 0x7f6cc415b3a0 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095789412 0 0) 0x7f6cc405c160 con 0x7f6cc415afd0 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 10 monclient(hunting): my global_id is 4338 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.271+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c90003610 con 0x7f6cc415afd0 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.272+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 765655727 0 0) 0x7f6cc405c440 con 0x7f6cc415b3a0 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.272+0000 7f6caaffd640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.272+0000 7f6caaffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.272+0000 7f6caaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.272+0000 7f6caaffd640 10 monclient(hunting): my global_id is 4357 2026-02-25T15:12:59.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.272+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cc405c160 con 0x7f6cc415b3a0 2026-02-25T15:12:59.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.274+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1436442527 0 0) 0x7f6c90003610 con 0x7f6cc415afd0 2026-02-25T15:12:59.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.274+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6cc405c440 con 0x7f6cc415afd0 2026-02-25T15:12:59.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.274+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6cb80030f0 con 0x7f6cc415afd0 2026-02-25T15:12:59.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.274+0000 7f6caaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:59.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.274+0000 7f6caaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:59.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.274+0000 7f6caaffd640 10 monclient(hunting): dump: 2026-02-25T15:12:59.285 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.274+0000 7f6caaffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.275+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4154143578 0 0) 0x7f6cc405c160 con 0x7f6cc415b3a0 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.275+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c90003610 con 0x7f6cc415b3a0 2026-02-25T15:12:59.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.275+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6cac002fc0 con 0x7f6cc415b3a0 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.275+0000 7f6caaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.275+0000 7f6caaffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.275+0000 7f6caaffd640 10 monclient(hunting): dump: 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.287 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2773496594 0 0) 0x7f6cc405c440 con 0x7f6cc415afd0 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 >> v1:10.20.193.167:6789/0 conn(0x7f6cc4163890 legacy=0x7f6cc4128c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 >> v1:10.20.193.155:6789/0 conn(0x7f6cc415b3a0 legacy=0x7f6cc40a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 10 monclient: _finish_hunting 0 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 1 monclient: found mon.a 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc405ca00 con 0x7f6cc415afd0 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 10 monclient: _finish_auth 0 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 10 monclient: _check_auth_tickets 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6caaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:59.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 5 monclient: authenticate success, global_id 4338 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 10 monclient: _renew_subs 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc405cce0 con 0x7f6cc415afd0 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 10 client.4338.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 10 monclient: _renew_subs 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6cc414c460 con 0x7f6cc415afd0 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.276+0000 7f6cc8d08640 1 librados: init done 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.277+0000 7f6cc8d08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.277+0000 7f6cc8d08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.277+0000 7f6cc8d08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.277+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc41655d0 con 0x7f6cc415afd0 2026-02-25T15:12:59.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.371+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6cb80048d0 con 0x7f6cc415afd0 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.371+0000 7f6caaffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.371+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6cb8004c20 con 0x7f6cc415afd0 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.371+0000 7f6caaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.371+0000 7f6caaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.371+0000 7f6caaffd640 10 monclient: dump: 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.374 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.375 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.375 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.375 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.375 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.371+0000 7f6cc0d72640 4 set_mon_vals no callback set 2026-02-25T15:12:59.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.372+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6cb801da90 con 0x7f6cc415afd0 2026-02-25T15:12:59.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.372+0000 7f6cc1d74640 10 monclient: get_auth_request con 0x7f6c90077c80 auth_method 0 2026-02-25T15:12:59.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.373+0000 7f6caaffd640 10 client.4338.objecter ms_handle_connect 0x7f6c90077c80 2026-02-25T15:12:59.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.375+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(24..24 src has 1..24) ==== 7757+0+0 (unknown 161676074 0 0) 0x7f6cb8093440 con 0x7f6cc415afd0 2026-02-25T15:12:59.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.375+0000 7f6caaffd640 10 client.4338.objecter ms_dispatch2 0x7f6cc4000b90 osd_map(24..24 src has 1..24) 2026-02-25T15:12:59.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.375+0000 7f6caaffd640 3 client.4338.objecter handle_osd_map got epochs [24,24] > 0 2026-02-25T15:12:59.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.375+0000 7f6caaffd640 3 client.4338.objecter handle_osd_map decoding full epoch 24 2026-02-25T15:12:59.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.375+0000 7f6caaffd640 20 client.4338.objecter dump_active .. 0 homeless 2026-02-25T15:12:59.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.375+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6cc41655d0 con 0x7f6cc415afd0 2026-02-25T15:12:59.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.375+0000 7f6caaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:12:59.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.375+0000 7f6caaffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:12:59.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.483+0000 7f6cc8d08640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-25T15:12:59.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.483+0000 7f6cc8d08640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-25T15:12:59.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.483+0000 7f6cc8d08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.483+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f6cc4135960 con 0x7f6cc415afd0 2026-02-25T15:12:59.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.571+0000 7f6caaffd640 1 -- 10.20.193.78:0/421102535 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v25) ==== 109+0+0 (unknown 2655803957 0 0) 0x7f6cc4135960 con 0x7f6cc415afd0 2026-02-25T15:12:59.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.571+0000 7f6caaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-25T15:12:59.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.571+0000 7f6caaffd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-25T15:12:59.573 INFO:teuthology.orchestra.run.trial078.stderr:pool 'rbd' created 2026-02-25T15:12:59.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 10 librados: watch_flush enter 2026-02-25T15:12:59.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 10 librados: watch_flush exit 2026-02-25T15:12:59.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 20 client.4338.objecter shutdown clearing up homeless session... 2026-02-25T15:12:59.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 10 client.4338.objecter successfully canceled tick 2026-02-25T15:12:59.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6c90077c80 legacy=0x7f6c90098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 10 monclient: shutdown 2026-02-25T15:12:59.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:59.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 >> v1:10.20.193.78:6789/0 conn(0x7f6cc415afd0 legacy=0x7f6cc414c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 shutdown_connections 2026-02-25T15:12:59.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 >> 10.20.193.78:0/421102535 conn(0x7f6cc40b2f10 msgr2=0x7f6cc405d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:59.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 shutdown_connections 2026-02-25T15:12:59.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 1 -- 10.20.193.78:0/421102535 wait complete. 2026-02-25T15:12:59.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.573+0000 7f6cc8d08640 1 librados: shutdown 2026-02-25T15:12:59.585 DEBUG:teuthology.orchestra.run.trial078:> rbd --cluster ceph pool init rbd 2026-02-25T15:12:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.613+0000 7fe54ed62300 10 monclient: get_monmap_and_config 2026-02-25T15:12:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.613+0000 7fe54ed62300 10 monclient: build_initial_monmap 2026-02-25T15:12:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.613+0000 7fe54ed62300 10 monclient: monmap: 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:12:59.614484+0000 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:12:59.614484+0000 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:59.616 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 1 Processor -- start 2026-02-25T15:12:59.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 1 -- start start 2026-02-25T15:12:59.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 10 monclient: init 2026-02-25T15:12:59.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 10 monclient: _reopen_session rank -1 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 10 monclient(hunting): picked mon.noname-a con 0x5639af027640 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 10 monclient(hunting): picked mon.noname-b con 0x5639aef3bd80 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 10 monclient(hunting): picked mon.noname-c con 0x5639af02dd10 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5639aed930c0 con 0x5639af027640 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5639aeda2a80 con 0x5639aef3bd80 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5639aef3b000 con 0x5639af02dd10 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 10 monclient(hunting): _renew_subs 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.614+0000 7fe54ed62300 10 monclient(hunting): authenticate will time out at 3349.203723s 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.615+0000 7fe54d817640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x5639af027640 0x5639af02ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:53092/0 (socket says 10.20.193.78:53092) 2026-02-25T15:12:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.615+0000 7fe54d817640 1 -- 10.20.193.78:0/426662917 learned_addr learned my addr 10.20.193.78:0/426662917 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614323924 0 0) 0x5639aed930c0 con 0x5639af027640 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 10 monclient(hunting): my global_id is 4341 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe534001e10 con 0x5639af027640 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364394533 0 0) 0x5639aeda2a80 con 0x5639aef3bd80 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 10 monclient(hunting): my global_id is 4360 2026-02-25T15:12:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.616+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5639aed930c0 con 0x5639aef3bd80 2026-02-25T15:12:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3869592248 0 0) 0x7fe534001e10 con 0x5639af027640 2026-02-25T15:12:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 >> v1:10.20.193.167:6789/0 conn(0x5639af02dd10 legacy=0x5639aef37e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:12:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 >> v1:10.20.193.155:6789/0 conn(0x5639aef3bd80 legacy=0x5639af02d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: _finish_hunting 0 2026-02-25T15:12:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 1 monclient: found mon.noname-a 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639aef80b40 con 0x5639af027640 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: _finish_auth 0 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: _check_auth_tickets 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe5440015f0 con 0x5639af027640 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: dump: 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.626 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54ed62300 5 monclient: authenticate success, global_id 4341 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54ed62300 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe544001870 con 0x5639af027640 2026-02-25T15:12:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54ed62300 10 monclient: get_monmap_and_config success 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54ed62300 4 set_mon_vals no callback set 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 1 -- 10.20.193.78:0/426662917 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe544001cb0 con 0x5639af027640 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.618+0000 7fe54c815640 10 monclient: dump: 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.628 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 10 monclient: shutdown 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 1 -- 10.20.193.78:0/426662917 >> v1:10.20.193.78:6789/0 conn(0x5639af027640 legacy=0x5639af02ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 1 -- 10.20.193.78:0/426662917 shutdown_connections 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 1 -- 10.20.193.78:0/426662917 >> 10.20.193.78:0/426662917 conn(0x5639aef391d0 msgr2=0x5639aef395d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 1 -- 10.20.193.78:0/426662917 shutdown_connections 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 1 -- 10.20.193.78:0/426662917 wait complete. 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 10 monclient: build_initial_monmap 2026-02-25T15:12:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 10 monclient: monmap: 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 1 librados: starting msgr at 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 1 librados: starting objecter 2026-02-25T15:12:59.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.619+0000 7fe54ed62300 1 Processor -- start 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 1 -- start start 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 1 librados: setting wanted keys 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 1 librados: calling monclient init 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 10 monclient: init 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 10 monclient: _reopen_session rank -1 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 10 monclient(hunting): picked mon.noname-b con 0x5639aef3bd80 addr v1:10.20.193.155:6789/0 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 10 monclient(hunting): picked mon.noname-c con 0x5639af027640 addr v1:10.20.193.167:6789/0 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 10 monclient(hunting): picked mon.noname-a con 0x5639af02dd10 addr v1:10.20.193.78:6789/0 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5639af003660 con 0x5639af02dd10 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5639af03d5b0 con 0x5639aef3bd80 2026-02-25T15:12:59.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5639af03d890 con 0x5639af027640 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 10 monclient(hunting): _renew_subs 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54ed62300 10 monclient(hunting): authenticate will time out at 3349.209487s 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54d817640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x5639aef3bd80 0x5639af002f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58120/0 (socket says 10.20.193.78:58120) 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.620+0000 7fe54d817640 1 -- 10.20.193.78:0/2866516559 learned_addr learned my addr 10.20.193.78:0/2866516559 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.621+0000 7fe53dffb640 10 client.?.objecter ms_handle_connect 0x5639aef3bd80 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.621+0000 7fe53dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.621+0000 7fe53dffb640 10 client.?.objecter ms_handle_connect 0x5639af02dd10 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.621+0000 7fe53dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620844124 0 0) 0x5639af03d5b0 con 0x5639aef3bd80 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 monclient(hunting): my global_id is 4363 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe52c001e10 con 0x5639aef3bd80 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514726206 0 0) 0x5639af003660 con 0x5639af02dd10 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 monclient(hunting): my global_id is 4344 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5639af03d5b0 con 0x5639af02dd10 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 client.?.objecter ms_handle_connect 0x5639af027640 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.622+0000 7fe53dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.623+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972534242 0 0) 0x5639af03d890 con 0x5639af027640 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.623+0000 7fe53dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:12:59.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.623+0000 7fe53dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:12:59.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.623+0000 7fe53dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:12:59.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.623+0000 7fe53dffb640 10 monclient(hunting): my global_id is 4337 2026-02-25T15:12:59.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.623+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5639af003660 con 0x5639af027640 2026-02-25T15:12:59.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 58007596 0 0) 0x5639af03d5b0 con 0x5639af02dd10 2026-02-25T15:12:59.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5639af03d890 con 0x5639af02dd10 2026-02-25T15:12:59.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe5400019d0 con 0x5639af02dd10 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 10 monclient(hunting): dump: 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.637 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 331549428 0 0) 0x7fe52c001e10 con 0x5639aef3bd80 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5639af03d5b0 con 0x5639aef3bd80 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe544001920 con 0x5639aef3bd80 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.624+0000 7fe53dffb640 10 monclient(hunting): dump: 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.638 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2015427737 0 0) 0x5639af003660 con 0x5639af027640 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe52c001e10 con 0x5639af027640 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe538001800 con 0x5639af027640 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:12:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 10 monclient(hunting): dump: 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1684083935 0 0) 0x5639af03d890 con 0x5639af02dd10 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 >> v1:10.20.193.167:6789/0 conn(0x5639af027640 legacy=0x5639af02b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 >> v1:10.20.193.155:6789/0 conn(0x5639aef3bd80 legacy=0x5639af002f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 1 monclient: found mon.a 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639af03db70 con 0x5639af02dd10 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 10 monclient: _finish_auth 0 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe53dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 5 monclient: authenticate success, global_id 4344 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 10 monclient: _renew_subs 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x5639af03de50 con 0x5639af02dd10 2026-02-25T15:12:59.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 10 monclient: _renew_subs 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x5639af03d170 con 0x5639af02dd10 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 1 librados: init done 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.626+0000 7fe54ed62300 10 librados: wait_for_osdmap waiting 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.634+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe540001b70 con 0x5639af02dd10 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.634+0000 7fe53dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.634+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe540002230 con 0x5639af02dd10 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.634+0000 7fe53dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.634+0000 7fe53dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.634+0000 7fe53dffb640 10 monclient: dump: 2026-02-25T15:12:59.642 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:12:59.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.634+0000 7fe53ffff640 4 set_mon_vals no callback set 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.635+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fe54001b110 con 0x5639af02dd10 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.635+0000 7fe54d817640 10 monclient: get_auth_request con 0x7fe52c076730 auth_method 0 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.635+0000 7fe53dffb640 10 client.4344.objecter ms_handle_connect 0x7fe52c076730 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 8102+0+0 (unknown 2795937430 0 0) 0x7fe5400909a0 con 0x5639af02dd10 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe53dffb640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_map(25..25 src has 1..25) 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe53dffb640 3 client.4344.objecter handle_osd_map got epochs [25,25] > 0 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe53dffb640 3 client.4344.objecter handle_osd_map decoding full epoch 25 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe53dffb640 20 client.4344.objecter dump_active .. 0 homeless 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe54ed62300 10 librados: wait_for_osdmap done waiting 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe54ed62300 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-25T15:12:59.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe54ed62300 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-25T15:12:59.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe54ed62300 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:12:59.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:12:59.636+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x5639af02c1f0 con 0x5639af02dd10 2026-02-25T15:13:00.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.583+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v26) ==== 141+0+0 (unknown 433528931 0 0) 0x7fe54005b3d0 con 0x5639af02dd10 2026-02-25T15:13:00.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.583+0000 7fe53dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-25T15:13:00.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.583+0000 7fe53dffb640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-25T15:13:00.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.583+0000 7fe54ed62300 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:00.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.583+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x5639aee2bfb0 con 0x5639af02dd10 2026-02-25T15:13:00.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.620+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (unknown 2370098492 0 0) 0x7fe54005a3d0 con 0x5639af02dd10 2026-02-25T15:13:00.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.620+0000 7fe53dffb640 10 monclient: handle_get_version_reply finishing 1 version 26 2026-02-25T15:13:00.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.620+0000 7fe53ffff640 10 client.4344.objecter _get_latest_version latest 26, waiting 2026-02-25T15:13:00.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.620+0000 7fe53ffff640 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:00.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.620+0000 7fe53ffff640 10 monclient: _renew_subs 2026-02-25T15:13:00.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.620+0000 7fe53ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:00.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.620+0000 7fe53ffff640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=26}) -- 0x7fe528002ae0 con 0x5639af02dd10 2026-02-25T15:13:00.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 11 ==== osd_map(26..26 src has 1..26) ==== 669+0+0 (unknown 660926658 0 0) 0x7fe54005a590 con 0x5639af02dd10 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe53dffb640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_map(26..26 src has 1..26) 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe53dffb640 3 client.4344.objecter handle_osd_map got epochs [26,26] > 25 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe53dffb640 3 client.4344.objecter handle_osd_map decoding incremental epoch 26 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe53dffb640 20 client.4344.objecter dump_active .. 0 homeless 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 10 librados: create oid=rbd_trash nspace= 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 10 client.4344.objecter _op_submit op 0x5639af0236e0 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 20 client.4344.objecter _calc_target epoch 26 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 20 client.4344.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 10 client.4344.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [12,14] primary 12 2026-02-25T15:13:00.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 20 client.4344.objecter _get_session s=0x5639aedac280 osd=12 3 2026-02-25T15:13:00.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 10 client.4344.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.12 2026-02-25T15:13:00.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 20 client.4344.objecter get_session s=0x5639aedac280 osd=12 3 2026-02-25T15:13:00.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 15 client.4344.objecter _session_op_assign 12 1 2026-02-25T15:13:00.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 15 client.4344.objecter _send_op 1 to 2.3 on osd.12 2026-02-25T15:13:00.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6809/3800864779 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) -- 0x5639af0c49c0 con 0x5639af0a2ec0 2026-02-25T15:13:00.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 4 2026-02-25T15:13:00.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.656+0000 7fe54ed62300 5 client.4344.objecter 1 in flight 2026-02-25T15:13:00.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.697+0000 7fe54d016640 10 monclient: get_auth_request con 0x5639af0a2ec0 auth_method 0 2026-02-25T15:13:00.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:00.701+0000 7fe53dffb640 10 client.4344.objecter ms_handle_connect 0x5639af0a2ec0 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 1 -- 10.20.193.78:0/2866516559 <== osd.12 v1:10.20.193.78:6809/3800864779 1 ==== osd_op_reply(1 rbd_trash [create] v26'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 504360132 0 0) 0x7fe538003e10 con 0x5639af0a2ec0 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_op_reply(1 rbd_trash [create] v26'1 uv1 ondisk = 0) 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 10 client.4344.objecter in handle_osd_op_reply 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 7 client.4344.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 10 client.4344.objecter op 0 rval 0 len 0 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 15 client.4344.objecter handle_osd_op_reply completed tid 1 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 15 client.4344.objecter _finish_op 1 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 4 2026-02-25T15:13:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 15 client.4344.objecter _session_op_remove 12 1 2026-02-25T15:13:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54d016640 5 client.4344.objecter 0 in flight 2026-02-25T15:13:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.355+0000 7fe54ed62300 10 librados: Objecter returned from create r=0 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 10 client.4344.objecter _op_submit op 0x5639af0ff670 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 20 client.4344.objecter _calc_target epoch 26 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 20 client.4344.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 10 client.4344.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [12,8] primary 12 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 10 client.4344.objecter chose random osd.12 of [12,8] 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 20 client.4344.objecter _get_session s=0x5639aedac280 osd=12 3 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 10 client.4344.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.12 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 20 client.4344.objecter get_session s=0x5639aedac280 osd=12 3 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 15 client.4344.objecter _session_op_assign 12 2 2026-02-25T15:13:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 15 client.4344.objecter _send_op 2 to 2.2 on osd.12 2026-02-25T15:13:01.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6809/3800864779 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e26) -- 0x5639af0ffba0 con 0x5639af0a2ec0 2026-02-25T15:13:01.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 4 2026-02-25T15:13:01.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.357+0000 7fe54ed62300 5 client.4344.objecter 1 in flight 2026-02-25T15:13:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 1 -- 10.20.193.78:0/2866516559 <== osd.12 v1:10.20.193.78:6809/3800864779 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 3560438577 0 0) 0x7fe538003e10 con 0x5639af0a2ec0 2026-02-25T15:13:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 10 client.4344.objecter in handle_osd_op_reply 2026-02-25T15:13:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 7 client.4344.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-25T15:13:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 10 client.4344.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 10 client.4344.objecter op 0 rval 0 len 0 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 15 client.4344.objecter handle_osd_op_reply completed tid 2 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 15 client.4344.objecter _finish_op 2 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 4 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 15 client.4344.objecter _session_op_remove 12 2 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54d016640 5 client.4344.objecter 0 in flight 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 10 client.4344.objecter _op_submit op 0x5639af0fe7d0 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 20 client.4344.objecter _calc_target epoch 26 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 20 client.4344.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 10 client.4344.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [12,8] primary 12 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 10 client.4344.objecter chose random osd.8 of [12,8] 2026-02-25T15:13:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 20 client.4344.objecter _get_session s=0x5639af0fec80 osd=8 3 2026-02-25T15:13:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 10 client.4344.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.8 2026-02-25T15:13:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 20 client.4344.objecter get_session s=0x5639af0fec80 osd=8 3 2026-02-25T15:13:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 15 client.4344.objecter _session_op_assign 8 3 2026-02-25T15:13:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 15 client.4344.objecter _send_op 3 to 2.2 on osd.8 2026-02-25T15:13:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6810/1740746686 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e26) -- 0x5639af0ff750 con 0x5639af0ff300 2026-02-25T15:13:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 20 client.4344.objecter put_session s=0x5639af0fec80 osd=8 4 2026-02-25T15:13:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.373+0000 7fe54ed62300 5 client.4344.objecter 1 in flight 2026-02-25T15:13:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.374+0000 7fe54d817640 10 monclient: get_auth_request con 0x5639af0ff300 auth_method 0 2026-02-25T15:13:01.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.375+0000 7fe53dffb640 10 client.4344.objecter ms_handle_connect 0x5639af0ff300 2026-02-25T15:13:01.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 1 -- 10.20.193.78:0/2866516559 <== osd.8 v1:10.20.193.78:6810/1740746686 1 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 3580297533 0 0) 0x7fe544006420 con 0x5639af0ff300 2026-02-25T15:13:01.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:01.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 10 client.4344.objecter in handle_osd_op_reply 2026-02-25T15:13:01.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 7 client.4344.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-25T15:13:01.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 10 client.4344.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:01.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 10 client.4344.objecter op 0 rval 0 len 0 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 15 client.4344.objecter handle_osd_op_reply completed tid 3 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 15 client.4344.objecter _finish_op 3 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 20 client.4344.objecter put_session s=0x5639af0fec80 osd=8 4 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 15 client.4344.objecter _session_op_remove 8 3 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe54d817640 5 client.4344.objecter 0 in flight 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe53f7fe640 10 client.4344.objecter allocate_selfmanaged_snap; pool: 2 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe53f7fe640 10 client.4344.objecter pool_op_submit 4 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe53f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:01.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.429+0000 7fe53f7fe640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fe520003110 con 0x5639af02dd10 2026-02-25T15:13:01.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v27) ==== 55+0+0 (unknown 2566355408 0 0) 0x7fe54005acd0 con 0x5639af02dd10 2026-02-25T15:13:01.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 pool_op_reply(tid 4 (0) Success v27) 2026-02-25T15:13:01.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 10 client.4344.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v27) 2026-02-25T15:13:01.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 10 client.4344.objecter have request 4 at 0x7fe5200030a0 Op: create unmanaged snap 2026-02-25T15:13:01.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 20 client.4344.objecter waiting for client to reach epoch 27 before calling back 2026-02-25T15:13:01.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:01.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 10 monclient: _renew_subs 2026-02-25T15:13:01.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:01.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=27}) -- 0x5639af03d890 con 0x5639af02dd10 2026-02-25T15:13:01.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.670+0000 7fe53dffb640 10 client.4344.objecter done 2026-02-25T15:13:01.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 13 ==== osd_map(27..27 src has 1..27) ==== 629+0+0 (unknown 955156682 0 0) 0x7fe54005a790 con 0x5639af02dd10 2026-02-25T15:13:01.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53dffb640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_map(27..27 src has 1..27) 2026-02-25T15:13:01.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53dffb640 3 client.4344.objecter handle_osd_map got epochs [27,27] > 26 2026-02-25T15:13:01.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53dffb640 3 client.4344.objecter handle_osd_map decoding incremental epoch 27 2026-02-25T15:13:01.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53dffb640 20 client.4344.objecter dump_active .. 0 homeless 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53ffff640 20 librados: queue_aio_write 0x5639af0fac00 completion 0x5639aedcf3a0 write_seq 1 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53ffff640 10 client.4344.objecter _op_submit op 0x7fe528006400 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53ffff640 20 client.4344.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.676+0000 7fe53ffff640 20 client.4344.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 10 client.4344.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [12,8] primary 12 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 20 client.4344.objecter _get_session s=0x5639aedac280 osd=12 3 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 10 client.4344.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.12 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 20 client.4344.objecter get_session s=0x5639aedac280 osd=12 3 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 15 client.4344.objecter _session_op_assign 12 5 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 15 client.4344.objecter _send_op 5 to 2.2 on osd.12 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6809/3800864779 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x7fe528006910 con 0x5639af0a2ec0 2026-02-25T15:13:01.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 4 2026-02-25T15:13:01.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.677+0000 7fe53ffff640 5 client.4344.objecter 1 in flight 2026-02-25T15:13:01.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 1 -- 10.20.193.78:0/2866516559 <== osd.12 v1:10.20.193.78:6809/3800864779 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v27'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 3272180499 0 0) 0x7fe538003e10 con 0x5639af0a2ec0 2026-02-25T15:13:01.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_op_reply(5 rbd_info [create,write 0~8] v27'1 uv1 ondisk = 0) 2026-02-25T15:13:01.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 10 client.4344.objecter in handle_osd_op_reply 2026-02-25T15:13:01.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 7 client.4344.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-25T15:13:01.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 10 client.4344.objecter op 0 rval 0 len 0 2026-02-25T15:13:01.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 10 client.4344.objecter op 1 rval 0 len 0 2026-02-25T15:13:01.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 15 client.4344.objecter handle_osd_op_reply completed tid 5 2026-02-25T15:13:01.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 15 client.4344.objecter _finish_op 5 2026-02-25T15:13:01.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 4 2026-02-25T15:13:01.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 15 client.4344.objecter _session_op_remove 12 5 2026-02-25T15:13:01.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 5 client.4344.objecter 0 in flight 2026-02-25T15:13:01.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe54d016640 20 librados: complete_aio_write 0x5639aedcf3a0 2026-02-25T15:13:01.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe53f7fe640 10 client.4344.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-25T15:13:01.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe53f7fe640 10 client.4344.objecter pool_op_submit 6 2026-02-25T15:13:01.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe53f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:01.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:01.816+0000 7fe53f7fe640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v27) -- 0x7fe5200033b0 con 0x5639af02dd10 2026-02-25T15:13:02.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.620+0000 7fe53cff9640 10 monclient: tick 2026-02-25T15:13:02.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.620+0000 7fe53cff9640 10 monclient: _check_auth_tickets 2026-02-25T15:13:02.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.620+0000 7fe53cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:02.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.620+0000 7fe53cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:02.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v28) ==== 43+0+0 (unknown 955237139 0 0) 0x7fe5400603b0 con 0x5639af02dd10 2026-02-25T15:13:02.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 pool_op_reply(tid 6 (0) Success v28) 2026-02-25T15:13:02.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 10 client.4344.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v28) 2026-02-25T15:13:02.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 10 client.4344.objecter have request 6 at 0x7fe5200030a0 Op: delete unmanaged snap 2026-02-25T15:13:02.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 20 client.4344.objecter waiting for client to reach epoch 28 before calling back 2026-02-25T15:13:02.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:02.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 10 monclient: _renew_subs 2026-02-25T15:13:02.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:02.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=28}) -- 0x5639af003660 con 0x5639af02dd10 2026-02-25T15:13:02.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.752+0000 7fe53dffb640 10 client.4344.objecter done 2026-02-25T15:13:02.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.760+0000 7fe53dffb640 1 -- 10.20.193.78:0/2866516559 <== mon.0 v1:10.20.193.78:6789/0 15 ==== osd_map(28..28 src has 1..28) ==== 657+0+0 (unknown 2991693576 0 0) 0x7fe5400589d0 con 0x5639af02dd10 2026-02-25T15:13:02.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.760+0000 7fe53dffb640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_map(28..28 src has 1..28) 2026-02-25T15:13:02.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.760+0000 7fe53dffb640 3 client.4344.objecter handle_osd_map got epochs [28,28] > 27 2026-02-25T15:13:02.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.760+0000 7fe53dffb640 3 client.4344.objecter handle_osd_map decoding incremental epoch 28 2026-02-25T15:13:02.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.760+0000 7fe53dffb640 20 client.4344.objecter dump_active .. 0 homeless 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 20 librados: queue_aio_write 0x5639af0fac00 completion 0x7fe520001da0 write_seq 2 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 10 client.4344.objecter _op_submit op 0x7fe528006400 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 20 client.4344.objecter _calc_target epoch 28 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 20 client.4344.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 10 client.4344.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [12,8] primary 12 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 20 client.4344.objecter _get_session s=0x5639aedac280 osd=12 3 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 10 client.4344.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.12 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 20 client.4344.objecter get_session s=0x5639aedac280 osd=12 3 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 15 client.4344.objecter _session_op_assign 12 7 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 15 client.4344.objecter _send_op 7 to 2.2 on osd.12 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 1 -- 10.20.193.78:0/2866516559 --> v1:10.20.193.78:6809/3800864779 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) -- 0x7fe528006e40 con 0x5639af0a2ec0 2026-02-25T15:13:02.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 4 2026-02-25T15:13:02.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.761+0000 7fe53ffff640 5 client.4344.objecter 1 in flight 2026-02-25T15:13:02.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 1 -- 10.20.193.78:0/2866516559 <== osd.12 v1:10.20.193.78:6809/3800864779 4 ==== osd_op_reply(7 rbd_info [write 0~19] v28'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 1447781391 0 0) 0x7fe538003e10 con 0x5639af0a2ec0 2026-02-25T15:13:02.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 10 client.4344.objecter ms_dispatch2 0x5639aee4fd50 osd_op_reply(7 rbd_info [write 0~19] v28'2 uv2 ondisk = 0) 2026-02-25T15:13:02.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 10 client.4344.objecter in handle_osd_op_reply 2026-02-25T15:13:02.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 7 client.4344.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-25T15:13:02.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 10 client.4344.objecter op 0 rval 0 len 0 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 15 client.4344.objecter handle_osd_op_reply completed tid 7 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 15 client.4344.objecter _finish_op 7 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 4 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 15 client.4344.objecter _session_op_remove 12 7 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 5 client.4344.objecter 0 in flight 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54d016640 20 librados: complete_aio_write 0x7fe520001da0 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54ed62300 10 librados: watch_flush enter 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54ed62300 10 librados: watch_flush exit 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54ed62300 10 client.4344.objecter close_session for osd.8 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 >> v1:10.20.193.78:6810/1740746686 conn(0x5639af0ff300 legacy=0x5639af0fad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54ed62300 20 client.4344.objecter put_session s=0x5639af0fec80 osd=8 1 2026-02-25T15:13:02.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54ed62300 10 client.4344.objecter close_session for osd.12 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.852+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 >> v1:10.20.193.78:6809/3800864779 conn(0x5639af0a2ec0 legacy=0x5639af0c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 20 client.4344.objecter put_session s=0x5639aedac280 osd=12 1 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 20 client.4344.objecter shutdown clearing up homeless session... 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 10 client.4344.objecter successfully canceled tick 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 >> v1:10.20.193.78:6800/3497602169 conn(0x7fe52c076730 legacy=0x7fe52c096be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 10 monclient: shutdown 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 >> v1:10.20.193.78:6789/0 conn(0x5639af02dd10 legacy=0x5639af022fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54eaa0640 1 -- 10.20.193.78:0/2866516559 reap_dead start 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54eaa0640 1 -- 10.20.193.78:0/2866516559 reap_dead start 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 shutdown_connections 2026-02-25T15:13:02.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 >> 10.20.193.78:0/2866516559 conn(0x5639aef391d0 msgr2=0x5639af02ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:02.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 shutdown_connections 2026-02-25T15:13:02.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 1 -- 10.20.193.78:0/2866516559 wait complete. 2026-02-25T15:13:02.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.853+0000 7fe54ed62300 1 librados: shutdown 2026-02-25T15:13:02.860 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-25T15:13:02.861 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-25T15:13:02.861 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-25T15:13:02.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.968+0000 7f6e8a13a640 10 monclient: get_monmap_and_config 2026-02-25T15:13:02.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.968+0000 7f6e8a13a640 10 monclient: build_initial_monmap 2026-02-25T15:13:02.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.968+0000 7f6e8a13a640 10 monclient: monmap: 2026-02-25T15:13:02.970 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:02.970 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:02.970 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:02.968990+0000 2026-02-25T15:13:02.970 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:02.968990+0000 2026-02-25T15:13:02.970 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:02.971 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:02.971 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:02.971 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:02.971 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:02.971 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:02.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.968+0000 7f6e8a13a640 1 Processor -- start 2026-02-25T15:13:02.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.968+0000 7f6e8a13a640 1 -- start start 2026-02-25T15:13:02.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.968+0000 7f6e8a13a640 10 monclient: init 2026-02-25T15:13:02.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:02.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:02.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 10 monclient(hunting): picked mon.noname-b con 0x7f6e84157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 10 monclient(hunting): picked mon.noname-c con 0x7f6e84157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 10 monclient(hunting): picked mon.noname-a con 0x7f6e84164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8405de70 con 0x7f6e84164d00 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e84055b20 con 0x7f6e84157780 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e84055e00 con 0x7f6e84157b50 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e8a13a640 10 monclient(hunting): authenticate will time out at 3352.558085s 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e83fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6e84164d00 0x7f6e841c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:53106/0 (socket says 10.20.193.78:53106) 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.969+0000 7f6e83fff640 1 -- 10.20.193.78:0/473502532 learned_addr learned my addr 10.20.193.78:0/473502532 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098392807 0 0) 0x7f6e8405de70 con 0x7f6e84164d00 2026-02-25T15:13:02.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 10 monclient(hunting): my global_id is 4347 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e68003610 con 0x7f6e84164d00 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071133326 0 0) 0x7f6e84055e00 con 0x7f6e84157b50 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 10 monclient(hunting): my global_id is 4340 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.970+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8405de70 con 0x7f6e84157b50 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.971+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733918391 0 0) 0x7f6e84055b20 con 0x7f6e84157780 2026-02-25T15:13:02.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.971+0000 7f6e827fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:02.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.971+0000 7f6e827fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:02.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.971+0000 7f6e827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:02.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.971+0000 7f6e827fc640 10 monclient(hunting): my global_id is 4366 2026-02-25T15:13:02.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.971+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e84055e00 con 0x7f6e84157780 2026-02-25T15:13:02.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3580091723 0 0) 0x7f6e68003610 con 0x7f6e84164d00 2026-02-25T15:13:02.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 >> v1:10.20.193.167:6789/0 conn(0x7f6e84157b50 legacy=0x7f6e841645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 >> v1:10.20.193.155:6789/0 conn(0x7f6e84157780 legacy=0x7f6e84056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 1 monclient: found mon.noname-a 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e840560e0 con 0x7f6e84164d00 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e78003170 con 0x7f6e84164d00 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:02.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e827fc640 10 monclient: dump: 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:02.983 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e8a13a640 5 monclient: authenticate success, global_id 4347 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.972+0000 7f6e8a13a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e78003340 con 0x7f6e84164d00 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e827fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e827fc640 1 -- 10.20.193.78:0/473502532 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e78003780 con 0x7f6e84164d00 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e827fc640 10 monclient: dump: 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.984 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 4 set_mon_vals no callback set 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 10 monclient: shutdown 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 1 -- 10.20.193.78:0/473502532 >> v1:10.20.193.78:6789/0 conn(0x7f6e84164d00 legacy=0x7f6e841c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 1 -- 10.20.193.78:0/473502532 shutdown_connections 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 1 -- 10.20.193.78:0/473502532 >> 10.20.193.78:0/473502532 conn(0x7f6e840b2ef0 msgr2=0x7f6e840b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 1 -- 10.20.193.78:0/473502532 shutdown_connections 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.973+0000 7f6e8a13a640 1 -- 10.20.193.78:0/473502532 wait complete. 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient: build_initial_monmap 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient: monmap: 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:02.986 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 librados: starting msgr at 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 librados: starting objecter 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 Processor -- start 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 -- start start 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 librados: setting wanted keys 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 librados: calling monclient init 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient: init 2026-02-25T15:13:02.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient(hunting): picked mon.noname-b con 0x7f6e84157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient(hunting): picked mon.noname-a con 0x7f6e84157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient(hunting): picked mon.noname-c con 0x7f6e84164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8413c220 con 0x7f6e84157b50 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8413c500 con 0x7f6e84157780 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8413c7e0 con 0x7f6e84164d00 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.974+0000 7f6e8a13a640 10 monclient(hunting): authenticate will time out at 3352.563926s 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.975+0000 7f6e82ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6e84157b50 0x7f6e8413b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:53112/0 (socket says 10.20.193.78:53112) 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.975+0000 7f6e82ffd640 1 -- 10.20.193.78:0/3213534710 learned_addr learned my addr 10.20.193.78:0/3213534710 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:02.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.975+0000 7f6e5ffff640 10 client.?.objecter ms_handle_connect 0x7f6e84157b50 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.975+0000 7f6e5ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.975+0000 7f6e5ffff640 10 client.?.objecter ms_handle_connect 0x7f6e84164d00 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.975+0000 7f6e5ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.975+0000 7f6e5ffff640 10 client.?.objecter ms_handle_connect 0x7f6e84157780 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.975+0000 7f6e5ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354036510 0 0) 0x7f6e8413c220 con 0x7f6e84157b50 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): my global_id is 4350 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e54003610 con 0x7f6e84157b50 2026-02-25T15:13:02.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612576114 0 0) 0x7f6e8413c500 con 0x7f6e84157780 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): my global_id is 4369 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8413c220 con 0x7f6e84157780 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775468643 0 0) 0x7f6e8413c7e0 con 0x7f6e84164d00 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 10 monclient(hunting): my global_id is 4343 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.976+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8413c500 con 0x7f6e84164d00 2026-02-25T15:13:02.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.978+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3879032940 0 0) 0x7f6e54003610 con 0x7f6e84157b50 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.978+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e8413c7e0 con 0x7f6e84157b50 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.978+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e74003190 con 0x7f6e84157b50 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.978+0000 7f6e5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.978+0000 7f6e5ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.978+0000 7f6e5ffff640 10 monclient(hunting): dump: 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:02.991 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.978+0000 7f6e5ffff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1044991794 0 0) 0x7f6e8413c500 con 0x7f6e84164d00 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e54003610 con 0x7f6e84164d00 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e78003690 con 0x7f6e84164d00 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 10 monclient(hunting): dump: 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:02.992 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2559842059 0 0) 0x7f6e8413c220 con 0x7f6e84157780 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e8413c500 con 0x7f6e84157780 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e70003060 con 0x7f6e84157780 2026-02-25T15:13:02.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.979+0000 7f6e5ffff640 10 monclient(hunting): dump: 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:02.994 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:02.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3791179897 0 0) 0x7f6e8413c7e0 con 0x7f6e84157b50 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 >> v1:10.20.193.167:6789/0 conn(0x7f6e84164d00 legacy=0x7f6e840aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 >> v1:10.20.193.155:6789/0 conn(0x7f6e84157780 legacy=0x7f6e841496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 1 monclient: found mon.a 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8413cac0 con 0x7f6e84157b50 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 10 monclient: _finish_auth 0 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:02.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e5ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 5 monclient: authenticate success, global_id 4350 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 10 monclient: _renew_subs 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8413cda0 con 0x7f6e84157b50 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 10 client.4350.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 10 monclient: _renew_subs 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e84149f90 con 0x7f6e84157b50 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 1 librados: init done 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.980+0000 7f6e8a13a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.981+0000 7f6e8a13a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.981+0000 7f6e8a13a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:02.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:02.981+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e84165740 con 0x7f6e84157b50 2026-02-25T15:13:03.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.071+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e740034e0 con 0x7f6e84157b50 2026-02-25T15:13:03.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.071+0000 7f6e5ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:03.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.071+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e74003b50 con 0x7f6e84157b50 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.071+0000 7f6e5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.071+0000 7f6e5ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.071+0000 7f6e81ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.071+0000 7f6e5ffff640 10 monclient: dump: 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.074 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.075 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.075 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.072+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6e74003d30 con 0x7f6e84157b50 2026-02-25T15:13:03.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.072+0000 7f6e837fe640 10 monclient: get_auth_request con 0x7f6e54077dd0 auth_method 0 2026-02-25T15:13:03.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.072+0000 7f6e5ffff640 10 client.4350.objecter ms_handle_connect 0x7f6e54077dd0 2026-02-25T15:13:03.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.074+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f6e74093270 con 0x7f6e84157b50 2026-02-25T15:13:03.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.074+0000 7f6e5ffff640 10 client.4350.objecter ms_dispatch2 0x7f6e84000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:03.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.074+0000 7f6e5ffff640 3 client.4350.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:03.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.074+0000 7f6e5ffff640 3 client.4350.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:03.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.074+0000 7f6e5ffff640 20 client.4350.objecter dump_active .. 0 homeless 2026-02-25T15:13:03.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.074+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6e84165740 con 0x7f6e84157b50 2026-02-25T15:13:03.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.074+0000 7f6e5ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:03.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.074+0000 7f6e5ffff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:03.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.181+0000 7f6e8a13a640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-25T15:13:03.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.181+0000 7f6e8a13a640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-25T15:13:03.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.181+0000 7f6e8a13a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.181+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6e8405e250 con 0x7f6e84157b50 2026-02-25T15:13:03.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.187+0000 7f6e5ffff640 1 -- 10.20.193.78:0/3213534710 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7f6e8405e250 con 0x7f6e84157b50 2026-02-25T15:13:03.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.187+0000 7f6e5ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-25T15:13:03.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.187+0000 7f6e5ffff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:03.189 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:13:03.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 10 librados: watch_flush enter 2026-02-25T15:13:03.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 10 librados: watch_flush exit 2026-02-25T15:13:03.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 20 client.4350.objecter shutdown clearing up homeless session... 2026-02-25T15:13:03.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 10 client.4350.objecter successfully canceled tick 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6e54077dd0 legacy=0x7f6e54098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 10 monclient: shutdown 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 >> v1:10.20.193.78:6789/0 conn(0x7f6e84157b50 legacy=0x7f6e8413b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 shutdown_connections 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 >> 10.20.193.78:0/3213534710 conn(0x7f6e840b2ef0 msgr2=0x7f6e8405b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 shutdown_connections 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 1 -- 10.20.193.78:0/3213534710 wait complete. 2026-02-25T15:13:03.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.188+0000 7f6e8a13a640 1 librados: shutdown 2026-02-25T15:13:03.199 INFO:teuthology.orchestra.run.trial078.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-25T15:13:03.199 INFO:tasks.ceph_manager:config epoch is 1 2026-02-25T15:13:03.199 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-25T15:13:03.199 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-25T15:13:03.200 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-25T15:13:03.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.265+0000 7ff6a294c640 10 monclient: get_monmap_and_config 2026-02-25T15:13:03.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.265+0000 7ff6a294c640 10 monclient: build_initial_monmap 2026-02-25T15:13:03.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.265+0000 7ff6a294c640 10 monclient: monmap: 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:03.266212+0000 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:03.266212+0000 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.265+0000 7ff6a294c640 1 Processor -- start 2026-02-25T15:13:03.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.265+0000 7ff6a294c640 1 -- start start 2026-02-25T15:13:03.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.265+0000 7ff6a294c640 10 monclient: init 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 10 monclient(hunting): picked mon.noname-b con 0x7ff69c058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 10 monclient(hunting): picked mon.noname-a con 0x7ff69c0b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 10 monclient(hunting): picked mon.noname-c con 0x7ff69c1626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c1655c0 con 0x7ff69c0b0410 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c0b12b0 con 0x7ff69c058da0 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c0b1590 con 0x7ff69c1626a0 2026-02-25T15:13:03.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff6a294c640 10 monclient(hunting): authenticate will time out at 3352.855281s 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff69b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff69c0b0410 0x7ff69c164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36772/0 (socket says 10.20.193.78:36772) 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.266+0000 7ff69b7fe640 1 -- 10.20.193.78:0/3525321864 learned_addr learned my addr 10.20.193.78:0/3525321864 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282840054 0 0) 0x7ff69c0b1590 con 0x7ff69c1626a0 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): my global_id is 4346 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff680003610 con 0x7ff69c1626a0 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116936469 0 0) 0x7ff69c1655c0 con 0x7ff69c0b0410 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): my global_id is 4353 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69c0b1590 con 0x7ff69c0b0410 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699365255 0 0) 0x7ff69c0b12b0 con 0x7ff69c058da0 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 10 monclient(hunting): my global_id is 4372 2026-02-25T15:13:03.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.268+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69c1655c0 con 0x7ff69c058da0 2026-02-25T15:13:03.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3943494219 0 0) 0x7ff680003610 con 0x7ff69c1626a0 2026-02-25T15:13:03.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 >> v1:10.20.193.155:6789/0 conn(0x7ff69c058da0 legacy=0x7ff69c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 >> v1:10.20.193.78:6789/0 conn(0x7ff69c0b0410 legacy=0x7ff69c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:03.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 1 monclient: found mon.noname-c 2026-02-25T15:13:03.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c0b1870 con 0x7ff69c1626a0 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 10 monclient: _finish_auth 0 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff690003170 con 0x7ff69c1626a0 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff69affd640 10 monclient: dump: 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.280 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.281 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.281 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.281 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.281 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.281 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.281 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.282 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.282 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff6a294c640 5 monclient: authenticate success, global_id 4346 2026-02-25T15:13:03.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.270+0000 7ff6a294c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:03.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff690003340 con 0x7ff69c1626a0 2026-02-25T15:13:03.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff69affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:03.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff69affd640 1 -- 10.20.193.78:0/3525321864 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff690003780 con 0x7ff69c1626a0 2026-02-25T15:13:03.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff69affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:03.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff69affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:03.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff69affd640 10 monclient: dump: 2026-02-25T15:13:03.283 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.283 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.284 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.284 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.284 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.284 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.284 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.284 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 4 set_mon_vals no callback set 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 10 monclient: shutdown 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 1 -- 10.20.193.78:0/3525321864 >> v1:10.20.193.167:6789/0 conn(0x7ff69c1626a0 legacy=0x7ff69c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 1 -- 10.20.193.78:0/3525321864 shutdown_connections 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 1 -- 10.20.193.78:0/3525321864 >> 10.20.193.78:0/3525321864 conn(0x7ff69c0b65f0 msgr2=0x7ff69c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:03.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 1 -- 10.20.193.78:0/3525321864 shutdown_connections 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 1 -- 10.20.193.78:0/3525321864 wait complete. 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 10 monclient: build_initial_monmap 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.271+0000 7ff6a294c640 10 monclient: monmap: 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:03.286 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 librados: starting msgr at 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 librados: starting objecter 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 Processor -- start 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 -- start start 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 librados: setting wanted keys 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 librados: calling monclient init 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 10 monclient: init 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 10 monclient(hunting): picked mon.noname-a con 0x7ff69c058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:03.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 10 monclient(hunting): picked mon.noname-b con 0x7ff69c0b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 10 monclient(hunting): picked mon.noname-c con 0x7ff69c1626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c1417f0 con 0x7ff69c058da0 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c136e10 con 0x7ff69c0b0410 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c1370f0 con 0x7ff69c1626a0 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff6a294c640 10 monclient(hunting): authenticate will time out at 3352.861512s 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff69bfff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff69c058da0 0x7ff69c0af890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36788/0 (socket says 10.20.193.78:36788) 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.272+0000 7ff69bfff640 1 -- 10.20.193.78:0/666666108 learned_addr learned my addr 10.20.193.78:0/666666108 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.273+0000 7ff698ff9640 10 client.?.objecter ms_handle_connect 0x7ff69c058da0 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.273+0000 7ff698ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.273+0000 7ff698ff9640 10 client.?.objecter ms_handle_connect 0x7ff69c1626a0 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.273+0000 7ff698ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:03.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.273+0000 7ff698ff9640 10 client.?.objecter ms_handle_connect 0x7ff69c0b0410 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.273+0000 7ff698ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.273+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176992863 0 0) 0x7ff69c1417f0 con 0x7ff69c058da0 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): my global_id is 4356 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff66c003610 con 0x7ff69c058da0 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114343944 0 0) 0x7ff69c1370f0 con 0x7ff69c1626a0 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): my global_id is 4349 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69c1417f0 con 0x7ff69c1626a0 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429123139 0 0) 0x7ff69c136e10 con 0x7ff69c0b0410 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 10 monclient(hunting): my global_id is 4375 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.274+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69c1370f0 con 0x7ff69c0b0410 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3171260567 0 0) 0x7ff66c003610 con 0x7ff69c058da0 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff69c136e10 con 0x7ff69c058da0 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff688003170 con 0x7ff69c058da0 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:03.290 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 667163634 0 0) 0x7ff69c1417f0 con 0x7ff69c1626a0 2026-02-25T15:13:03.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff66c003610 con 0x7ff69c1626a0 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff6900034f0 con 0x7ff69c1626a0 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.292 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3027298637 0 0) 0x7ff69c1370f0 con 0x7ff69c0b0410 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff69c1417f0 con 0x7ff69c0b0410 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff68c003030 con 0x7ff69c0b0410 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.276+0000 7ff698ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.293 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.294 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.294 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.294 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.294 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3931153232 0 0) 0x7ff69c136e10 con 0x7ff69c058da0 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 >> v1:10.20.193.167:6789/0 conn(0x7ff69c1626a0 legacy=0x7ff69c14a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 >> v1:10.20.193.155:6789/0 conn(0x7ff69c0b0410 legacy=0x7ff69c0ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 1 monclient: found mon.a 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1373d0 con 0x7ff69c058da0 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 10 monclient: _finish_auth 0 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff698ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:03.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 5 monclient: authenticate success, global_id 4356 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 10 monclient: _renew_subs 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c1376b0 con 0x7ff69c058da0 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 10 client.4356.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 10 monclient: _renew_subs 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff69c136a90 con 0x7ff69c058da0 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 1 librados: init done 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.278+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c05a000 con 0x7ff69c058da0 2026-02-25T15:13:03.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.372+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff688003310 con 0x7ff69c058da0 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.372+0000 7ff698ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.372+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff688003b50 con 0x7ff69c058da0 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.372+0000 7ff698ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.372+0000 7ff698ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.372+0000 7ff69a7fc640 4 set_mon_vals no callback set 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.372+0000 7ff698ff9640 10 monclient: dump: 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.375 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.376 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.376 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.376 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.376 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.376 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.376 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.376 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.373+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7ff688003d30 con 0x7ff69c058da0 2026-02-25T15:13:03.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.373+0000 7ff69b7fe640 10 monclient: get_auth_request con 0x7ff66c077f20 auth_method 0 2026-02-25T15:13:03.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.373+0000 7ff698ff9640 10 client.4356.objecter ms_handle_connect 0x7ff66c077f20 2026-02-25T15:13:03.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.376+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7ff688093260 con 0x7ff69c058da0 2026-02-25T15:13:03.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.376+0000 7ff698ff9640 10 client.4356.objecter ms_dispatch2 0x7ff69c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:03.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.376+0000 7ff698ff9640 3 client.4356.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:03.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.376+0000 7ff698ff9640 3 client.4356.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:03.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.376+0000 7ff698ff9640 20 client.4356.objecter dump_active .. 0 homeless 2026-02-25T15:13:03.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.376+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff68805dc90 con 0x7ff69c058da0 2026-02-25T15:13:03.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.376+0000 7ff698ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:03.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.376+0000 7ff698ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:03.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.510+0000 7ff6a294c640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-25T15:13:03.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.510+0000 7ff6a294c640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-25T15:13:03.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.510+0000 7ff6a294c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.510+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff69c059d20 con 0x7ff69c058da0 2026-02-25T15:13:03.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.553+0000 7ff698ff9640 1 -- 10.20.193.78:0/666666108 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193213 (unknown 481731318 0 371826021) 0x7ff688003b50 con 0x7ff69c058da0 2026-02-25T15:13:03.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.553+0000 7ff698ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-25T15:13:03.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.553+0000 7ff698ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:03.557 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:13:03.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 10 librados: watch_flush enter 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 10 librados: watch_flush exit 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 20 client.4356.objecter shutdown clearing up homeless session... 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 10 client.4356.objecter successfully canceled tick 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 >> v1:10.20.193.78:6800/3497602169 conn(0x7ff66c077f20 legacy=0x7ff66c0983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 10 monclient: shutdown 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 >> v1:10.20.193.78:6789/0 conn(0x7ff69c058da0 legacy=0x7ff69c0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 shutdown_connections 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 >> 10.20.193.78:0/666666108 conn(0x7ff69c0b65f0 msgr2=0x7ff69c0559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 shutdown_connections 2026-02-25T15:13:03.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 1 -- 10.20.193.78:0/666666108 wait complete. 2026-02-25T15:13:03.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.554+0000 7ff6a294c640 1 librados: shutdown 2026-02-25T15:13:03.565 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6800","nonce":3497602169}]},"active_addr":"10.20.193.78:6800/3497602169","active_change":"2026-02-25T15:12:20.622459+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":2493596545}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":2447291917}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":1645789793}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":2760544468}]}]} 2026-02-25T15:13:03.571 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-25T15:13:03.571 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-25T15:13:03.572 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.671+0000 7f56d9082640 10 monclient: get_monmap_and_config 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.671+0000 7f56d9082640 10 monclient: build_initial_monmap 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.671+0000 7f56d9082640 10 monclient: monmap: 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:03.672534+0000 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:03.672534+0000 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:03.674 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.675 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:03.675 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:03.675 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:03.675 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 1 Processor -- start 2026-02-25T15:13:03.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 1 -- start start 2026-02-25T15:13:03.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 10 monclient: init 2026-02-25T15:13:03.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:03.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 10 monclient(hunting): picked mon.noname-b con 0x7f56d4058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 10 monclient(hunting): picked mon.noname-c con 0x7f56d40b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 10 monclient(hunting): picked mon.noname-a con 0x7f56d41626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d41655c0 con 0x7f56d41626a0 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d40b12b0 con 0x7f56d4058da0 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d40b1590 con 0x7f56d40b0410 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.672+0000 7f56d9082640 10 monclient(hunting): authenticate will time out at 3353.261638s 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.673+0000 7f56d3577640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f56d41626a0 0x7f56d41c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36792/0 (socket says 10.20.193.78:36792) 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.673+0000 7f56d3577640 1 -- 10.20.193.78:0/1545978529 learned_addr learned my addr 10.20.193.78:0/1545978529 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:03.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507111709 0 0) 0x7f56d41655c0 con 0x7f56d41626a0 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 10 monclient(hunting): my global_id is 4359 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56c0003610 con 0x7f56d41626a0 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987548543 0 0) 0x7f56d40b1590 con 0x7f56d40b0410 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 10 monclient(hunting): my global_id is 4352 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.674+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d41655c0 con 0x7f56d40b0410 2026-02-25T15:13:03.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.675+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759301225 0 0) 0x7f56d40b12b0 con 0x7f56d4058da0 2026-02-25T15:13:03.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.675+0000 7f56d1d74640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.675+0000 7f56d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.675+0000 7f56d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.675+0000 7f56d1d74640 10 monclient(hunting): my global_id is 4378 2026-02-25T15:13:03.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.675+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d40b1590 con 0x7f56d4058da0 2026-02-25T15:13:03.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2919808675 0 0) 0x7f56c0003610 con 0x7f56d41626a0 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 >> v1:10.20.193.167:6789/0 conn(0x7f56d40b0410 legacy=0x7f56d4164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 >> v1:10.20.193.155:6789/0 conn(0x7f56d4058da0 legacy=0x7f56d41647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 10 monclient: _finish_hunting 0 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 1 monclient: found mon.noname-a 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d40b1870 con 0x7f56d41626a0 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 10 monclient: _finish_auth 0 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 10 monclient: _check_auth_tickets 2026-02-25T15:13:03.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c4003170 con 0x7f56d41626a0 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d1d74640 10 monclient: dump: 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.688 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d9082640 5 monclient: authenticate success, global_id 4359 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.676+0000 7f56d9082640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56c4003340 con 0x7f56d41626a0 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d1d74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 4 set_mon_vals no callback set 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d1d74640 1 -- 10.20.193.78:0/1545978529 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c4003780 con 0x7f56d41626a0 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d1d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:03.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d1d74640 10 monclient: dump: 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 10 monclient: shutdown 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:03.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 1 -- 10.20.193.78:0/1545978529 >> v1:10.20.193.78:6789/0 conn(0x7f56d41626a0 legacy=0x7f56d41c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 1 -- 10.20.193.78:0/1545978529 shutdown_connections 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 1 -- 10.20.193.78:0/1545978529 >> 10.20.193.78:0/1545978529 conn(0x7f56d40b65f0 msgr2=0x7f56d40b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 1 -- 10.20.193.78:0/1545978529 shutdown_connections 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 1 -- 10.20.193.78:0/1545978529 wait complete. 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 10 monclient: build_initial_monmap 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.677+0000 7f56d9082640 10 monclient: monmap: 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:03.691 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 librados: starting msgr at 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 librados: starting objecter 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 Processor -- start 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 -- start start 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 librados: setting wanted keys 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 librados: calling monclient init 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 10 monclient: init 2026-02-25T15:13:03.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 10 monclient(hunting): picked mon.noname-c con 0x7f56d4058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 10 monclient(hunting): picked mon.noname-b con 0x7f56d40b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 10 monclient(hunting): picked mon.noname-a con 0x7f56d41626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d4138250 con 0x7f56d41626a0 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d41384f0 con 0x7f56d40b0410 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d41387d0 con 0x7f56d4058da0 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.678+0000 7f56d9082640 10 monclient(hunting): authenticate will time out at 3353.267815s 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.679+0000 7f56d3577640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f56d41626a0 0x7f56d41fc620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36808/0 (socket says 10.20.193.78:36808) 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.679+0000 7f56d3577640 1 -- 10.20.193.78:0/4247758277 learned_addr learned my addr 10.20.193.78:0/4247758277 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:03.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.679+0000 7f56b37fe640 10 client.?.objecter ms_handle_connect 0x7f56d41626a0 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.679+0000 7f56b37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.679+0000 7f56b37fe640 10 client.?.objecter ms_handle_connect 0x7f56d4058da0 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.679+0000 7f56b37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.679+0000 7f56b37fe640 10 client.?.objecter ms_handle_connect 0x7f56d40b0410 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.679+0000 7f56b37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590052007 0 0) 0x7f56d4138250 con 0x7f56d41626a0 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): my global_id is 4362 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a0003610 con 0x7f56d41626a0 2026-02-25T15:13:03.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065953654 0 0) 0x7f56d41384f0 con 0x7f56d40b0410 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): my global_id is 4381 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d4138250 con 0x7f56d40b0410 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032048714 0 0) 0x7f56d41387d0 con 0x7f56d4058da0 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 10 monclient(hunting): my global_id is 4355 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.680+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d41384f0 con 0x7f56d4058da0 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 253430859 0 0) 0x7f56a0003610 con 0x7f56d41626a0 2026-02-25T15:13:03.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d41387d0 con 0x7f56d41626a0 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c4003730 con 0x7f56d41626a0 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 10 monclient(hunting): dump: 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.696 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 224712429 0 0) 0x7f56d41384f0 con 0x7f56d4058da0 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56a0003610 con 0x7f56d4058da0 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c8003060 con 0x7f56d4058da0 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.682+0000 7f56b37fe640 10 monclient(hunting): dump: 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.697 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.683+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2289135140 0 0) 0x7f56d4138250 con 0x7f56d40b0410 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.683+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d41384f0 con 0x7f56d40b0410 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.683+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56bc0030b0 con 0x7f56d40b0410 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.683+0000 7f56b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.683+0000 7f56b37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:03.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.683+0000 7f56b37fe640 10 monclient(hunting): dump: 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2652703037 0 0) 0x7f56d41387d0 con 0x7f56d41626a0 2026-02-25T15:13:03.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 >> v1:10.20.193.167:6789/0 conn(0x7f56d4058da0 legacy=0x7f56d413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 >> v1:10.20.193.155:6789/0 conn(0x7f56d40b0410 legacy=0x7f56d4132310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 1 monclient: found mon.a 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d4138ab0 con 0x7f56d41626a0 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 5 monclient: authenticate success, global_id 4362 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 10 monclient: _renew_subs 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56d4138d90 con 0x7f56d41626a0 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 10 client.4362.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 10 monclient: _renew_subs 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56d413ddd0 con 0x7f56d41626a0 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 1 librados: init done 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.684+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d40b6c80 con 0x7f56d41626a0 2026-02-25T15:13:03.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.774+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56c40032f0 con 0x7f56d41626a0 2026-02-25T15:13:03.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.774+0000 7f56b37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:03.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.774+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c4004f00 con 0x7f56d41626a0 2026-02-25T15:13:03.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.774+0000 7f56b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:03.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.774+0000 7f56b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:03.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.774+0000 7f56d1573640 4 set_mon_vals no callback set 2026-02-25T15:13:03.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.774+0000 7f56b37fe640 10 monclient: dump: 2026-02-25T15:13:03.777 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:03.777 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:03.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.775+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f56c401dd70 con 0x7f56d41626a0 2026-02-25T15:13:03.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.775+0000 7f56d2d76640 10 monclient: get_auth_request con 0x7f56a0077f20 auth_method 0 2026-02-25T15:13:03.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.775+0000 7f56b37fe640 10 client.4362.objecter ms_handle_connect 0x7f56a0077f20 2026-02-25T15:13:03.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.779+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f56c40933c0 con 0x7f56d41626a0 2026-02-25T15:13:03.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.779+0000 7f56b37fe640 10 client.4362.objecter ms_dispatch2 0x7f56d4000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:03.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.779+0000 7f56b37fe640 3 client.4362.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:03.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.779+0000 7f56b37fe640 3 client.4362.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:03.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.779+0000 7f56b37fe640 20 client.4362.objecter dump_active .. 0 homeless 2026-02-25T15:13:03.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.779+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f56c405ddf0 con 0x7f56d41626a0 2026-02-25T15:13:03.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.779+0000 7f56b37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:03.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.779+0000 7f56b37fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:03.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.888+0000 7f56d9082640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:13:03.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.888+0000 7f56d9082640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:13:03.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.888+0000 7f56d9082640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:03.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.888+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56d4162190 con 0x7f56d41626a0 2026-02-25T15:13:03.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.931+0000 7f56b37fe640 1 -- 10.20.193.78:0/4247758277 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+20960 (unknown 634195324 0 2502042818) 0x7f56d4162190 con 0x7f56d41626a0 2026-02-25T15:13:03.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.931+0000 7f56b37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:13:03.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.931+0000 7f56b37fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:03.934 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:13:03.935 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":28,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:13:02.681349+0000","last_up_change":"2026-02-25T15:12:51.067937+0000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T15:12:50.860144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T15:12:59.489971+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":28,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":3604255984}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":3604255984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":3604255984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":3604255984}]},"public_addr":"10.20.193.78:6801/3604255984","cluster_addr":"10.20.193.78:6802/3604255984","heartbeat_back_addr":"10.20.193.78:6804/3604255984","heartbeat_front_addr":"10.20.193.78:6803/3604255984","state":["exists","up"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6812","nonce":2301996681}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6813","nonce":2301996681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6815","nonce":2301996681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6814","nonce":2301996681}]},"public_addr":"10.20.193.155:6812/2301996681","cluster_addr":"10.20.193.155:6813/2301996681","heartbeat_back_addr":"10.20.193.155:6815/2301996681","heartbeat_front_addr":"10.20.193.155:6814/2301996681","state":["exists","up"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6808","nonce":3985671893}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6809","nonce":3985671893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6811","nonce":3985671893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6810","nonce":3985671893}]},"public_addr":"10.20.193.167:6808/3985671893","cluster_addr":"10.20.193.167:6809/3985671893","heartbeat_back_addr":"10.20.193.167:6811/3985671893","heartbeat_front_addr":"10.20.193.167:6810/3985671893","state":["exists","up"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6804","nonce":3507256265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6805","nonce":3507256265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6807","nonce":3507256265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6806","nonce":3507256265}]},"public_addr":"10.20.193.174:6804/3507256265","cluster_addr":"10.20.193.174:6805/3507256265","heartbeat_back_addr":"10.20.193.174:6807/3507256265","heartbeat_front_addr":"10.20.193.174:6806/3507256265","state":["exists","up"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":2928350245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":2928350245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2928350245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":2928350245}]},"public_addr":"10.20.193.78:6805/2928350245","cluster_addr":"10.20.193.78:6806/2928350245","heartbeat_back_addr":"10.20.193.78:6808/2928350245","heartbeat_front_addr":"10.20.193.78:6807/2928350245","state":["exists","up"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":3530698425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":3530698425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":3530698425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":3530698425}]},"public_addr":"10.20.193.155:6804/3530698425","cluster_addr":"10.20.193.155:6806/3530698425","heartbeat_back_addr":"10.20.193.155:6808/3530698425","heartbeat_front_addr":"10.20.193.155:6807/3530698425","state":["exists","up"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6812","nonce":762620751}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6813","nonce":762620751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6815","nonce":762620751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6814","nonce":762620751}]},"public_addr":"10.20.193.167:6812/762620751","cluster_addr":"10.20.193.167:6813/762620751","heartbeat_back_addr":"10.20.193.167:6815/762620751","heartbeat_front_addr":"10.20.193.167:6814/762620751","state":["exists","up"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6809","nonce":463709274}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6811","nonce":463709274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6815","nonce":463709274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6813","nonce":463709274}]},"public_addr":"10.20.193.174:6809/463709274","cluster_addr":"10.20.193.174:6811/463709274","heartbeat_back_addr":"10.20.193.174:6815/463709274","heartbeat_front_addr":"10.20.193.174:6813/463709274","state":["exists","up"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":1740746686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":1740746686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":1740746686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":1740746686}]},"public_addr":"10.20.193.78:6810/1740746686","cluster_addr":"10.20.193.78:6812/1740746686","heartbeat_back_addr":"10.20.193.78:6816/1740746686","heartbeat_front_addr":"10.20.193.78:6814/1740746686","state":["exists","up"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6805","nonce":976780597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6809","nonce":976780597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6811","nonce":976780597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6810","nonce":976780597}]},"public_addr":"10.20.193.155:6805/976780597","cluster_addr":"10.20.193.155:6809/976780597","heartbeat_back_addr":"10.20.193.155:6811/976780597","heartbeat_front_addr":"10.20.193.155:6810/976780597","state":["exists","up"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6804","nonce":601461155}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6805","nonce":601461155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6807","nonce":601461155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6806","nonce":601461155}]},"public_addr":"10.20.193.167:6804/601461155","cluster_addr":"10.20.193.167:6805/601461155","heartbeat_back_addr":"10.20.193.167:6807/601461155","heartbeat_front_addr":"10.20.193.167:6806/601461155","state":["exists","up"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6800","nonce":1887691036}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6801","nonce":1887691036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6803","nonce":1887691036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6802","nonce":1887691036}]},"public_addr":"10.20.193.174:6800/1887691036","cluster_addr":"10.20.193.174:6801/1887691036","heartbeat_back_addr":"10.20.193.174:6803/1887691036","heartbeat_front_addr":"10.20.193.174:6802/1887691036","state":["exists","up"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3800864779}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3800864779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":3800864779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":3800864779}]},"public_addr":"10.20.193.78:6809/3800864779","cluster_addr":"10.20.193.78:6811/3800864779","heartbeat_back_addr":"10.20.193.78:6815/3800864779","heartbeat_front_addr":"10.20.193.78:6813/3800864779","state":["exists","up"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6800","nonce":4105183277}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":4105183277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":4105183277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":4105183277}]},"public_addr":"10.20.193.155:6800/4105183277","cluster_addr":"10.20.193.155:6801/4105183277","heartbeat_back_addr":"10.20.193.155:6803/4105183277","heartbeat_front_addr":"10.20.193.155:6802/4105183277","state":["exists","up"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6800","nonce":376081176}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6801","nonce":376081176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6803","nonce":376081176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6802","nonce":376081176}]},"public_addr":"10.20.193.167:6800/376081176","cluster_addr":"10.20.193.167:6801/376081176","heartbeat_back_addr":"10.20.193.167:6803/376081176","heartbeat_front_addr":"10.20.193.167:6802/376081176","state":["exists","up"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6808","nonce":2760611848}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6810","nonce":2760611848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6814","nonce":2760611848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6812","nonce":2760611848}]},"public_addr":"10.20.193.174:6808/2760611848","cluster_addr":"10.20.193.174:6810/2760611848","heartbeat_back_addr":"10.20.193.174:6814/2760611848","heartbeat_front_addr":"10.20.193.174:6812/2760611848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.914877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.866863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.870323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.920826+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.103405+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.622662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.967538+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.005082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.055253+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.755804+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.863220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.094171+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.145637+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.608452+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.864615+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.980094+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:13:03.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 10 librados: watch_flush enter 2026-02-25T15:13:03.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 10 librados: watch_flush exit 2026-02-25T15:13:03.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 20 client.4362.objecter shutdown clearing up homeless session... 2026-02-25T15:13:03.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 10 client.4362.objecter successfully canceled tick 2026-02-25T15:13:03.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 >> v1:10.20.193.78:6800/3497602169 conn(0x7f56a0077f20 legacy=0x7f56a00983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 10 monclient: shutdown 2026-02-25T15:13:03.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:03.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 >> v1:10.20.193.78:6789/0 conn(0x7f56d41626a0 legacy=0x7f56d41fc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:03.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 shutdown_connections 2026-02-25T15:13:03.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 >> 10.20.193.78:0/4247758277 conn(0x7f56d40b65f0 msgr2=0x7f56d4057030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:03.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 shutdown_connections 2026-02-25T15:13:03.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 1 -- 10.20.193.78:0/4247758277 wait complete. 2026-02-25T15:13:03.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:03.934+0000 7f56d9082640 1 librados: shutdown 2026-02-25T15:13:03.946 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-25T15:13:03.947 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T15:13:04.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.014+0000 7fb307fe0640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.014+0000 7fb307fe0640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.014+0000 7fb307fe0640 10 monclient: monmap: 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.015581+0000 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.015581+0000 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.017 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.018 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 1 Processor -- start 2026-02-25T15:13:04.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 1 -- start start 2026-02-25T15:13:04.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 10 monclient: init 2026-02-25T15:13:04.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 10 monclient(hunting): picked mon.noname-c con 0x7fb300058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 10 monclient(hunting): picked mon.noname-b con 0x7fb3000b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 10 monclient(hunting): picked mon.noname-a con 0x7fb3001626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3001655c0 con 0x7fb3001626a0 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3000b12b0 con 0x7fb3000b0410 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3000b1590 con 0x7fb300058da0 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.015+0000 7fb307fe0640 10 monclient(hunting): authenticate will time out at 3353.604693s 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.016+0000 7fb305554640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fb3000b0410 0x7fb300164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57682/0 (socket says 10.20.193.78:57682) 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.016+0000 7fb305554640 1 -- 10.20.193.78:0/389935102 learned_addr learned my addr 10.20.193.78:0/389935102 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194229581 0 0) 0x7fb3001655c0 con 0x7fb3001626a0 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 10 monclient(hunting): my global_id is 4365 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2e8003610 con 0x7fb3001626a0 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076753037 0 0) 0x7fb3000b1590 con 0x7fb300058da0 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 10 monclient(hunting): my global_id is 4358 2026-02-25T15:13:04.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.017+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3001655c0 con 0x7fb300058da0 2026-02-25T15:13:04.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.018+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711932637 0 0) 0x7fb3000b12b0 con 0x7fb3000b0410 2026-02-25T15:13:04.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.018+0000 7fb304d53640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.018+0000 7fb304d53640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.018+0000 7fb304d53640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.018+0000 7fb304d53640 10 monclient(hunting): my global_id is 4384 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.018+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3000b1590 con 0x7fb3000b0410 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3913718571 0 0) 0x7fb2e8003610 con 0x7fb3001626a0 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 >> v1:10.20.193.167:6789/0 conn(0x7fb300058da0 legacy=0x7fb3001647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 >> v1:10.20.193.155:6789/0 conn(0x7fb3000b0410 legacy=0x7fb300164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3000b1870 con 0x7fb3001626a0 2026-02-25T15:13:04.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb2fc003170 con 0x7fb3001626a0 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb304d53640 10 monclient: dump: 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.031 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb307fe0640 5 monclient: authenticate success, global_id 4365 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.019+0000 7fb307fe0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2fc003340 con 0x7fb3001626a0 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb304d53640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb304d53640 1 -- 10.20.193.78:0/389935102 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb2fc003780 con 0x7fb3001626a0 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb304d53640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb304d53640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb304d53640 10 monclient: dump: 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.033 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 4 set_mon_vals no callback set 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 10 monclient: shutdown 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 1 -- 10.20.193.78:0/389935102 >> v1:10.20.193.78:6789/0 conn(0x7fb3001626a0 legacy=0x7fb3001c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 1 -- 10.20.193.78:0/389935102 shutdown_connections 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 1 -- 10.20.193.78:0/389935102 >> 10.20.193.78:0/389935102 conn(0x7fb3000b65f0 msgr2=0x7fb3000b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 1 -- 10.20.193.78:0/389935102 shutdown_connections 2026-02-25T15:13:04.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.020+0000 7fb307fe0640 1 -- 10.20.193.78:0/389935102 wait complete. 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 10 monclient: monmap: 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.035 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 1 librados: starting msgr at 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 1 librados: starting objecter 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 1 Processor -- start 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 1 -- start start 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 1 librados: setting wanted keys 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 1 librados: calling monclient init 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.021+0000 7fb307fe0640 10 monclient: init 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 10 monclient(hunting): picked mon.noname-b con 0x7fb300058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 10 monclient(hunting): picked mon.noname-a con 0x7fb3000b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 10 monclient(hunting): picked mon.noname-c con 0x7fb3001626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb300161210 con 0x7fb3000b0410 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30013d4c0 con 0x7fb300058da0 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30013d7a0 con 0x7fb3001626a0 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb307fe0640 10 monclient(hunting): authenticate will time out at 3353.611078s 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb305554640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb3000b0410 0x7fb30013a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36830/0 (socket says 10.20.193.78:36830) 2026-02-25T15:13:04.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb305554640 1 -- 10.20.193.78:0/1821562659 learned_addr learned my addr 10.20.193.78:0/1821562659 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb2ee7fc640 10 client.?.objecter ms_handle_connect 0x7fb3000b0410 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb2ee7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb2ee7fc640 10 client.?.objecter ms_handle_connect 0x7fb3001626a0 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.022+0000 7fb2ee7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.023+0000 7fb2ee7fc640 10 client.?.objecter ms_handle_connect 0x7fb300058da0 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.023+0000 7fb2ee7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.023+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016829103 0 0) 0x7fb300161210 con 0x7fb3000b0410 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.023+0000 7fb2ee7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.023+0000 7fb2ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.023+0000 7fb2ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.023+0000 7fb2ee7fc640 10 monclient(hunting): my global_id is 4368 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.023+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d0003610 con 0x7fb3000b0410 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013371405 0 0) 0x7fb30013d7a0 con 0x7fb3001626a0 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 10 monclient(hunting): my global_id is 4361 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb300161210 con 0x7fb3001626a0 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324363294 0 0) 0x7fb30013d4c0 con 0x7fb300058da0 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 10 monclient(hunting): my global_id is 4387 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.024+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb30013d7a0 con 0x7fb300058da0 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3197238636 0 0) 0x7fb300161210 con 0x7fb3001626a0 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb30013d4c0 con 0x7fb3001626a0 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb2fc0034f0 con 0x7fb3001626a0 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 10 monclient(hunting): dump: 2026-02-25T15:13:04.040 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3460409381 0 0) 0x7fb30013d7a0 con 0x7fb300058da0 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb300161210 con 0x7fb300058da0 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb2f0003070 con 0x7fb300058da0 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.026+0000 7fb2ee7fc640 10 monclient(hunting): dump: 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.042 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.027+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3136294118 0 0) 0x7fb2d0003610 con 0x7fb3000b0410 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.027+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb30013d7a0 con 0x7fb3000b0410 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.027+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb2f4003060 con 0x7fb3000b0410 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.027+0000 7fb2ee7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.027+0000 7fb2ee7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.027+0000 7fb2ee7fc640 10 monclient(hunting): dump: 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.044 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1031025716 0 0) 0x7fb300161210 con 0x7fb300058da0 2026-02-25T15:13:04.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 >> v1:10.20.193.167:6789/0 conn(0x7fb3001626a0 legacy=0x7fb3000af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 >> v1:10.20.193.78:6789/0 conn(0x7fb3000b0410 legacy=0x7fb30013a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 1 monclient: found mon.b 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30013da80 con 0x7fb300058da0 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb2ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 5 monclient: authenticate success, global_id 4387 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 10 monclient: _renew_subs 2026-02-25T15:13:04.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb30013dd60 con 0x7fb300058da0 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 10 client.4387.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 10 monclient: _renew_subs 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb300117740 con 0x7fb300058da0 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 1 librados: init done 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.028+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb300139da0 con 0x7fb300058da0 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.123+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2f00034c0 con 0x7fb300058da0 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.123+0000 7fb2ee7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.123+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb2f00038d0 con 0x7fb300058da0 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.123+0000 7fb2ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.123+0000 7fb2ee7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.123+0000 7fb2ee7fc640 10 monclient: dump: 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.125 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.126 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.126 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.126 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.126 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.126 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.126 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.126 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.123+0000 7fb2effff640 4 set_mon_vals no callback set 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.123+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fb2f0003ab0 con 0x7fb300058da0 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.124+0000 7fb305554640 10 monclient: get_auth_request con 0x7fb2d0077ec0 auth_method 0 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.124+0000 7fb2ee7fc640 10 client.4387.objecter ms_handle_connect 0x7fb2d0077ec0 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.124+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fb2f0091f60 con 0x7fb300058da0 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.124+0000 7fb2ee7fc640 10 client.4387.objecter ms_dispatch2 0x7fb300000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.124+0000 7fb2ee7fc640 3 client.4387.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.124+0000 7fb2ee7fc640 3 client.4387.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.124+0000 7fb2ee7fc640 20 client.4387.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.125+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb2f00038d0 con 0x7fb300058da0 2026-02-25T15:13:04.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.125+0000 7fb2ee7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.125+0000 7fb2ee7fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:04.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.228+0000 7fb307fe0640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:13:04.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.229+0000 7fb307fe0640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:13:04.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.229+0000 7fb307fe0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.229+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3000b27f0 con 0x7fb300058da0 2026-02-25T15:13:04.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb2ee7fc640 1 -- 10.20.193.78:0/1821562659 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+20960 (unknown 634195324 0 2502042818) 0x7fb2f005c990 con 0x7fb300058da0 2026-02-25T15:13:04.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb2ee7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:13:04.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb2ee7fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:04.247 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:13:04.247 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":28,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:13:02.681349+0000","last_up_change":"2026-02-25T15:12:51.067937+0000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T15:12:50.860144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T15:12:59.489971+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":28,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":3604255984}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":3604255984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":3604255984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":3604255984}]},"public_addr":"10.20.193.78:6801/3604255984","cluster_addr":"10.20.193.78:6802/3604255984","heartbeat_back_addr":"10.20.193.78:6804/3604255984","heartbeat_front_addr":"10.20.193.78:6803/3604255984","state":["exists","up"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6812","nonce":2301996681}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6813","nonce":2301996681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6815","nonce":2301996681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6814","nonce":2301996681}]},"public_addr":"10.20.193.155:6812/2301996681","cluster_addr":"10.20.193.155:6813/2301996681","heartbeat_back_addr":"10.20.193.155:6815/2301996681","heartbeat_front_addr":"10.20.193.155:6814/2301996681","state":["exists","up"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6808","nonce":3985671893}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6809","nonce":3985671893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6811","nonce":3985671893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6810","nonce":3985671893}]},"public_addr":"10.20.193.167:6808/3985671893","cluster_addr":"10.20.193.167:6809/3985671893","heartbeat_back_addr":"10.20.193.167:6811/3985671893","heartbeat_front_addr":"10.20.193.167:6810/3985671893","state":["exists","up"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6804","nonce":3507256265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6805","nonce":3507256265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6807","nonce":3507256265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6806","nonce":3507256265}]},"public_addr":"10.20.193.174:6804/3507256265","cluster_addr":"10.20.193.174:6805/3507256265","heartbeat_back_addr":"10.20.193.174:6807/3507256265","heartbeat_front_addr":"10.20.193.174:6806/3507256265","state":["exists","up"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":2928350245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":2928350245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2928350245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":2928350245}]},"public_addr":"10.20.193.78:6805/2928350245","cluster_addr":"10.20.193.78:6806/2928350245","heartbeat_back_addr":"10.20.193.78:6808/2928350245","heartbeat_front_addr":"10.20.193.78:6807/2928350245","state":["exists","up"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":3530698425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":3530698425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":3530698425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":3530698425}]},"public_addr":"10.20.193.155:6804/3530698425","cluster_addr":"10.20.193.155:6806/3530698425","heartbeat_back_addr":"10.20.193.155:6808/3530698425","heartbeat_front_addr":"10.20.193.155:6807/3530698425","state":["exists","up"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6812","nonce":762620751}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6813","nonce":762620751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6815","nonce":762620751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6814","nonce":762620751}]},"public_addr":"10.20.193.167:6812/762620751","cluster_addr":"10.20.193.167:6813/762620751","heartbeat_back_addr":"10.20.193.167:6815/762620751","heartbeat_front_addr":"10.20.193.167:6814/762620751","state":["exists","up"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6809","nonce":463709274}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6811","nonce":463709274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6815","nonce":463709274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6813","nonce":463709274}]},"public_addr":"10.20.193.174:6809/463709274","cluster_addr":"10.20.193.174:6811/463709274","heartbeat_back_addr":"10.20.193.174:6815/463709274","heartbeat_front_addr":"10.20.193.174:6813/463709274","state":["exists","up"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":1740746686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":1740746686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":1740746686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":1740746686}]},"public_addr":"10.20.193.78:6810/1740746686","cluster_addr":"10.20.193.78:6812/1740746686","heartbeat_back_addr":"10.20.193.78:6816/1740746686","heartbeat_front_addr":"10.20.193.78:6814/1740746686","state":["exists","up"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6805","nonce":976780597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6809","nonce":976780597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6811","nonce":976780597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6810","nonce":976780597}]},"public_addr":"10.20.193.155:6805/976780597","cluster_addr":"10.20.193.155:6809/976780597","heartbeat_back_addr":"10.20.193.155:6811/976780597","heartbeat_front_addr":"10.20.193.155:6810/976780597","state":["exists","up"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6804","nonce":601461155}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6805","nonce":601461155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6807","nonce":601461155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6806","nonce":601461155}]},"public_addr":"10.20.193.167:6804/601461155","cluster_addr":"10.20.193.167:6805/601461155","heartbeat_back_addr":"10.20.193.167:6807/601461155","heartbeat_front_addr":"10.20.193.167:6806/601461155","state":["exists","up"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6800","nonce":1887691036}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6801","nonce":1887691036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6803","nonce":1887691036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6802","nonce":1887691036}]},"public_addr":"10.20.193.174:6800/1887691036","cluster_addr":"10.20.193.174:6801/1887691036","heartbeat_back_addr":"10.20.193.174:6803/1887691036","heartbeat_front_addr":"10.20.193.174:6802/1887691036","state":["exists","up"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3800864779}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3800864779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":3800864779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":3800864779}]},"public_addr":"10.20.193.78:6809/3800864779","cluster_addr":"10.20.193.78:6811/3800864779","heartbeat_back_addr":"10.20.193.78:6815/3800864779","heartbeat_front_addr":"10.20.193.78:6813/3800864779","state":["exists","up"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6800","nonce":4105183277}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":4105183277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":4105183277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":4105183277}]},"public_addr":"10.20.193.155:6800/4105183277","cluster_addr":"10.20.193.155:6801/4105183277","heartbeat_back_addr":"10.20.193.155:6803/4105183277","heartbeat_front_addr":"10.20.193.155:6802/4105183277","state":["exists","up"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6800","nonce":376081176}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6801","nonce":376081176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6803","nonce":376081176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6802","nonce":376081176}]},"public_addr":"10.20.193.167:6800/376081176","cluster_addr":"10.20.193.167:6801/376081176","heartbeat_back_addr":"10.20.193.167:6803/376081176","heartbeat_front_addr":"10.20.193.167:6802/376081176","state":["exists","up"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6808","nonce":2760611848}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6810","nonce":2760611848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6814","nonce":2760611848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6812","nonce":2760611848}]},"public_addr":"10.20.193.174:6808/2760611848","cluster_addr":"10.20.193.174:6810/2760611848","heartbeat_back_addr":"10.20.193.174:6814/2760611848","heartbeat_front_addr":"10.20.193.174:6812/2760611848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.914877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.866863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.870323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.920826+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.103405+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.622662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.967538+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.005082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.055253+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.755804+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.863220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.094171+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.145637+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.608452+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.864615+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.980094+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:13:04.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 10 librados: watch_flush enter 2026-02-25T15:13:04.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 10 librados: watch_flush exit 2026-02-25T15:13:04.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 20 client.4387.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 10 client.4387.objecter successfully canceled tick 2026-02-25T15:13:04.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 >> v1:10.20.193.78:6800/3497602169 conn(0x7fb2d0077ec0 legacy=0x7fb2d0098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 10 monclient: shutdown 2026-02-25T15:13:04.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 >> v1:10.20.193.155:6789/0 conn(0x7fb300058da0 legacy=0x7fb300160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 shutdown_connections 2026-02-25T15:13:04.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 >> 10.20.193.78:0/1821562659 conn(0x7fb3000b65f0 msgr2=0x7fb300055a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 shutdown_connections 2026-02-25T15:13:04.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.245+0000 7fb307fe0640 1 -- 10.20.193.78:0/1821562659 wait complete. 2026-02-25T15:13:04.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.246+0000 7fb307fe0640 1 librados: shutdown 2026-02-25T15:13:04.258 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-25T15:13:04.259 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-25T15:13:04.259 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-25T15:13:04.260 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-25T15:13:04.260 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-25T15:13:04.261 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-25T15:13:04.261 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-25T15:13:04.262 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-25T15:13:04.262 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-25T15:13:04.263 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-25T15:13:04.263 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-25T15:13:04.264 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-25T15:13:04.264 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-25T15:13:04.265 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-25T15:13:04.265 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-25T15:13:04.266 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-25T15:13:04.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.347+0000 7f20fe383640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.347+0000 7f20fe383640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.347+0000 7f20fe383640 10 monclient: monmap: 2026-02-25T15:13:04.350 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.350 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.350 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.348805+0000 2026-02-25T15:13:04.350 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.348805+0000 2026-02-25T15:13:04.350 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.351 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.351 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.351 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.351 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.351 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f6b8b66e640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f6b8b66e640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f6b8b66e640 10 monclient: monmap: 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.349327+0000 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.349327+0000 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.352 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.353 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.353 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.353 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.353 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f20fe383640 1 Processor -- start 2026-02-25T15:13:04.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f20fe383640 1 -- start start 2026-02-25T15:13:04.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f20fe383640 10 monclient: init 2026-02-25T15:13:04.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f6b8b66e640 1 Processor -- start 2026-02-25T15:13:04.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f6b8b66e640 1 -- start start 2026-02-25T15:13:04.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.348+0000 7f6b8b66e640 10 monclient: init 2026-02-25T15:13:04.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 10 monclient(hunting): picked mon.noname-a con 0x7f20f81566e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 10 monclient(hunting): picked mon.noname-c con 0x7f20f8160c00 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:04.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 10 monclient(hunting): picked mon.noname-b con 0x7f20f8156ab0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f8058480 con 0x7f20f81566e0 2026-02-25T15:13:04.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 10 monclient(hunting): picked mon.noname-c con 0x7f6b840b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f8058760 con 0x7f20f8156ab0 2026-02-25T15:13:04.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 10 monclient(hunting): picked mon.noname-a con 0x7f6b840ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f80b0f90 con 0x7f20f8160c00 2026-02-25T15:13:04.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 10 monclient(hunting): picked mon.noname-b con 0x7f6b840585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f20fe383640 10 monclient(hunting): authenticate will time out at 3353.938659s 2026-02-25T15:13:04.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b84163930 con 0x7f6b840ba350 2026-02-25T15:13:04.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b84163bb0 con 0x7f6b840585e0 2026-02-25T15:13:04.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b84163e90 con 0x7f6b840b9f80 2026-02-25T15:13:04.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.349+0000 7f6b8b66e640 10 monclient(hunting): authenticate will time out at 3353.938722s 2026-02-25T15:13:04.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.350+0000 7f20fc8f9640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f20f8156ab0 0x7f20f8055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57700/0 (socket says 10.20.193.78:57700) 2026-02-25T15:13:04.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.350+0000 7f20fc8f9640 1 -- 10.20.193.78:0/3779530669 learned_addr learned my addr 10.20.193.78:0/3779530669 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.350+0000 7f6b893e3640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f6b840b9f80 0x7f6b84163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50596/0 (socket says 10.20.193.78:50596) 2026-02-25T15:13:04.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.350+0000 7f6b893e3640 1 -- 10.20.193.78:0/2162854843 learned_addr learned my addr 10.20.193.78:0/2162854843 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.350+0000 7f7835613640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.350+0000 7f7835613640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.350+0000 7f7835613640 10 monclient: monmap: 2026-02-25T15:13:04.362 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.362 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.362 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.351612+0000 2026-02-25T15:13:04.363 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.351612+0000 2026-02-25T15:13:04.363 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.363 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.363 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.363 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.363 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.363 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.351+0000 7f7835613640 1 Processor -- start 2026-02-25T15:13:04.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.351+0000 7fe181bd9640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.351+0000 7fe181bd9640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.351+0000 7fe181bd9640 10 monclient: monmap: 2026-02-25T15:13:04.364 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.364 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.364 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.352843+0000 2026-02-25T15:13:04.364 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.352843+0000 2026-02-25T15:13:04.364 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.365 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.365 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.365 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.365 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.365 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802531001 0 0) 0x7f20f8058760 con 0x7f20f8156ab0 2026-02-25T15:13:04.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f20f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f20f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f20f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f20f6ffd640 10 monclient(hunting): my global_id is 4390 2026-02-25T15:13:04.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20dc003610 con 0x7f20f8156ab0 2026-02-25T15:13:04.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.351+0000 7f7835613640 1 -- start start 2026-02-25T15:13:04.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.351+0000 7f7835613640 10 monclient: init 2026-02-25T15:13:04.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399793590 0 0) 0x7f6b84163e90 con 0x7f6b840b9f80 2026-02-25T15:13:04.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 10 monclient(hunting): my global_id is 4364 2026-02-25T15:13:04.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b6c003610 con 0x7f6b840b9f80 2026-02-25T15:13:04.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7fe181bd9640 1 Processor -- start 2026-02-25T15:13:04.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7fe181bd9640 1 -- start start 2026-02-25T15:13:04.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7fe181bd9640 10 monclient: init 2026-02-25T15:13:04.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 10 monclient(hunting): picked mon.noname-c con 0x7f78300b9f30 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 10 monclient(hunting): picked mon.noname-b con 0x7f78300b7110 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 10 monclient(hunting): picked mon.noname-a con 0x7f78300ba300 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78301680a0 con 0x7f78300ba300 2026-02-25T15:13:04.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7830168380 con 0x7f78300b7110 2026-02-25T15:13:04.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78300b5610 con 0x7f78300b9f30 2026-02-25T15:13:04.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f7835613640 10 monclient(hunting): authenticate will time out at 3353.941904s 2026-02-25T15:13:04.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631692660 0 0) 0x7f6b84163bb0 con 0x7f6b840585e0 2026-02-25T15:13:04.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 10 monclient(hunting): my global_id is 4393 2026-02-25T15:13:04.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.352+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b84163e90 con 0x7f6b840585e0 2026-02-25T15:13:04.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414594627 0 0) 0x7f20f80b0f90 con 0x7f20f8160c00 2026-02-25T15:13:04.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f20f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f20f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f20f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f20f6ffd640 10 monclient(hunting): my global_id is 4367 2026-02-25T15:13:04.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f8058760 con 0x7f20f8160c00 2026-02-25T15:13:04.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f782f7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f78300ba300 0x7f78300b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36856/0 (socket says 10.20.193.78:36856) 2026-02-25T15:13:04.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f782f7fe640 1 -- 10.20.193.78:0/1045480571 learned_addr learned my addr 10.20.193.78:0/1045480571 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 10 monclient(hunting): picked mon.noname-a con 0x7fe17c15d3b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 10 monclient(hunting): picked mon.noname-c con 0x7fe17c0b4c30 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 10 monclient(hunting): picked mon.noname-b con 0x7fe17c1a7ac0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17c164640 con 0x7fe17c15d3b0 2026-02-25T15:13:04.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17c0b1530 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17c0b1810 con 0x7fe17c0b4c30 2026-02-25T15:13:04.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7fe181bd9640 10 monclient(hunting): authenticate will time out at 3353.942587s 2026-02-25T15:13:04.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f5a81213640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f5a81213640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f5a81213640 10 monclient: monmap: 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.354562+0000 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.354562+0000 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.377 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.378 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.378 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f7b407c8640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f7b407c8640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.353+0000 7f7b407c8640 10 monclient: monmap: 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.354776+0000 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.354776+0000 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.379 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.380 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.380 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f156d72e640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f156d72e640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f156d72e640 10 monclient: monmap: 2026-02-25T15:13:04.380 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.380 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.381 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.354978+0000 2026-02-25T15:13:04.381 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.354978+0000 2026-02-25T15:13:04.381 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.381 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.381 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.381 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.381 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.381 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f5a81213640 1 Processor -- start 2026-02-25T15:13:04.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f5a81213640 1 -- start start 2026-02-25T15:13:04.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f5a81213640 10 monclient: init 2026-02-25T15:13:04.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282225250 0 0) 0x7f20f8058480 con 0x7f20f81566e0 2026-02-25T15:13:04.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f20f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f20f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f20f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f20f6ffd640 10 monclient(hunting): my global_id is 4374 2026-02-25T15:13:04.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f80b0f90 con 0x7f20f81566e0 2026-02-25T15:13:04.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3608795731 0 0) 0x7f6b6c003610 con 0x7f6b840b9f80 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 >> v1:10.20.193.155:6789/0 conn(0x7f6b840585e0 legacy=0x7f6b84166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 >> v1:10.20.193.78:6789/0 conn(0x7f6b840ba350 legacy=0x7f6b84057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 1 monclient: found mon.noname-c 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b840573f0 con 0x7f6b840b9f80 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6b74002df0 con 0x7f6b840b9f80 2026-02-25T15:13:04.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b73fff640 10 monclient: dump: 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.385 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.386 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f7b407c8640 1 Processor -- start 2026-02-25T15:13:04.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f156d72e640 1 Processor -- start 2026-02-25T15:13:04.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f156d72e640 1 -- start start 2026-02-25T15:13:04.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f156d72e640 10 monclient: init 2026-02-25T15:13:04.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f7b407c8640 1 -- start start 2026-02-25T15:13:04.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f7b407c8640 10 monclient: init 2026-02-25T15:13:04.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b8b66e640 5 monclient: authenticate success, global_id 4364 2026-02-25T15:13:04.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f6b8b66e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f5a81213640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f5a81213640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f5a81213640 10 monclient(hunting): picked mon.noname-b con 0x7f5a7c0b0630 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.354+0000 7f5a81213640 10 monclient(hunting): picked mon.noname-a con 0x7f5a7c0b0a00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f5a81213640 10 monclient(hunting): picked mon.noname-c con 0x7f5a7c15b050 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f5a81213640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c0b4c30 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f5a81213640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c0b4f10 con 0x7f5a7c0b0630 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f5a81213640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c0b51f0 con 0x7f5a7c15b050 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f5a81213640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f5a81213640 10 monclient(hunting): authenticate will time out at 3353.944261s 2026-02-25T15:13:04.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 10 monclient(hunting): picked mon.noname-b con 0x7f7b3815af80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 10 monclient(hunting): picked mon.noname-c con 0x7f7b3815b350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 10 monclient(hunting): picked mon.noname-a con 0x7f7b380b5d80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b38059130 con 0x7f7b380b5d80 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b38059410 con 0x7f7b3815af80 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b380596f0 con 0x7f7b3815b350 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f7b407c8640 10 monclient(hunting): authenticate will time out at 3353.944362s 2026-02-25T15:13:04.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:04.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 10 monclient(hunting): picked mon.noname-c con 0x7f15680b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 10 monclient(hunting): picked mon.noname-a con 0x7f15680ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 10 monclient(hunting): picked mon.noname-b con 0x7f15680585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1568163930 con 0x7f15680ba350 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1568163bb0 con 0x7f15680585e0 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1568163e90 con 0x7f15680b9f80 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.355+0000 7f156d72e640 10 monclient(hunting): authenticate will time out at 3353.944550s 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f7b3ed3e640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7b380b5d80 0x7f7b380b7700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36886/0 (socket says 10.20.193.78:36886) 2026-02-25T15:13:04.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f7b3ed3e640 1 -- 10.20.193.78:0/1337223168 learned_addr learned my addr 10.20.193.78:0/1337223168 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1131267448 0 0) 0x7f20dc003610 con 0x7f20f8156ab0 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 >> v1:10.20.193.167:6789/0 conn(0x7f20f8160c00 legacy=0x7f20f8057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 >> v1:10.20.193.78:6789/0 conn(0x7f20f81566e0 legacy=0x7f20f80b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f80b1270 con 0x7f20f8156ab0 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f20ec003170 con 0x7f20f8156ab0 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849525164 0 0) 0x7f78301680a0 con 0x7f78300ba300 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f782dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f782dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f782dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f782dffb640 10 monclient(hunting): my global_id is 4377 2026-02-25T15:13:04.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f781c003610 con 0x7f78300ba300 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20f6ffd640 10 monclient: dump: 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20fe383640 5 monclient: authenticate success, global_id 4390 2026-02-25T15:13:04.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f20fe383640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f1423624640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f1423624640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.356+0000 7f1423624640 10 monclient: monmap: 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.357826+0000 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.357826+0000 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.357+0000 7fe17affd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fe17c0b4c30 0x7fe17c0af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50612/0 (socket says 10.20.193.78:50612) 2026-02-25T15:13:04.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.357+0000 7fe17affd640 1 -- 10.20.193.78:0/3319269538 learned_addr learned my addr 10.20.193.78:0/3319269538 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.357+0000 7f1423624640 1 Processor -- start 2026-02-25T15:13:04.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.357+0000 7f1423624640 1 -- start start 2026-02-25T15:13:04.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.357+0000 7f1423624640 10 monclient: init 2026-02-25T15:13:04.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.357+0000 7f5a7a575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5a7c0b0a00 0x7f5a7c15a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36882/0 (socket says 10.20.193.78:36882) 2026-02-25T15:13:04.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.357+0000 7f5a7a575640 1 -- 10.20.193.78:0/374978727 learned_addr learned my addr 10.20.193.78:0/374978727 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 10 monclient(hunting): picked mon.noname-b con 0x7f141c0b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 10 monclient(hunting): picked mon.noname-c con 0x7f141c0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 10 monclient(hunting): picked mon.noname-a con 0x7f141c0585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c163930 con 0x7f141c0585e0 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c163bb0 con 0x7f141c0b9f80 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c163e90 con 0x7f141c0ba350 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f1423624640 10 monclient(hunting): authenticate will time out at 3353.947659s 2026-02-25T15:13:04.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20ec003340 con 0x7f20f8156ab0 2026-02-25T15:13:04.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f20f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f20f6ffd640 1 -- 10.20.193.78:0/3779530669 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f20ec003780 con 0x7f20f8156ab0 2026-02-25T15:13:04.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f20f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f20f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f20f6ffd640 10 monclient: dump: 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f20fe383640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.358+0000 7f20fe383640 4 set_mon_vals no callback set 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.359+0000 7f20fe383640 10 monclient: shutdown 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.359+0000 7f20fe383640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.359+0000 7f20fe383640 1 -- 10.20.193.78:0/3779530669 >> v1:10.20.193.155:6789/0 conn(0x7f20f8156ab0 legacy=0x7f20f8055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.359+0000 7f20fe383640 1 -- 10.20.193.78:0/3779530669 shutdown_connections 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.359+0000 7f20fe383640 1 -- 10.20.193.78:0/3779530669 >> 10.20.193.78:0/3779530669 conn(0x7f20f80b2ef0 msgr2=0x7f20f80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.359+0000 7f20fe383640 1 -- 10.20.193.78:0/3779530669 shutdown_connections 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.359+0000 7f20fe383640 1 -- 10.20.193.78:0/3779530669 wait complete. 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 10 monclient: monmap: 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193262121 0 0) 0x7f7830168380 con 0x7f78300b7110 2026-02-25T15:13:04.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f782dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f782dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f782dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f782dffb640 10 monclient(hunting): my global_id is 4396 2026-02-25T15:13:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78301680a0 con 0x7f78300b7110 2026-02-25T15:13:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 1 librados: starting msgr at 2026-02-25T15:13:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 1 librados: starting objecter 2026-02-25T15:13:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fb424e46640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fb424e46640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fb424e46640 10 monclient: monmap: 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.361157+0000 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.361157+0000 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.403 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f15677fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f15680585e0 0x7f1568166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57738/0 (socket says 10.20.193.78:57738) 2026-02-25T15:13:04.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f15677fe640 1 -- 10.20.193.78:0/836460891 learned_addr learned my addr 10.20.193.78:0/836460891 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 1 Processor -- start 2026-02-25T15:13:04.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 1 -- start start 2026-02-25T15:13:04.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 1 librados: setting wanted keys 2026-02-25T15:13:04.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 1 librados: calling monclient init 2026-02-25T15:13:04.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7f20fe383640 10 monclient: init 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fa680c46640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fa680c46640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fa680c46640 10 monclient: monmap: 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.361698+0000 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.361698+0000 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.405 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fb424e46640 1 Processor -- start 2026-02-25T15:13:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fb424e46640 1 -- start start 2026-02-25T15:13:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.360+0000 7fb424e46640 10 monclient: init 2026-02-25T15:13:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 10 monclient(hunting): picked mon.noname-c con 0x7f20f81566e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 10 monclient(hunting): picked mon.noname-b con 0x7f20f8156ab0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b74003000 con 0x7f6b840b9f80 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b73fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b73fff640 1 -- 10.20.193.78:0/2162854843 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6b74003440 con 0x7f6b840b9f80 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b73fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b73fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b73fff640 10 monclient: dump: 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.407 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.408 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.408 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.408 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 10 monclient(hunting): picked mon.noname-a con 0x7f20f8160c00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f80b0360 con 0x7f20f8160c00 2026-02-25T15:13:04.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f815c460 con 0x7f20f8156ab0 2026-02-25T15:13:04.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f815c740 con 0x7f20f81566e0 2026-02-25T15:13:04.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b8b66e640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f20fe383640 10 monclient(hunting): authenticate will time out at 3353.950199s 2026-02-25T15:13:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b8b66e640 4 set_mon_vals no callback set 2026-02-25T15:13:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fa680c46640 1 Processor -- start 2026-02-25T15:13:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fa680c46640 1 -- start start 2026-02-25T15:13:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fa680c46640 10 monclient: init 2026-02-25T15:13:04.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 10 monclient(hunting): picked mon.noname-a con 0x7fb42015d3b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 10 monclient(hunting): picked mon.noname-b con 0x7fb4200b4c30 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 10 monclient(hunting): picked mon.noname-c con 0x7fb4201a7ac0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb420164640 con 0x7fb42015d3b0 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4200b1530 con 0x7fb4200b4c30 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4200b1810 con 0x7fb4201a7ac0 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb424e46640 10 monclient(hunting): authenticate will time out at 3353.950500s 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863597026 0 0) 0x7f78300b5610 con 0x7f78300b9f30 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f782dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f782dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f782dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f782dffb640 10 monclient(hunting): my global_id is 4370 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb237a6a640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb237a6a640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7830168380 con 0x7f78300b9f30 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fb237a6a640 10 monclient: monmap: 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.362485+0000 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.362485+0000 2026-02-25T15:13:04.412 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3189957381 0 0) 0x7f7b380596f0 con 0x7f7b3815b350 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f7b3d53b640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f7b3d53b640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f7b3d53b640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f7b3d53b640 10 monclient(hunting): my global_id is 4379 2026-02-25T15:13:04.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b20003610 con 0x7f7b3815b350 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b8b66e640 10 monclient: shutdown 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b8b66e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7f6b8b66e640 1 -- 10.20.193.78:0/2162854843 >> v1:10.20.193.167:6789/0 conn(0x7f6b840b9f80 legacy=0x7f6b84163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fd807d92640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fd807d92640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fd807d92640 10 monclient: monmap: 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.362733+0000 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.362733+0000 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.414 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f6b8b66e640 1 -- 10.20.193.78:0/2162854843 shutdown_connections 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f6b8b66e640 1 -- 10.20.193.78:0/2162854843 >> 10.20.193.78:0/2162854843 conn(0x7f6b840b7990 msgr2=0x7f6b840b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f6b8b66e640 1 -- 10.20.193.78:0/2162854843 shutdown_connections 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f6b8b66e640 1 -- 10.20.193.78:0/2162854843 wait complete. 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fd807d92640 1 Processor -- start 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fd807d92640 1 -- start start 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fd807d92640 10 monclient: init 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fa680c46640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fa680c46640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.361+0000 7fa680c46640 10 monclient(hunting): picked mon.noname-b con 0x7fa67c0b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fa680c46640 10 monclient(hunting): picked mon.noname-a con 0x7fa67c0ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fa680c46640 10 monclient(hunting): picked mon.noname-c con 0x7fa67c0585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fa680c46640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c163930 con 0x7fa67c0ba350 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fa680c46640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c163bb0 con 0x7fa67c0b9f80 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fa680c46640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c163e90 con 0x7fa67c0585e0 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fa680c46640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fa680c46640 10 monclient(hunting): authenticate will time out at 3353.951056s 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fb237a6a640 1 Processor -- start 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914202224 0 0) 0x7f5a7c0b51f0 con 0x7f5a7c15b050 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f5a79d74640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f5a79d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f5a79d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f5a79d74640 10 monclient(hunting): my global_id is 4376 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a68003610 con 0x7f5a7c15b050 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f9b6b013640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f9b6b013640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f9b6b013640 10 monclient: monmap: 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.363506+0000 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.363506+0000 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.416 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f1420b98640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f141c0ba350 0x7f141c057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50648/0 (socket says 10.20.193.78:50648) 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f1420b98640 1 -- 10.20.193.78:0/4156493515 learned_addr learned my addr 10.20.193.78:0/4156493515 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f6b8b66e640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7f6b8b66e640 10 monclient: monmap: 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fd807d92640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fd807d92640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fd807d92640 10 monclient(hunting): picked mon.noname-a con 0x7fd800157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fd807d92640 10 monclient(hunting): picked mon.noname-c con 0x7fd800157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fd807d92640 10 monclient(hunting): picked mon.noname-b con 0x7fd800164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fd807d92640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd80005de70 con 0x7fd800157780 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fd807d92640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd800055b20 con 0x7fd800164d00 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fd807d92640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd800055e00 con 0x7fd800157b50 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fd807d92640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fd807d92640 10 monclient(hunting): authenticate will time out at 3353.952128s 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fc0a8f02640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fc0a8f02640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fc0a8f02640 10 monclient: monmap: 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.363795+0000 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.363795+0000 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.418 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fb237a6a640 1 -- start start 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.362+0000 7fb237a6a640 10 monclient: init 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 1 librados: starting msgr at 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 1 librados: starting objecter 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 1 Processor -- start 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 1 -- start start 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 1 librados: setting wanted keys 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 1 librados: calling monclient init 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 10 monclient: init 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fc0a8f02640 1 Processor -- start 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 10 monclient(hunting): picked mon.noname-a con 0x7fb230159a70 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 10 monclient(hunting): picked mon.noname-b con 0x7fb230159e40 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 10 monclient(hunting): picked mon.noname-c con 0x7fb230058070 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb230163930 con 0x7fb230159a70 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb230163bf0 con 0x7fb230159e40 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb230163ed0 con 0x7fb230058070 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fb237a6a640 10 monclient(hunting): authenticate will time out at 3353.952392s 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fc0a8f02640 1 -- start start 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7fc0a8f02640 10 monclient: init 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 10 monclient(hunting): picked mon.noname-b con 0x7f6b840585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 10 monclient(hunting): picked mon.noname-a con 0x7f6b840b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f9b6b013640 1 Processor -- start 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.363+0000 7f6b8b66e640 10 monclient(hunting): picked mon.noname-c con 0x7f6b840ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f6b8b66e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b84156bc0 con 0x7f6b840b9f80 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f6b8b66e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b841ff450 con 0x7f6b840585e0 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f6b8b66e640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b841fb140 con 0x7f6b840ba350 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f6b8b66e640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f6b8b66e640 10 monclient(hunting): authenticate will time out at 3353.953127s 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 10 monclient(hunting): picked mon.noname-b con 0x7fc0a40b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 10 monclient(hunting): picked mon.noname-a con 0x7fc0a40ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 10 monclient(hunting): picked mon.noname-c con 0x7fc0a40585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4163930 con 0x7fc0a40ba350 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446161147 0 0) 0x7f5a7c0b4c30 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f5a79d74640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f5a79d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f5a79d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f5a79d74640 10 monclient(hunting): my global_id is 4383 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a7c0b51f0 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4163bb0 con 0x7fc0a40b9f80 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4163e90 con 0x7fc0a40585e0 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fc0a8f02640 10 monclient(hunting): authenticate will time out at 3353.953239s 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 1 -- start start 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 10 monclient: init 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 10 monclient(hunting): picked mon.noname-a con 0x7f9b64159a70 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 10 monclient(hunting): picked mon.noname-b con 0x7f9b64159e40 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 10 monclient(hunting): picked mon.noname-c con 0x7f9b64058070 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b64163930 con 0x7f9b64159a70 2026-02-25T15:13:04.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b64163bf0 con 0x7f9b64159e40 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b64163ed0 con 0x7f9b64058070 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f9b6b013640 10 monclient(hunting): authenticate will time out at 3353.953589s 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710286138 0 0) 0x7f1568163bb0 con 0x7f15680585e0 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f1565ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f1565ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f1565ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f1565ffb640 10 monclient(hunting): my global_id is 4405 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038308199 0 0) 0x7fe17c0b1810 con 0x7fe17c0b4c30 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fe17a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fe17a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fe17a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1554003610 con 0x7f15680585e0 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fe17a7fc640 10 monclient(hunting): my global_id is 4373 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.364+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe164003610 con 0x7fe17c0b4c30 2026-02-25T15:13:04.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.365+0000 7fb41e575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb42015d3b0 0x7fb420163bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36916/0 (socket says 10.20.193.78:36916) 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.365+0000 7fb41e575640 1 -- 10.20.193.78:0/1715610370 learned_addr learned my addr 10.20.193.78:0/1715610370 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.365+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324368393 0 0) 0x7fe17c0b1530 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.365+0000 7fe17a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.365+0000 7fe17a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.365+0000 7fe17a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.365+0000 7fe17a7fc640 10 monclient(hunting): my global_id is 4399 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.365+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17c0b1810 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1462291731 0 0) 0x7f7b38059410 con 0x7f7b3815af80 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7f7b3d53b640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7f7b3d53b640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7f7b3d53b640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7f7b3d53b640 10 monclient(hunting): my global_id is 4408 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b380596f0 con 0x7f7b3815af80 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7f20f7fff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f20f81566e0 0x7f20f80afc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50654/0 (socket says 10.20.193.78:50654) 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7f20f7fff640 1 -- 10.20.193.78:0/1731020707 learned_addr learned my addr 10.20.193.78:0/1731020707 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7fc759d98640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7fc759d98640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.366+0000 7fc759d98640 10 monclient: monmap: 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.367740+0000 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.367740+0000 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7fc759d98640 1 Processor -- start 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7fc759d98640 1 -- start start 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7fc759d98640 10 monclient: init 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7f20f4ff9640 10 client.?.objecter ms_handle_connect 0x7f20f8156ab0 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7f20f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7f20f4ff9640 10 client.?.objecter ms_handle_connect 0x7f20f81566e0 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7f20f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7f1219cfb640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7f1219cfb640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7f1219cfb640 10 monclient: monmap: 2026-02-25T15:13:04.425 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.368585+0000 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.368585+0000 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.367+0000 7fc759d98640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 10 monclient(hunting): picked mon.noname-a con 0x7fc7540b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 10 monclient(hunting): picked mon.noname-b con 0x7fc7540ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 10 monclient(hunting): picked mon.noname-c con 0x7fc7540585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc754163930 con 0x7fc7540b9f80 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc754163bb0 con 0x7fc7540ba350 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc754163e90 con 0x7fc7540585e0 2026-02-25T15:13:04.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7fc759d98640 10 monclient(hunting): authenticate will time out at 3353.957224s 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3118795262 0 0) 0x7f5a7c0b4f10 con 0x7f5a7c0b0630 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f5a79d74640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f5a79d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f5a79d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f5a79d74640 10 monclient(hunting): my global_id is 4402 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a7c0b4c30 con 0x7f5a7c0b0630 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f1219cfb640 1 Processor -- start 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f1219cfb640 1 -- start start 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f1219cfb640 10 monclient: init 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f20f4ff9640 10 client.?.objecter ms_handle_connect 0x7f20f8160c00 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f20f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673984027 0 0) 0x7f141c163bb0 con 0x7f141c0b9f80 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f140bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f140bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f140bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f140bfff640 10 monclient(hunting): my global_id is 4411 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.368+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1404003610 con 0x7f141c0b9f80 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 10 monclient(hunting): picked mon.noname-b con 0x7f12140b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 10 monclient(hunting): picked mon.noname-a con 0x7f12140ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 10 monclient(hunting): picked mon.noname-c con 0x7f12140585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1214163930 con 0x7f12140ba350 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1214163bb0 con 0x7f12140b9f80 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1214163e90 con 0x7f12140585e0 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f1219cfb640 10 monclient(hunting): authenticate will time out at 3353.958331s 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7fa67a575640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fa67c0b9f80 0x7fa67c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57780/0 (socket says 10.20.193.78:57780) 2026-02-25T15:13:04.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7fa67a575640 1 -- 10.20.193.78:0/2725138171 learned_addr learned my addr 10.20.193.78:0/2725138171 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1728429694 0 0) 0x7f78301680a0 con 0x7f78300b7110 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 >> v1:10.20.193.167:6789/0 conn(0x7f78300b9f30 legacy=0x7f783016b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 >> v1:10.20.193.78:6789/0 conn(0x7f78300ba300 legacy=0x7f78300b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78300b58f0 con 0x7f78300b7110 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7818002df0 con 0x7f78300b7110 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f782dffb640 10 monclient: dump: 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f7835613640 5 monclient: authenticate success, global_id 4396 2026-02-25T15:13:04.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.369+0000 7f7835613640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4214705426 0 0) 0x7f7b38059130 con 0x7f7b380b5d80 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient(hunting): my global_id is 4380 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b38059410 con 0x7f7b380b5d80 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2871881408 0 0) 0x7f7b20003610 con 0x7f7b3815b350 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 >> v1:10.20.193.155:6789/0 conn(0x7f7b3815af80 legacy=0x7f7b38161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 >> v1:10.20.193.78:6789/0 conn(0x7f7b380b5d80 legacy=0x7f7b380b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 1 monclient: found mon.noname-c 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b380599d0 con 0x7f7b3815b350 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7b2c002df0 con 0x7f7b3815b350 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b3d53b640 10 monclient: dump: 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b407c8640 5 monclient: authenticate success, global_id 4379 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.370+0000 7f7b407c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375894885 0 0) 0x7f141c163e90 con 0x7f141c0ba350 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f140bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f140bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f140bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f140bfff640 10 monclient(hunting): my global_id is 4385 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f141c163bb0 con 0x7f141c0ba350 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7fb2357df640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb230159a70 0x7fb2300b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36936/0 (socket says 10.20.193.78:36936) 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7fb2357df640 1 -- 10.20.193.78:0/3636572328 learned_addr learned my addr 10.20.193.78:0/3636572328 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550481273 0 0) 0x7f1568163e90 con 0x7f15680b9f80 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f1565ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f1565ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f1565ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f1565ffb640 10 monclient(hunting): my global_id is 4382 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.372+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1568163bb0 con 0x7f15680b9f80 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.373+0000 7fd806308640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fd800164d00 0x7fd8001c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57784/0 (socket says 10.20.193.78:57784) 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.373+0000 7fd806308640 1 -- 10.20.193.78:0/1038880423 learned_addr learned my addr 10.20.193.78:0/1038880423 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.374+0000 7f6b893e3640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f6b840585e0 0x7f6b840b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57796/0 (socket says 10.20.193.78:57796) 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.374+0000 7f6b893e3640 1 -- 10.20.193.78:0/4235849377 learned_addr learned my addr 10.20.193.78:0/4235849377 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.375+0000 7f6b71ffb640 10 client.?.objecter ms_handle_connect 0x7f6b840ba350 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.375+0000 7f6b71ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.375+0000 7f6b71ffb640 10 client.?.objecter ms_handle_connect 0x7f6b840b9f80 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.375+0000 7f6b71ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.375+0000 7f6b71ffb640 10 client.?.objecter ms_handle_connect 0x7f6b840585e0 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.375+0000 7f6b71ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 190170211 0 0) 0x7f5a7c0b51f0 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 >> v1:10.20.193.167:6789/0 conn(0x7f5a7c15b050 legacy=0x7f5a7c1c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 >> v1:10.20.193.155:6789/0 conn(0x7f5a7c0b0630 legacy=0x7f5a7c0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c0b54d0 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5a64002df0 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a79d74640 10 monclient: dump: 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a81213640 5 monclient: authenticate success, global_id 4383 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7f5a81213640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7fc0a2575640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fc0a40b9f80 0x7fc0a4163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57808/0 (socket says 10.20.193.78:57808) 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.376+0000 7fc0a2575640 1 -- 10.20.193.78:0/8896143 learned_addr learned my addr 10.20.193.78:0/8896143 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7fc7537fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc7540b9f80 0x7fc754163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36970/0 (socket says 10.20.193.78:36970) 2026-02-25T15:13:04.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7fc7537fe640 1 -- 10.20.193.78:0/1218428184 learned_addr learned my addr 10.20.193.78:0/1218428184 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114586257 0 0) 0x7fb414002910 con 0x7fb42015d3b0 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7fb41d573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7fb41d573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7fb41d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7fb41d573640 10 monclient(hunting): my global_id is 4389 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb40c003610 con 0x7fb42015d3b0 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7f9b68d88640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9b64159a70 0x7f9b640b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:36954/0 (socket says 10.20.193.78:36954) 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.377+0000 7f9b68d88640 1 -- 10.20.193.78:0/277972323 learned_addr learned my addr 10.20.193.78:0/277972323 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.378+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332506129 0 0) 0x7f20f815c740 con 0x7f20f81566e0 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.378+0000 7f20f4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.378+0000 7f20f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.378+0000 7f20f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.378+0000 7f20f4ff9640 10 monclient(hunting): my global_id is 4388 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.378+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20c8003610 con 0x7f20f81566e0 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213417820 0 0) 0x7fe168002910 con 0x7fe17c15d3b0 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient(hunting): my global_id is 4386 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17c0b1530 con 0x7fe17c15d3b0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077071550 0 0) 0x7f20f815c460 con 0x7f20f8156ab0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7f20f4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7f20f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7f20f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7f20f4ff9640 10 monclient(hunting): my global_id is 4414 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f815c740 con 0x7f20f8156ab0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2973548468 0 0) 0x7fe17c0b1810 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 >> v1:10.20.193.167:6789/0 conn(0x7fe17c0b4c30 legacy=0x7fe17c0af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 >> v1:10.20.193.78:6789/0 conn(0x7fe17c15d3b0 legacy=0x7fe17c163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c0aebd0 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe170003170 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe17a7fc640 10 monclient: dump: 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.435 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe181bd9640 5 monclient: authenticate success, global_id 4399 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.379+0000 7fe181bd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672776375 0 0) 0x7fa664002910 con 0x7fa67c0ba350 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7fa679573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7fa679573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7fa679573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7fa679573640 10 monclient(hunting): my global_id is 4398 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa668003610 con 0x7fa67c0ba350 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b2c002fc0 con 0x7f7b3815b350 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f7b3d53b640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f7b3d53b640 1 -- 10.20.193.78:0/1337223168 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7b2c003400 con 0x7f7b3815b350 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f7b3d53b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f7b3d53b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f7b3d53b640 10 monclient: dump: 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.436 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f7b407c8640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f7b407c8640 4 set_mon_vals no callback set 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182412035 0 0) 0x7f6b84156bc0 con 0x7f6b840b9f80 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f6b71ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f6b71ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f6b71ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f6b71ffb640 10 monclient(hunting): my global_id is 4407 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.383+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b54003610 con 0x7f6b840b9f80 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 10 monclient: shutdown 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 1 -- 10.20.193.78:0/1337223168 >> v1:10.20.193.167:6789/0 conn(0x7f7b3815b350 legacy=0x7f7b381623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 1 -- 10.20.193.78:0/1337223168 shutdown_connections 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 1 -- 10.20.193.78:0/1337223168 >> 10.20.193.78:0/1337223168 conn(0x7f7b380b5270 msgr2=0x7f7b380b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3771302843 0 0) 0x7f20f80b0360 con 0x7f20f8160c00 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f20f4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f20f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f20f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f20f4ff9640 10 monclient(hunting): my global_id is 4395 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f815c460 con 0x7f20f8160c00 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 1 -- 10.20.193.78:0/1337223168 shutdown_connections 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 1 -- 10.20.193.78:0/1337223168 wait complete. 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242962404 0 0) 0x7fc740002910 con 0x7fc7540b9f80 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7fc7527fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7fc7527fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7fc7527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7fc7527fc640 10 monclient(hunting): my global_id is 4410 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc738003610 con 0x7fc7540b9f80 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.384+0000 7f7b407c8640 10 monclient: monmap: 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.438 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 librados: starting msgr at 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 librados: starting objecter 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 Processor -- start 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 -- start start 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 librados: setting wanted keys 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 librados: calling monclient init 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 10 monclient: init 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868568665 0 0) 0x7fa67c163e90 con 0x7fa67c0585e0 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7fa679573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7fa679573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7fa679573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7fa679573640 10 monclient(hunting): my global_id is 4394 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa664002910 con 0x7fa67c0585e0 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 10 monclient(hunting): picked mon.noname-a con 0x7f7b380b5d80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 10 monclient(hunting): picked mon.noname-b con 0x7f7b3815af80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609482250 0 0) 0x7f1550002910 con 0x7f15680ba350 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f1565ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f1565ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f1565ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f1565ffb640 10 monclient(hunting): my global_id is 4392 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 10 monclient(hunting): picked mon.noname-c con 0x7f7b3815b350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1568163e90 con 0x7f15680ba350 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b38174300 con 0x7f7b380b5d80 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b380b1110 con 0x7f7b3815af80 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b381704d0 con 0x7f7b3815b350 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.385+0000 7f7b407c8640 10 monclient(hunting): authenticate will time out at 3353.974815s 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217960502 0 0) 0x7fa67c163bb0 con 0x7fa67c0b9f80 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7fa679573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7fa679573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7fa679573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7fa679573640 10 monclient(hunting): my global_id is 4417 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c163e90 con 0x7fa67c0b9f80 2026-02-25T15:13:04.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006883045 0 0) 0x7f6b841ff450 con 0x7f6b840585e0 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7f6b71ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7f6b71ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7f6b71ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7f6b71ffb640 10 monclient(hunting): my global_id is 4429 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.386+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b84156bc0 con 0x7f6b840585e0 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676337715 0 0) 0x7fd800055b20 con 0x7fd800164d00 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fd804b05640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fd804b05640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fd804b05640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fd804b05640 10 monclient(hunting): my global_id is 4423 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7e8003610 con 0x7fd800164d00 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151293720 0 0) 0x7fc0a4163bb0 con 0x7fc0a40b9f80 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fc0a1573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fc0a1573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fc0a1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fc0a1573640 10 monclient(hunting): my global_id is 4432 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc090003610 con 0x7fc0a40b9f80 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953652271 0 0) 0x7fb230163ed0 con 0x7fb230058070 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fb21ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fb21ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fb21ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fb21ffff640 10 monclient(hunting): my global_id is 4403 2026-02-25T15:13:04.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb218003610 con 0x7fb230058070 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2728136908 0 0) 0x7f1554003610 con 0x7f15680585e0 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 >> v1:10.20.193.167:6789/0 conn(0x7f15680b9f80 legacy=0x7f1568163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.387+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 >> v1:10.20.193.78:6789/0 conn(0x7f15680ba350 legacy=0x7f1568057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15680573f0 con 0x7f15680585e0 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1558003170 con 0x7f15680585e0 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1565ffb640 10 monclient: dump: 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f156d72e640 5 monclient: authenticate success, global_id 4405 2026-02-25T15:13:04.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f156d72e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318792055 0 0) 0x7fb4200b1530 con 0x7fb4200b4c30 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7fb41d573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7fb41d573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7fb41d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7fb41d573640 10 monclient(hunting): my global_id is 4420 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb414002910 con 0x7fb4200b4c30 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1213fff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f12140585e0 0x7f1214166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50704/0 (socket says 10.20.193.78:50704) 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f1213fff640 1 -- 10.20.193.78:0/2166014419 learned_addr learned my addr 10.20.193.78:0/2166014419 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660093754 0 0) 0x7f6b841fb140 con 0x7f6b840ba350 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f6b71ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f6b71ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f6b71ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f6b71ffb640 10 monclient(hunting): my global_id is 4400 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b841ff450 con 0x7f6b840ba350 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3512237956 0 0) 0x7f20f815c740 con 0x7f20f8156ab0 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20f80b0360 con 0x7f20f8156ab0 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f20e8002fc0 con 0x7f20f8156ab0 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f20f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f20f4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f20f4ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.443 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f20f4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332808369 0 0) 0x7f9b64163ed0 con 0x7f9b64058070 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f9b5b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f9b5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f9b5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.388+0000 7f9b5b7fe640 10 monclient(hunting): my global_id is 4406 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b50003610 con 0x7f9b64058070 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1889362483 0 0) 0x7fb230163bf0 con 0x7fb230159e40 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 10 monclient(hunting): my global_id is 4426 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb230163ed0 con 0x7fb230159e40 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610479942 0 0) 0x7fc754163e90 con 0x7fc7540585e0 2026-02-25T15:13:04.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fc7527fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fc7527fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fc7527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fc7527fc640 10 monclient(hunting): my global_id is 4409 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc740002910 con 0x7fc7540585e0 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2525651707 0 0) 0x7f141c163bb0 con 0x7f141c0ba350 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 >> v1:10.20.193.155:6789/0 conn(0x7f141c0b9f80 legacy=0x7f141c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 >> v1:10.20.193.78:6789/0 conn(0x7f141c0585e0 legacy=0x7f141c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 1 monclient: found mon.noname-c 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c0573f0 con 0x7f141c0ba350 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1410002df0 con 0x7f141c0ba350 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f140bfff640 10 monclient: dump: 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f1423624640 5 monclient: authenticate success, global_id 4385 2026-02-25T15:13:04.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f1423624640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574673775 0 0) 0x7fb230163930 con 0x7fb230159a70 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 10 monclient(hunting): my global_id is 4401 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3890301424 0 0) 0x7f20c8003610 con 0x7f20f81566e0 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20f815c740 con 0x7f20f81566e0 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f20e4003170 con 0x7f20f81566e0 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f20f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f20f4ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7f20f4ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.389+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb230163bf0 con 0x7fb230159a70 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263493478 0 0) 0x7f9b64163bf0 con 0x7f9b64159e40 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7f9b5b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7f9b5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7f9b5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7f9b5b7fe640 10 monclient(hunting): my global_id is 4435 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b64163ed0 con 0x7f9b64159e40 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081309853 0 0) 0x7fb4200b1810 con 0x7fb4201a7ac0 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7fb41d573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7fb41d573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7fb41d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7fb41d573640 10 monclient(hunting): my global_id is 4391 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.390+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4200b1530 con 0x7fb4201a7ac0 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841000146 0 0) 0x7fd800055e00 con 0x7fd800157b50 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7fd804b05640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7fd804b05640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7fd804b05640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7fd804b05640 10 monclient(hunting): my global_id is 4397 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd800055b20 con 0x7fd800157b50 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550099862 0 0) 0x7f9b64163930 con 0x7f9b64159a70 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7f9b5b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7f9b5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7f9b5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7f9b5b7fe640 10 monclient(hunting): my global_id is 4416 2026-02-25T15:13:04.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.391+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b64163bf0 con 0x7f9b64159a70 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.393+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe170003340 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.393+0000 7fe17a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.393+0000 7fe17a7fc640 1 -- 10.20.193.78:0/3319269538 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe170003780 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.393+0000 7fe17a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.393+0000 7fe17a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.393+0000 7fe17a7fc640 10 monclient: dump: 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.393+0000 7fe181bd9640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.393+0000 7fe181bd9640 4 set_mon_vals no callback set 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fe181bd9640 10 monclient: shutdown 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fe181bd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fe181bd9640 1 -- 10.20.193.78:0/3319269538 >> v1:10.20.193.155:6789/0 conn(0x7fe17c1a7ac0 legacy=0x7fe17c1c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fe181bd9640 1 -- 10.20.193.78:0/3319269538 shutdown_connections 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fe181bd9640 1 -- 10.20.193.78:0/3319269538 >> 10.20.193.78:0/3319269538 conn(0x7fe17c0b4120 msgr2=0x7fe17c0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fe181bd9640 1 -- 10.20.193.78:0/3319269538 shutdown_connections 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fe181bd9640 1 -- 10.20.193.78:0/3319269538 wait complete. 2026-02-25T15:13:04.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2972771772 0 0) 0x7fd7e8003610 con 0x7fd800164d00 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 >> v1:10.20.193.167:6789/0 conn(0x7fd800157b50 legacy=0x7fd8001645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 >> v1:10.20.193.78:6789/0 conn(0x7fd800157780 legacy=0x7fd800056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8000560e0 con 0x7fd800164d00 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd7fc003170 con 0x7fd800164d00 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd804b05640 10 monclient: dump: 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd807d92640 5 monclient: authenticate success, global_id 4423 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.394+0000 7fd807d92640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a64002fc0 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a79d74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a79d74640 1 -- 10.20.193.78:0/374978727 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5a64003400 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a79d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a79d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a79d74640 10 monclient: dump: 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.449 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 4 set_mon_vals no callback set 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 10 monclient: monmap: 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 1 librados: starting msgr at 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 1 librados: starting objecter 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 1 Processor -- start 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 1 -- start start 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 1 librados: setting wanted keys 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 1 librados: calling monclient init 2026-02-25T15:13:04.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fe181bd9640 10 monclient: init 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 183987413 0 0) 0x7fa668003610 con 0x7fa67c0ba350 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 >> v1:10.20.193.167:6789/0 conn(0x7fa67c0585e0 legacy=0x7fa67c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 >> v1:10.20.193.155:6789/0 conn(0x7fa67c0b9f80 legacy=0x7fa67c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0573f0 con 0x7fa67c0ba350 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa664002fc0 con 0x7fa67c0ba350 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa679573640 10 monclient: dump: 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa680c46640 5 monclient: authenticate success, global_id 4398 2026-02-25T15:13:04.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fa680c46640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 10 monclient: shutdown 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 1 -- 10.20.193.78:0/374978727 >> v1:10.20.193.78:6789/0 conn(0x7f5a7c0b0a00 legacy=0x7f5a7c15a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3476584481 0 0) 0x7fb40c003610 con 0x7fb42015d3b0 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 >> v1:10.20.193.167:6789/0 conn(0x7fb4201a7ac0 legacy=0x7fb4201c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 >> v1:10.20.193.155:6789/0 conn(0x7fb4200b4c30 legacy=0x7fb4200af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4200aebd0 con 0x7fb42015d3b0 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 1 -- 10.20.193.78:0/374978727 shutdown_connections 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 1 -- 10.20.193.78:0/374978727 >> 10.20.193.78:0/374978727 conn(0x7f5a7c0b7360 msgr2=0x7f5a7c0b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb414002fc0 con 0x7fb42015d3b0 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb41d573640 10 monclient: dump: 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.452 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb424e46640 5 monclient: authenticate success, global_id 4389 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 1 -- 10.20.193.78:0/374978727 shutdown_connections 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7fb424e46640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.395+0000 7f5a81213640 1 -- 10.20.193.78:0/374978727 wait complete. 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 10 monclient(hunting): picked mon.noname-b con 0x7fe17c0b4c30 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 10 monclient(hunting): picked mon.noname-a con 0x7fe17c15d3b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 10 monclient(hunting): picked mon.noname-c con 0x7fe17c1a7ac0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17c0a79e0 con 0x7fe17c15d3b0 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17c0a7c80 con 0x7fe17c0b4c30 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17c0a7f60 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fe181bd9640 10 monclient(hunting): authenticate will time out at 3353.985211s 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f7b3ed3e640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f7b3815b350 0x7f7b38163e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50720/0 (socket says 10.20.193.78:50720) 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f7b3ed3e640 1 -- 10.20.193.78:0/889199527 learned_addr learned my addr 10.20.193.78:0/889199527 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 10 monclient: monmap: 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 741701867 0 0) 0x7f6b54003610 con 0x7f6b840b9f80 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b841fb140 con 0x7f6b840b9f80 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6b78002f70 con 0x7f6b840b9f80 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f6b71ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f6b71ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f6b71ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f6b71ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 1 librados: starting msgr at 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 1 librados: starting objecter 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 1 Processor -- start 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 1 -- start start 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 1 librados: setting wanted keys 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 1 librados: calling monclient init 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7f5a81213640 10 monclient: init 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 744512831 0 0) 0x7fc738003610 con 0x7fc7540b9f80 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 >> v1:10.20.193.167:6789/0 conn(0x7fc7540585e0 legacy=0x7fc754166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 >> v1:10.20.193.155:6789/0 conn(0x7fc7540ba350 legacy=0x7fc754057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7540573f0 con 0x7fc7540b9f80 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc740002fc0 con 0x7fc7540b9f80 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc7527fc640 10 monclient: dump: 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.455 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc759d98640 5 monclient: authenticate success, global_id 4410 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.396+0000 7fc759d98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 10 monclient(hunting): picked mon.noname-c con 0x7f5a7c0b0630 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 10 monclient(hunting): picked mon.noname-b con 0x7f5a7c0b0a00 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 10 monclient(hunting): picked mon.noname-a con 0x7f5a7c15b050 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c13b2b0 con 0x7f5a7c15b050 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c13b590 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c13b870 con 0x7f5a7c0b0630 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f5a81213640 10 monclient(hunting): authenticate will time out at 3353.986140s 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f7b1effd640 10 client.?.objecter ms_handle_connect 0x7f7b380b5d80 2026-02-25T15:13:04.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.397+0000 7f7b1effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.398+0000 7f7b1effd640 10 client.?.objecter ms_handle_connect 0x7f7b3815b350 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.398+0000 7f7b1effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.398+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2712391385 0 0) 0x7f20f815c460 con 0x7f20f8160c00 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.398+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20c8003610 con 0x7f20f8160c00 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.398+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f20ec0034f0 con 0x7f20f8160c00 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.398+0000 7f20f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.398+0000 7f20f4ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.398+0000 7f20f4ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986929025 0 0) 0x7fc08c002910 con 0x7fc0a40ba350 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fc0a1573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fc0a1573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fc0a1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fc0a1573640 10 monclient(hunting): my global_id is 4419 2026-02-25T15:13:04.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a4163bb0 con 0x7fc0a40ba350 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 213698868 0 0) 0x7fb230163bf0 con 0x7fb230159a70 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 >> v1:10.20.193.167:6789/0 conn(0x7fb230058070 legacy=0x7fb230058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 >> v1:10.20.193.155:6789/0 conn(0x7fb230159e40 legacy=0x7fb230163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb230057590 con 0x7fb230159a70 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb220002dd0 con 0x7fb230159a70 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1833112484 0 0) 0x7f6b841ff450 con 0x7f6b840ba350 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b54003610 con 0x7f6b840ba350 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6b80003400 con 0x7f6b840ba350 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.458 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3124044919 0 0) 0x7f6b841fb140 con 0x7f6b840b9f80 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 >> v1:10.20.193.167:6789/0 conn(0x7f6b840ba350 legacy=0x7f6b84158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb21ffff640 10 monclient: dump: 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb237a6a640 5 monclient: authenticate success, global_id 4401 2026-02-25T15:13:04.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7fb237a6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 >> v1:10.20.193.155:6789/0 conn(0x7f6b840585e0 legacy=0x7f6b840b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 1 monclient: found mon.a 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b841fb420 con 0x7f6b840b9f80 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b71ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 5 monclient: authenticate success, global_id 4407 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 10 monclient: _renew_subs 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6b841fb700 con 0x7f6b840b9f80 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 10 client.4407.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 10 monclient: _renew_subs 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6b841fbcc0 con 0x7f6b840b9f80 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.404+0000 7f6b8b66e640 1 librados: init done 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f6b8b66e640 10 client.4407.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f6b8b66e640 15 client.4407.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f6b8b66e640 20 client.4407.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f6b8b66e640 10 client.4407.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f6b8b66e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6b840b9170 con 0x7f6b840b9f80 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7818002fc0 con 0x7f78300b7110 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f782dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f782dffb640 1 -- 10.20.193.78:0/1045480571 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7818003400 con 0x7f78300b7110 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f782dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f782dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f782dffb640 10 monclient: dump: 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f7835613640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f7835613640 4 set_mon_vals no callback set 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1558003340 con 0x7f15680585e0 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f1565ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f1565ffb640 1 -- 10.20.193.78:0/836460891 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1558003780 con 0x7f15680585e0 2026-02-25T15:13:04.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f1565ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f1565ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f1565ffb640 10 monclient: dump: 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f156d72e640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.405+0000 7f156d72e640 4 set_mon_vals no callback set 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 10 monclient: shutdown 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 1 -- 10.20.193.78:0/1045480571 >> v1:10.20.193.155:6789/0 conn(0x7f78300b7110 legacy=0x7f78301676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 420004578 0 0) 0x7f9b50003610 con 0x7f9b64058070 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 >> v1:10.20.193.155:6789/0 conn(0x7f9b64159e40 legacy=0x7f9b64163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 >> v1:10.20.193.78:6789/0 conn(0x7f9b64159a70 legacy=0x7f9b640b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 1 monclient: found mon.noname-c 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b64057590 con 0x7f9b64058070 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9b60003170 con 0x7f9b64058070 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b5b7fe640 10 monclient: dump: 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b6b013640 5 monclient: authenticate success, global_id 4406 2026-02-25T15:13:04.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f9b6b013640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 1 -- 10.20.193.78:0/1045480571 shutdown_connections 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 1 -- 10.20.193.78:0/1045480571 >> 10.20.193.78:0/1045480571 conn(0x7f78300b7990 msgr2=0x7f78300b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 1 -- 10.20.193.78:0/1045480571 shutdown_connections 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 1 -- 10.20.193.78:0/1045480571 wait complete. 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f156d72e640 10 monclient: shutdown 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f156d72e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f156d72e640 1 -- 10.20.193.78:0/836460891 >> v1:10.20.193.155:6789/0 conn(0x7f15680585e0 legacy=0x7f1568166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f156d72e640 1 -- 10.20.193.78:0/836460891 shutdown_connections 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f156d72e640 1 -- 10.20.193.78:0/836460891 >> 10.20.193.78:0/836460891 conn(0x7f15680b7990 msgr2=0x7f15680b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f156d72e640 1 -- 10.20.193.78:0/836460891 shutdown_connections 2026-02-25T15:13:04.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f156d72e640 1 -- 10.20.193.78:0/836460891 wait complete. 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.406+0000 7f7835613640 10 monclient: monmap: 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1935250158 0 0) 0x7fc090003610 con 0x7fc0a40b9f80 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 >> v1:10.20.193.167:6789/0 conn(0x7fc0a40585e0 legacy=0x7fc0a4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 >> v1:10.20.193.78:6789/0 conn(0x7fc0a40ba350 legacy=0x7fc0a4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a40573f0 con 0x7fc0a40b9f80 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc098002df0 con 0x7fc0a40b9f80 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a1573640 10 monclient: dump: 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 librados: starting msgr at 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 librados: starting objecter 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 Processor -- start 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a8f02640 5 monclient: authenticate success, global_id 4432 2026-02-25T15:13:04.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fc0a8f02640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 -- start start 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 librados: setting wanted keys 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 librados: calling monclient init 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 10 monclient: init 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 10 monclient: monmap: 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.467 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3077410409 0 0) 0x7f20f80b0360 con 0x7f20f8156ab0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 >> v1:10.20.193.167:6789/0 conn(0x7f20f81566e0 legacy=0x7f20f80afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 >> v1:10.20.193.78:6789/0 conn(0x7f20f8160c00 legacy=0x7f20f81284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 1 monclient: found mon.b 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f815ca20 con 0x7f20f8156ab0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 5 monclient: authenticate success, global_id 4414 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 10 monclient: _renew_subs 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f20f815cd00 con 0x7f20f8156ab0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 10 client.4414.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 10 monclient: _renew_subs 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f20f8126b70 con 0x7f20f8156ab0 2026-02-25T15:13:04.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f20fe383640 1 librados: init done 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1410003000 con 0x7f141c0ba350 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f140bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f140bfff640 1 -- 10.20.193.78:0/4156493515 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1410003440 con 0x7f141c0ba350 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f140bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f140bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f140bfff640 10 monclient: dump: 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f1423624640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f1423624640 4 set_mon_vals no callback set 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 1 librados: starting msgr at 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 1 librados: starting objecter 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 1 Processor -- start 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 1 -- start start 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 1 librados: setting wanted keys 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 1 librados: calling monclient init 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f156d72e640 10 monclient: init 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 10 monclient(hunting): picked mon.noname-a con 0x7f78300b7110 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 10 monclient(hunting): picked mon.noname-b con 0x7f78300b9f30 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7fc003400 con 0x7fd800164d00 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fd804b05640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fd804b05640 1 -- 10.20.193.78:0/1038880423 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd7fc003800 con 0x7fd800164d00 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fd804b05640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fd804b05640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fd804b05640 10 monclient: dump: 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 10 monclient(hunting): picked mon.noname-c con 0x7f78300ba300 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783013bc90 con 0x7f78300b7110 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fd807d92640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783013bf70 con 0x7f78300b9f30 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7fd807d92640 4 set_mon_vals no callback set 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783013c250 con 0x7f78300ba300 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f7835613640 10 monclient(hunting): authenticate will time out at 3353.996840s 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f1423624640 10 monclient: shutdown 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f1423624640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.407+0000 7f1423624640 1 -- 10.20.193.78:0/4156493515 >> v1:10.20.193.167:6789/0 conn(0x7f141c0ba350 legacy=0x7f141c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f20fe383640 10 client.4414.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f20fe383640 15 client.4414.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f20fe383640 20 client.4414.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f20fe383640 10 client.4414.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f20fe383640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f20f8056010 con 0x7f20f8156ab0 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 10 monclient(hunting): picked mon.noname-b con 0x7f15680585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f1423624640 1 -- 10.20.193.78:0/4156493515 shutdown_connections 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f1423624640 1 -- 10.20.193.78:0/4156493515 >> 10.20.193.78:0/4156493515 conn(0x7f141c0b7990 msgr2=0x7f141c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 10 monclient(hunting): picked mon.noname-a con 0x7f15680b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f7b1effd640 10 client.?.objecter ms_handle_connect 0x7f7b3815af80 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f7b1effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 10 monclient(hunting): picked mon.noname-c con 0x7f15680ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1568156050 con 0x7f15680b9f80 2026-02-25T15:13:04.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f1423624640 1 -- 10.20.193.78:0/4156493515 shutdown_connections 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15681fcb00 con 0x7f15680585e0 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15681fcde0 con 0x7f15680ba350 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f156d72e640 10 monclient(hunting): authenticate will time out at 3353.997186s 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f1423624640 1 -- 10.20.193.78:0/4156493515 wait complete. 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7fd807d92640 10 monclient: shutdown 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7fd807d92640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7fd807d92640 1 -- 10.20.193.78:0/1038880423 >> v1:10.20.193.155:6789/0 conn(0x7fd800164d00 legacy=0x7fd8001c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f1423624640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f1423624640 10 monclient: monmap: 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.474 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f1423624640 1 librados: starting msgr at 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.408+0000 7f1423624640 1 librados: starting objecter 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7fd807d92640 1 -- 10.20.193.78:0/1038880423 shutdown_connections 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7fd807d92640 1 -- 10.20.193.78:0/1038880423 >> 10.20.193.78:0/1038880423 conn(0x7fd8000b2ef0 msgr2=0x7fd8000b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 1 Processor -- start 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7fd807d92640 1 -- 10.20.193.78:0/1038880423 shutdown_connections 2026-02-25T15:13:04.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7fd807d92640 1 -- 10.20.193.78:0/1038880423 wait complete. 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 1 -- start start 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 1 librados: setting wanted keys 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 1 librados: calling monclient init 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 10 monclient: init 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 10 monclient(hunting): picked mon.noname-a con 0x7f141c0585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 10 monclient(hunting): picked mon.noname-c con 0x7f141c0b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 10 monclient(hunting): picked mon.noname-b con 0x7f141c0ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c1fd0f0 con 0x7f141c0585e0 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c1fd3d0 con 0x7f141c0ba350 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c1fd6b0 con 0x7f141c0b9f80 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7f1423624640 10 monclient(hunting): authenticate will time out at 3353.998578s 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7fd807d92640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7fd807d92640 10 monclient: monmap: 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7fd807d92640 1 librados: starting msgr at 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.409+0000 7fd807d92640 1 librados: starting objecter 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 1 Processor -- start 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 1 -- start start 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 1 librados: setting wanted keys 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 1 librados: calling monclient init 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 10 monclient: init 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427703068 0 0) 0x7f1214163bb0 con 0x7f12140b9f80 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7f12127fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7f12127fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7f12127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7f12127fc640 10 monclient(hunting): my global_id is 4441 2026-02-25T15:13:04.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11f8003610 con 0x7f12140b9f80 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 10 monclient(hunting): picked mon.noname-a con 0x7fd800157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 10 monclient(hunting): picked mon.noname-c con 0x7fd800157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 10 monclient(hunting): picked mon.noname-b con 0x7fd800164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8000abc80 con 0x7fd800157780 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8000af310 con 0x7fd800164d00 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8000af5f0 con 0x7fd800157b50 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fd807d92640 10 monclient(hunting): authenticate will time out at 3353.999876s 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fe17b7fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fe17c0b4c30 0x7fe17c129340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57844/0 (socket says 10.20.193.78:57844) 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.410+0000 7fe17b7fe640 1 -- 10.20.193.78:0/432585760 learned_addr learned my addr 10.20.193.78:0/432585760 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998979410 0 0) 0x7f7b381704d0 con 0x7f7b3815b350 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f7b1effd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f7b1effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f7b1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f7b1effd640 10 monclient(hunting): my global_id is 4418 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229866632 0 0) 0x7f1214163e90 con 0x7f12140585e0 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f12127fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f12127fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f12127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f12127fc640 10 monclient(hunting): my global_id is 4415 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1214163bb0 con 0x7f12140585e0 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.413+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b08003610 con 0x7f7b3815b350 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.415+0000 7fe157fff640 10 client.?.objecter ms_handle_connect 0x7fe17c0b4c30 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.415+0000 7fe157fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7400031d0 con 0x7fc7540b9f80 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc7527fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc7527fc640 1 -- 10.20.193.78:0/1218428184 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc740004990 con 0x7fc7540b9f80 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc7527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc7527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc7527fc640 10 monclient: dump: 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.479 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc759d98640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc759d98640 4 set_mon_vals no callback set 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687659304 0 0) 0x7f7b38174300 con 0x7f7b380b5d80 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7f7b1effd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7f7b1effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7f7b1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7f7b1effd640 10 monclient(hunting): my global_id is 4425 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b381704d0 con 0x7f7b380b5d80 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc759d98640 10 monclient: shutdown 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc759d98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fc759d98640 1 -- 10.20.193.78:0/1218428184 >> v1:10.20.193.78:6789/0 conn(0x7fc7540b9f80 legacy=0x7fc754163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa664003190 con 0x7fa67c0ba350 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fa679573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fa679573640 1 -- 10.20.193.78:0/2725138171 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa6640035d0 con 0x7fa67c0ba350 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fa680c46640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fa680c46640 4 set_mon_vals no callback set 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.417+0000 7fa679573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa679573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa679573640 10 monclient: dump: 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.480 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 1 -- 10.20.193.78:0/1218428184 shutdown_connections 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 1 -- 10.20.193.78:0/1218428184 >> 10.20.193.78:0/1218428184 conn(0x7fc7540b7990 msgr2=0x7fc7540b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fe157fff640 10 client.?.objecter ms_handle_connect 0x7fe17c15d3b0 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fe157fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 1 -- 10.20.193.78:0/1218428184 shutdown_connections 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 1 -- 10.20.193.78:0/1218428184 wait complete. 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7f782f7fe640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f78300ba300 0x7f783013b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50746/0 (socket says 10.20.193.78:50746) 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7f782f7fe640 1 -- 10.20.193.78:0/2026144358 learned_addr learned my addr 10.20.193.78:0/2026144358 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa680c46640 10 monclient: shutdown 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa680c46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa680c46640 1 -- 10.20.193.78:0/2725138171 >> v1:10.20.193.78:6789/0 conn(0x7fa67c0ba350 legacy=0x7fa67c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa680c46640 1 -- 10.20.193.78:0/2725138171 shutdown_connections 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa680c46640 1 -- 10.20.193.78:0/2725138171 >> 10.20.193.78:0/2725138171 conn(0x7fa67c0b7990 msgr2=0x7fa67c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa680c46640 1 -- 10.20.193.78:0/2725138171 shutdown_connections 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fa680c46640 1 -- 10.20.193.78:0/2725138171 wait complete. 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 10 monclient: monmap: 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 1 librados: starting msgr at 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 1 librados: starting objecter 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 1 Processor -- start 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.418+0000 7fc759d98640 1 -- start start 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 1 librados: setting wanted keys 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 1 librados: calling monclient init 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 10 monclient: init 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc098003000 con 0x7fc0a40b9f80 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a1573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a1573640 1 -- 10.20.193.78:0/8896143 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc098003440 con 0x7fc0a40b9f80 2026-02-25T15:13:04.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a1573640 10 monclient: dump: 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 4 set_mon_vals no callback set 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 10 monclient: monmap: 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656240407 0 0) 0x7f7b380b1110 con 0x7f7b3815af80 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7f7b1effd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7f7b1effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7f7b1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7f7b1effd640 10 monclient(hunting): my global_id is 4444 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b38174300 con 0x7f7b3815af80 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 1 librados: starting msgr at 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 1 librados: starting objecter 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 1 Processor -- start 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 1 -- start start 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 1 librados: setting wanted keys 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 1 librados: calling monclient init 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 10 monclient: init 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 10 monclient: shutdown 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 1 -- 10.20.193.78:0/8896143 >> v1:10.20.193.155:6789/0 conn(0x7fc0a40b9f80 legacy=0x7fc0a4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 10 monclient(hunting): picked mon.noname-a con 0x7fc7540585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7f5a7a575640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f5a7c0b0a00 0x7f5a7c1594e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57850/0 (socket says 10.20.193.78:57850) 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7f5a7a575640 1 -- 10.20.193.78:0/638847339 learned_addr learned my addr 10.20.193.78:0/638847339 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 10 monclient(hunting): picked mon.noname-c con 0x7fc7540b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 10 monclient(hunting): picked mon.noname-b con 0x7fc7540ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc754165ee0 con 0x7fc7540585e0 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc754156d30 con 0x7fc7540ba350 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc754166170 con 0x7fc7540b9f80 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 1 -- 10.20.193.78:0/8896143 shutdown_connections 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 1 -- 10.20.193.78:0/8896143 >> 10.20.193.78:0/8896143 conn(0x7fc0a40b7990 msgr2=0x7fc0a40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc759d98640 10 monclient(hunting): authenticate will time out at 3354.008637s 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 1 -- 10.20.193.78:0/8896143 shutdown_connections 2026-02-25T15:13:04.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fc0a8f02640 1 -- 10.20.193.78:0/8896143 wait complete. 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.419+0000 7fa680c46640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fa680c46640 10 monclient(hunting): picked mon.noname-c con 0x7fa67c0585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fa680c46640 10 monclient(hunting): picked mon.noname-a con 0x7fa67c0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fa680c46640 10 monclient(hunting): picked mon.noname-b con 0x7fa67c0ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fa680c46640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0b2bf0 con 0x7fa67c0b9f80 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fa680c46640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0b3b00 con 0x7fa67c0ba350 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fa680c46640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0b3de0 con 0x7fa67c0585e0 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fa680c46640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fa680c46640 10 monclient(hunting): authenticate will time out at 3354.009058s 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 10 monclient: monmap: 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f5a5b7fe640 10 client.?.objecter ms_handle_connect 0x7f5a7c0b0a00 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f5a5b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f1566ffd640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f15680585e0 0x7f15681fde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57864/0 (socket says 10.20.193.78:57864) 2026-02-25T15:13:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 1 librados: starting msgr at 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 1 librados: starting objecter 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f1566ffd640 1 -- 10.20.193.78:0/3679755628 learned_addr learned my addr 10.20.193.78:0/3679755628 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 1 Processor -- start 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 1 -- start start 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 1 librados: setting wanted keys 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 1 librados: calling monclient init 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 10 monclient: init 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f780f7fe640 10 client.?.objecter ms_handle_connect 0x7f78300b9f30 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f780f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f780f7fe640 10 client.?.objecter ms_handle_connect 0x7f78300ba300 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f780f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f15477fe640 10 client.?.objecter ms_handle_connect 0x7f15680585e0 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7f15477fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.420+0000 7fc0a8f02640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fc0a8f02640 10 monclient(hunting): picked mon.noname-a con 0x7fc0a40585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fc0a8f02640 10 monclient(hunting): picked mon.noname-b con 0x7fc0a40b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fc0a8f02640 10 monclient(hunting): picked mon.noname-c con 0x7fc0a40ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fc0a8f02640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4156070 con 0x7fc0a40585e0 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fc0a8f02640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a41fc0c0 con 0x7fc0a40b9f80 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fc0a8f02640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a415efa0 con 0x7fc0a40ba350 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fc0a8f02640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fc0a8f02640 10 monclient(hunting): authenticate will time out at 3354.010069s 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fe157fff640 10 client.?.objecter ms_handle_connect 0x7fe17c1a7ac0 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7fe157fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7f1420b98640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f141c0b9f80 0x7f141c1f8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50760/0 (socket says 10.20.193.78:50760) 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.421+0000 7f1420b98640 1 -- 10.20.193.78:0/2821587187 learned_addr learned my addr 10.20.193.78:0/2821587187 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f1409ffb640 10 client.?.objecter ms_handle_connect 0x7f141c0b9f80 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f1409ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7fd805306640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fd800157b50 0x7fd8000ab570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50770/0 (socket says 10.20.193.78:50770) 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7fd805306640 1 -- 10.20.193.78:0/2500858317 learned_addr learned my addr 10.20.193.78:0/2500858317 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f5a5b7fe640 10 client.?.objecter ms_handle_connect 0x7f5a7c0b0630 2026-02-25T15:13:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f5a5b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b840b9170 con 0x7f6b840b9f80 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f6b71ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6b780032b0 con 0x7f6b840b9f80 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f6b71ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f6b71ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f6b71ffb640 10 monclient: dump: 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.422+0000 7f6b737fe640 4 set_mon_vals no callback set 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7f1409ffb640 10 client.?.objecter ms_handle_connect 0x7f141c0ba350 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7f1409ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6b780034c0 con 0x7f6b840b9f80 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb414003190 con 0x7fb42015d3b0 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb41d573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 4 set_mon_vals no callback set 2026-02-25T15:13:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7f6b893e3640 10 monclient: get_auth_request con 0x7f6b54077d20 auth_method 0 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb41d573640 1 -- 10.20.193.78:0/1715610370 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb414004990 con 0x7fb42015d3b0 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb41d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb41d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb41d573640 10 monclient: dump: 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7f6b71ffb640 10 client.4407.objecter ms_handle_connect 0x7f6b54077d20 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 10 monclient: shutdown 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 1 -- 10.20.193.78:0/1715610370 >> v1:10.20.193.78:6789/0 conn(0x7fb42015d3b0 legacy=0x7fb420163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 1 -- 10.20.193.78:0/1715610370 shutdown_connections 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 1 -- 10.20.193.78:0/1715610370 >> 10.20.193.78:0/1715610370 conn(0x7fb4200b4120 msgr2=0x7fb4200b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 1 -- 10.20.193.78:0/1715610370 shutdown_connections 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.423+0000 7fb424e46640 1 -- 10.20.193.78:0/1715610370 wait complete. 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fd7ee7fc640 10 client.?.objecter ms_handle_connect 0x7fd800157b50 2026-02-25T15:13:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fd7ee7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 10 monclient: monmap: 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 1 librados: starting msgr at 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 1 librados: starting objecter 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 1 Processor -- start 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 1 -- start start 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 1 librados: setting wanted keys 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 1 librados: calling monclient init 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.424+0000 7fb424e46640 10 monclient: init 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b60003340 con 0x7f9b64058070 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b5b7fe640 1 -- 10.20.193.78:0/277972323 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9b60003780 con 0x7f9b64058070 2026-02-25T15:13:04.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b5b7fe640 10 monclient: dump: 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 4 set_mon_vals no callback set 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 10 monclient(hunting): picked mon.noname-b con 0x7fb4200b4c30 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 10 monclient(hunting): picked mon.noname-c con 0x7fb42015d3b0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 10 monclient(hunting): picked mon.noname-a con 0x7fb4201a7ac0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4200ad1f0 con 0x7fb4201a7ac0 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4200acf20 con 0x7fb4200b4c30 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb420126bc0 con 0x7fb42015d3b0 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7fb424e46640 10 monclient(hunting): authenticate will time out at 3354.014226s 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 10 monclient: shutdown 2026-02-25T15:13:04.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 1 -- 10.20.193.78:0/277972323 >> v1:10.20.193.167:6789/0 conn(0x7f9b64058070 legacy=0x7f9b64058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 1 -- 10.20.193.78:0/277972323 shutdown_connections 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 1 -- 10.20.193.78:0/277972323 >> 10.20.193.78:0/277972323 conn(0x7f9b640b7780 msgr2=0x7f9b640b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 1 -- 10.20.193.78:0/277972323 shutdown_connections 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.425+0000 7f9b6b013640 1 -- 10.20.193.78:0/277972323 wait complete. 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f6b78091e00 con 0x7f6b840b9f80 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 10 client.4407.objecter ms_dispatch2 0x7f6b84000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 3 client.4407.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 3 client.4407.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 10 client.4407.objecter checking command 1 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 20 client.4407.objecter _get_session s=0x7f6b540a0ba0 osd=3 3 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 20 client.4407.objecter put_session s=0x7f6b540a0ba0 osd=3 3 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 15 client.4407.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 20 client.4407.objecter _get_session s=0x7f6b540a0ba0 osd=3 3 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 20 client.4407.objecter get_session s=0x7f6b540a0ba0 osd=3 3 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 15 client.4407.objecter _session_command_op_assign 3 1 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 20 client.4407.objecter put_session s=0x7f6b540a0ba0 osd=3 4 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 10 client.4407.objecter _send_command 1 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.174:6804/3507256265 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b540c2e50 con 0x7f6b540a1250 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 20 client.4407.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f6b7805bf00 con 0x7f6b840b9f80 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b71ffb640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 10 monclient: monmap: 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.493 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb220002fa0 con 0x7fb230159a70 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7fb21ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7fb21ffff640 1 -- 10.20.193.78:0/3636572328 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb2200033e0 con 0x7fb230159a70 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7fb21ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7fb21ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7fb21ffff640 10 monclient: dump: 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7fb237a6a640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7fb237a6a640 4 set_mon_vals no callback set 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f5a5b7fe640 10 client.?.objecter ms_handle_connect 0x7f5a7c15b050 2026-02-25T15:13:04.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f5a5b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 1 librados: starting msgr at 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 1 librados: starting objecter 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 1 Processor -- start 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 1 -- start start 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 1 librados: setting wanted keys 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 1 librados: calling monclient init 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f9b6b013640 10 monclient: init 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1576070222 0 0) 0x7f7b08003610 con 0x7f7b3815b350 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b380b1110 con 0x7f7b3815b350 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7b34003410 con 0x7f7b3815b350 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f7b1effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f7b1effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f7b1effd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f7b1effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.426+0000 7f6b89be4640 10 monclient: get_auth_request con 0x7f6b540a1250 auth_method 0 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 10 monclient: shutdown 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 1 -- 10.20.193.78:0/3636572328 >> v1:10.20.193.78:6789/0 conn(0x7fb230159a70 legacy=0x7fb2300b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 1 -- 10.20.193.78:0/3636572328 shutdown_connections 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 1 -- 10.20.193.78:0/3636572328 >> 10.20.193.78:0/3636572328 conn(0x7fb2300b7780 msgr2=0x7fb2300b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 1 -- 10.20.193.78:0/3636572328 shutdown_connections 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 1 -- 10.20.193.78:0/3636572328 wait complete. 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736335052 0 0) 0x7f783013c250 con 0x7f78300ba300 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f780f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f780f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f780f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f780f7fe640 10 monclient(hunting): my global_id is 4424 2026-02-25T15:13:04.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77fc003610 con 0x7f78300ba300 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 10 monclient(hunting): picked mon.noname-b con 0x7f9b64058070 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 10 monclient(hunting): picked mon.noname-a con 0x7f9b64159a70 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 10 monclient(hunting): picked mon.noname-c con 0x7f9b64159e40 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b6415b940 con 0x7f9b64159a70 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b64162400 con 0x7f9b64058070 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b641faff0 con 0x7f9b64159e40 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f9b6b013640 10 monclient(hunting): authenticate will time out at 3354.016420s 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f15477fe640 10 client.?.objecter ms_handle_connect 0x7f15680ba350 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7f15477fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060075461 0 0) 0x7fd8000af5f0 con 0x7fd800157b50 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fd7ee7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fd7ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fd7ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fd7ee7fc640 10 monclient(hunting): my global_id is 4430 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d0003610 con 0x7fd800157b50 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 10 monclient: monmap: 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.497 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fa67a575640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fa67c0585e0 0x7fa67c1629d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50782/0 (socket says 10.20.193.78:50782) 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fa67a575640 1 -- 10.20.193.78:0/4113924773 learned_addr learned my addr 10.20.193.78:0/4113924773 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 1 librados: starting msgr at 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.427+0000 7fb237a6a640 1 librados: starting objecter 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 1 Processor -- start 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 1 -- start start 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 1 librados: setting wanted keys 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 1 librados: calling monclient init 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 10 monclient: init 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fa662ffd640 10 client.?.objecter ms_handle_connect 0x7fa67c0585e0 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fa662ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37927968 0 0) 0x7f1204002910 con 0x7f12140ba350 2026-02-25T15:13:04.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f12127fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787495271 0 0) 0x7f141c1fd6b0 con 0x7f141c0b9f80 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f1409ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f12127fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f12127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f12127fc640 10 monclient(hunting): my global_id is 4422 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f1409ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f1409ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f1409ffb640 10 monclient(hunting): my global_id is 4427 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13ec003610 con 0x7f141c0b9f80 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1214163e90 con 0x7f12140ba350 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 10 monclient(hunting): picked mon.noname-a con 0x7fb230058070 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 10 monclient(hunting): picked mon.noname-b con 0x7fb230159a70 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 10 monclient(hunting): picked mon.noname-c con 0x7fb230159e40 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2300b35f0 con 0x7fb230058070 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2300b38d0 con 0x7fb230159a70 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2300b3bb0 con 0x7fb230159e40 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7fb237a6a640 10 monclient(hunting): authenticate will time out at 3354.017576s 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.428+0000 7f6b71ffb640 10 client.4407.objecter ms_handle_connect 0x7f6b540a1250 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7fc752ffd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fc7540b9f80 0x7fc754156620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50780/0 (socket says 10.20.193.78:50780) 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7fc752ffd640 1 -- 10.20.193.78:0/1546102419 learned_addr learned my addr 10.20.193.78:0/1546102419 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 460410700 0 0) 0x7f1214163bb0 con 0x7f12140585e0 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 >> v1:10.20.193.155:6789/0 conn(0x7f12140b9f80 legacy=0x7f1214163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 >> v1:10.20.193.78:6789/0 conn(0x7f12140ba350 legacy=0x7f1214057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 1 monclient: found mon.noname-c 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12140573f0 con 0x7f12140585e0 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1208003170 con 0x7f12140585e0 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f12127fc640 10 monclient: dump: 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f1219cfb640 5 monclient: authenticate success, global_id 4415 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f1219cfb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f780f7fe640 10 client.?.objecter ms_handle_connect 0x7f78300b7110 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f780f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20f8056010 con 0x7f20f8156ab0 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f20f4ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f20e8003640 con 0x7f20f8156ab0 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f20f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f20f67fc640 4 set_mon_vals no callback set 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f20f4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.429+0000 7f20f4ff9640 10 monclient: dump: 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f20e801c520 con 0x7f20f8156ab0 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459684667 0 0) 0x7fe17c0a79e0 con 0x7fe17c15d3b0 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7fe157fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7fe157fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7fe157fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7fe157fff640 10 monclient(hunting): my global_id is 4428 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe14c003610 con 0x7fe17c15d3b0 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7fc72ffff640 10 client.?.objecter ms_handle_connect 0x7fc7540b9f80 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7fc72ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862896436 0 0) 0x7f5a7c13b2b0 con 0x7f5a7c15b050 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f5a5b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f5a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f5a5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f5a5b7fe640 10 monclient(hunting): my global_id is 4431 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a48003610 con 0x7f5a7c15b050 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f20f7fff640 10 monclient: get_auth_request con 0x7f20c8077e70 auth_method 0 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.430+0000 7f20f4ff9640 10 client.4414.objecter ms_handle_connect 0x7f20c8077e70 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f15477fe640 10 client.?.objecter ms_handle_connect 0x7f15680b9f80 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f15477fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f20e8091d50 con 0x7f20f8156ab0 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f20f4ff9640 10 client.4414.objecter ms_dispatch2 0x7f20f8000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f20f4ff9640 3 client.4414.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f20f4ff9640 3 client.4414.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f1409ffb640 10 client.?.objecter ms_handle_connect 0x7f141c0585e0 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f1409ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.431+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546792095 0 0) 0x7f15681fcb00 con 0x7f15680585e0 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f15477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f15477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f15477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f15477fe640 10 monclient(hunting): my global_id is 4456 2026-02-25T15:13:04.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1534003610 con 0x7f15680585e0 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 10 client.4414.objecter checking command 1 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 20 client.4414.objecter _get_session s=0x7f20c80a0cf0 osd=2 3 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 20 client.4414.objecter put_session s=0x7f20c80a0cf0 osd=2 3 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 15 client.4414.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 20 client.4414.objecter _get_session s=0x7f20c80a0cf0 osd=2 3 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 20 client.4414.objecter get_session s=0x7f20c80a0cf0 osd=2 3 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 15 client.4414.objecter _session_command_op_assign 2 1 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 20 client.4414.objecter put_session s=0x7f20c80a0cf0 osd=2 4 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 10 client.4414.objecter _send_command 1 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.167:6808/3985671893 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20c80c2fa0 con 0x7f20c80a13a0 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 20 client.4414.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f20e805be50 con 0x7f20f8156ab0 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20f4ff9640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7fc0a2575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc0a40585e0 0x7fc0a4155960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37040/0 (socket says 10.20.193.78:37040) 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7fc0a2575640 1 -- 10.20.193.78:0/3144343708 learned_addr learned my addr 10.20.193.78:0/3144343708 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7f20fc8f9640 10 monclient: get_auth_request con 0x7f20c80a13a0 auth_method 0 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361517275 0 0) 0x7fe17c0a7f60 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7fe157fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7fe157fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7fe157fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7fe157fff640 10 monclient(hunting): my global_id is 4421 2026-02-25T15:13:04.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.432+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17c0a79e0 con 0x7fe17c1a7ac0 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.433+0000 7f20f4ff9640 10 client.4414.objecter ms_handle_connect 0x7f20c80a13a0 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.434+0000 7fc72ffff640 10 client.?.objecter ms_handle_connect 0x7fc7540ba350 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.434+0000 7fc72ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.434+0000 7fd7ee7fc640 10 client.?.objecter ms_handle_connect 0x7fd800164d00 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.434+0000 7fd7ee7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.434+0000 7fc08affd640 10 client.?.objecter ms_handle_connect 0x7fc0a40585e0 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.434+0000 7fc08affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.436+0000 7fb41dd74640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fb42015d3b0 0x7fb42015d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50794/0 (socket says 10.20.193.78:50794) 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.436+0000 7fb41dd74640 1 -- 10.20.193.78:0/2353111462 learned_addr learned my addr 10.20.193.78:0/2353111462 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.436+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319786008 0 0) 0x7f5a7c13b590 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.436+0000 7f5a5b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.436+0000 7f5a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.436+0000 7f5a5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.436+0000 7f5a5b7fe640 10 monclient(hunting): my global_id is 4450 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.436+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a7c13b2b0 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546967838 0 0) 0x7fe17c0a7c80 con 0x7fe17c0b4c30 2026-02-25T15:13:04.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fe157fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fe157fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fe157fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fe157fff640 10 monclient(hunting): my global_id is 4447 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17c0a7f60 con 0x7fe17c0b4c30 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fa662ffd640 10 client.?.objecter ms_handle_connect 0x7fa67c0ba350 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fa662ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987394101 0 0) 0x7f141c1fd3d0 con 0x7f141c0ba350 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f1409ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f1409ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f1409ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f1409ffb640 10 monclient(hunting): my global_id is 4459 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f141c1fd6b0 con 0x7f141c0ba350 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136536822 0 0) 0x7fa67c0b3de0 con 0x7fa67c0585e0 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fa662ffd640 10 monclient(hunting): my global_id is 4439 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa648003610 con 0x7fa67c0585e0 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659426541 0 0) 0x7f5a7c13b870 con 0x7f5a7c0b0630 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f5a5b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f5a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f5a5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f5a5b7fe640 10 monclient(hunting): my global_id is 4433 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a7c13b590 con 0x7f5a7c0b0630 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fd7ee7fc640 10 client.?.objecter ms_handle_connect 0x7fd800157780 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7fd7ee7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469235928 0 0) 0x7f783013bf70 con 0x7f78300b9f30 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f780f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f780f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f780f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f780f7fe640 10 monclient(hunting): my global_id is 4453 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f783013c250 con 0x7f78300b9f30 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1053193501 0 0) 0x7f7b380b1110 con 0x7f7b3815b350 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 >> v1:10.20.193.155:6789/0 conn(0x7f7b3815af80 legacy=0x7f7b380b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 >> v1:10.20.193.78:6789/0 conn(0x7f7b380b5d80 legacy=0x7f7b380b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 1 monclient: found mon.c 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b381707b0 con 0x7f7b3815b350 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.437+0000 7f7b1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 5 monclient: authenticate success, global_id 4418 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 10 monclient: _renew_subs 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7b38170a90 con 0x7f7b3815b350 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 10 client.4418.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 10 monclient: _renew_subs 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7b380b2450 con 0x7f7b3815b350 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 1 librados: init done 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fc72ffff640 10 client.?.objecter ms_handle_connect 0x7fc7540585e0 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fc72ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fb2357df640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb230058070 0x7fb230162dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37058/0 (socket says 10.20.193.78:37058) 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fb2357df640 1 -- 10.20.193.78:0/681108985 learned_addr learned my addr 10.20.193.78:0/681108985 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1470418226 0 0) 0x7f77fc003610 con 0x7f78300ba300 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f783013bf70 con 0x7f78300ba300 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7820003290 con 0x7f78300ba300 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f780f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f780f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f780f7fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.508 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fc08affd640 10 client.?.objecter ms_handle_connect 0x7fc0a40ba350 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fc08affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f780f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 10 client.4418.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 15 client.4418.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 20 client.4418.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 10 client.4418.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7b3805bbc0 con 0x7f7b3815b350 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fb406ffd640 10 client.?.objecter ms_handle_connect 0x7fb42015d3b0 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fb406ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1548196362 0 0) 0x7fd7d0003610 con 0x7fd800157b50 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8000af5f0 con 0x7fd800157b50 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd7f4003170 con 0x7fd800157b50 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fd7ee7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fd7ee7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fd7ee7fc640 10 monclient(hunting): dump: 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.509 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.438+0000 7fd7ee7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.439+0000 7fb21dffb640 10 client.?.objecter ms_handle_connect 0x7fb230058070 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.439+0000 7fb21dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.439+0000 7fc08affd640 10 client.?.objecter ms_handle_connect 0x7fc0a40b9f80 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.439+0000 7fc08affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.440+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255520396 0 0) 0x7f15681fcde0 con 0x7f15680ba350 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.440+0000 7f15477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.440+0000 7f15477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.440+0000 7f15477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.440+0000 7f15477fe640 10 monclient(hunting): my global_id is 4436 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.440+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15681fcb00 con 0x7f15680ba350 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.440+0000 7fb406ffd640 10 client.?.objecter ms_handle_connect 0x7fb4201a7ac0 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.440+0000 7fb406ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fa662ffd640 10 client.?.objecter ms_handle_connect 0x7fa67c0b9f80 2026-02-25T15:13:04.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fa662ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066258018 0 0) 0x7fd8000af310 con 0x7fd800164d00 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fd7ee7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fd7ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fd7ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fd7ee7fc640 10 monclient(hunting): my global_id is 4465 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d0003610 con 0x7fd800164d00 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.443+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 413873798 0 0) 0x7fe17c0a7f60 con 0x7fe17c0b4c30 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.444+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe17c0a7c80 con 0x7fe17c0b4c30 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.444+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe168003260 con 0x7fe17c0b4c30 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.444+0000 7fe157fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.444+0000 7fe157fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.444+0000 7fe157fff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.444+0000 7fe157fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.446+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 417720293 0 0) 0x7f783013c250 con 0x7f78300b9f30 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.446+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77fc003610 con 0x7f78300b9f30 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.446+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7818003310 con 0x7f78300b9f30 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.446+0000 7f780f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.446+0000 7f780f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.446+0000 7f780f7fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.446+0000 7fb406ffd640 10 client.?.objecter ms_handle_connect 0x7fb4200b4c30 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.446+0000 7fb406ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.448+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== osd.3 v1:10.20.193.174:6804/3507256265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6b540c2e50 con 0x7f6b540a1250 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.448+0000 7f6b71ffb640 10 client.4407.objecter ms_dispatch2 0x7f6b84000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.448+0000 7f6b71ffb640 10 client.4407.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.448+0000 7f6b71ffb640 20 client.4407.objecter put_session s=0x7f6b540a0ba0 osd=3 4 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.448+0000 7f6b71ffb640 15 client.4407.objecter _session_command_op_remove 3 1 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f9b5bfff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9b64159a70 0x7f9b6413bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37056/0 (socket says 10.20.193.78:37056) 2026-02-25T15:13:04.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f9b5bfff640 1 -- 10.20.193.78:0/366159292 learned_addr learned my addr 10.20.193.78:0/366159292 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093555881 0 0) 0x7fc0a4156070 con 0x7fc0a40585e0 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fc08affd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fc08affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fc08affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fc08affd640 10 monclient(hunting): my global_id is 4443 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc070003610 con 0x7fc0a40585e0 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751461156 0 0) 0x7f1568163e90 con 0x7f15680b9f80 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f15477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f15477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f15477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f15477fe640 10 monclient(hunting): my global_id is 4437 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15681fcde0 con 0x7f15680b9f80 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f9b597fa640 10 client.?.objecter ms_handle_connect 0x7f9b64159a70 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7f9b597fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408696901 0 0) 0x7fb2300b35f0 con 0x7fb230058070 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fb21dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fb21dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fb21dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fb21dffb640 10 monclient(hunting): my global_id is 4452 2026-02-25T15:13:04.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.450+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb200003610 con 0x7fb230058070 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828219014 0 0) 0x7fd8000abc80 con 0x7fd800157780 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fd7ee7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fd7ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fd7ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fd7ee7fc640 10 monclient(hunting): my global_id is 4446 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8000af310 con 0x7fd800157780 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129743698 0 0) 0x7fb4200ad1f0 con 0x7fb4201a7ac0 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fb406ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fb406ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fb406ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fb406ffd640 10 monclient(hunting): my global_id is 4455 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3ec003610 con 0x7fb4201a7ac0 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 327379950 0 0) 0x7fe14c003610 con 0x7fe17c15d3b0 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe17c0a7f60 con 0x7fe17c15d3b0 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe16c0030b0 con 0x7fe17c15d3b0 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fe157fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fe157fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7fe157fff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.514 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1208003340 con 0x7f12140585e0 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7f12127fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7f12127fc640 1 -- 10.20.193.78:0/2166014419 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1208003780 con 0x7f12140585e0 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7f12127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7f12127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7f12127fc640 10 monclient: dump: 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7f1219cfb640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.451+0000 7f1219cfb640 4 set_mon_vals no callback set 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 10 monclient: shutdown 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 1 -- 10.20.193.78:0/2166014419 >> v1:10.20.193.167:6789/0 conn(0x7f12140585e0 legacy=0x7f1214166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 1 -- 10.20.193.78:0/2166014419 shutdown_connections 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 1 -- 10.20.193.78:0/2166014419 >> 10.20.193.78:0/2166014419 conn(0x7f12140b7990 msgr2=0x7f12140b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 1 -- 10.20.193.78:0/2166014419 shutdown_connections 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 1 -- 10.20.193.78:0/2166014419 wait complete. 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.452+0000 7f1219cfb640 10 monclient: monmap: 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 librados: starting msgr at 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 librados: starting objecter 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 Processor -- start 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 -- start start 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 librados: setting wanted keys 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 librados: calling monclient init 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 10 monclient: init 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3087757428 0 0) 0x7fa648003610 con 0x7fa67c0585e0 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa67c0b3de0 con 0x7fa67c0585e0 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa670003060 con 0x7fa67c0585e0 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fa662ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fa662ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fa662ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.516 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fa662ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 10 monclient(hunting): picked mon.noname-b con 0x7f12140585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 10 monclient(hunting): picked mon.noname-c con 0x7f12140b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 10 monclient(hunting): picked mon.noname-a con 0x7f12140ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1214159ea0 con 0x7f12140ba350 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12141fb450 con 0x7f12140585e0 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12141fb730 con 0x7f12140b9f80 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7f1219cfb640 10 monclient(hunting): authenticate will time out at 3354.042660s 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030339832 0 0) 0x7fc754166170 con 0x7fc7540b9f80 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc72ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc72ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc72ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc72ffff640 10 monclient(hunting): my global_id is 4442 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc724003610 con 0x7fc7540b9f80 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674645309 0 0) 0x7fc0a415efa0 con 0x7fc0a40ba350 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc08affd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc08affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc08affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc08affd640 10 monclient(hunting): my global_id is 4445 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.453+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a4156070 con 0x7fc0a40ba350 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== osd.2 v1:10.20.193.167:6808/3985671893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f20c80c2fa0 con 0x7f20c80a13a0 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f20f4ff9640 10 client.4414.objecter ms_dispatch2 0x7f20f8000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f20f4ff9640 10 client.4414.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f20f4ff9640 20 client.4414.objecter put_session s=0x7f20c80a0cf0 osd=2 4 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f20f4ff9640 15 client.4414.objecter _session_command_op_remove 2 1 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2469641835 0 0) 0x7f5a48003610 con 0x7f5a7c15b050 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a7c13b870 con 0x7f5a7c15b050 2026-02-25T15:13:04.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5a6c003250 con 0x7f5a7c15b050 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202187268 0 0) 0x7f783013bc90 con 0x7f78300b7110 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f780f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f780f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f780f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f780f7fe640 10 monclient(hunting): my global_id is 4434 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f783013c250 con 0x7f78300b7110 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 131395325 0 0) 0x7f5a7c13b2b0 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a48003610 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5a64003310 con 0x7f5a7c0b0a00 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.454+0000 7f5a5b7fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.519 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154594279 0 0) 0x7f141c1fd0f0 con 0x7f141c0585e0 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f1409ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f1409ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f1409ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f1409ffb640 10 monclient(hunting): my global_id is 4440 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f141c1fd3d0 con 0x7f141c0585e0 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276254327 0 0) 0x7fc754165ee0 con 0x7fc7540585e0 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 10 monclient(hunting): my global_id is 4449 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc754166170 con 0x7fc7540585e0 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 10 client.4407.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 15 client.4407.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 20 client.4407.objecter _get_session s=0x7f6b540a0ba0 osd=3 3 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 20 client.4407.objecter put_session s=0x7f6b540a0ba0 osd=3 3 2026-02-25T15:13:04.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 20 client.4407.objecter _get_session s=0x7f6b540a0ba0 osd=3 3 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 15 client.4407.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 20 client.4407.objecter get_session s=0x7f6b540a0ba0 osd=3 3 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 15 client.4407.objecter _session_command_op_assign 3 2 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 20 client.4407.objecter put_session s=0x7f6b540a0ba0 osd=3 4 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 10 client.4407.objecter _send_command 2 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 --> v1:10.20.193.174:6804/3507256265 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b840b8e90 con 0x7f6b540a1250 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3948685913 0 0) 0x7fc754156d30 con 0x7fc7540ba350 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 10 monclient(hunting): my global_id is 4462 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.455+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc754165ee0 con 0x7fc7540ba350 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.456+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1976774291 0 0) 0x7fc070003610 con 0x7fc0a40585e0 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.456+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0a415efa0 con 0x7fc0a40585e0 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.456+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc098002d00 con 0x7fc0a40585e0 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.456+0000 7fc08affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.456+0000 7fc08affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.456+0000 7fc08affd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.456+0000 7fc08affd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7f9b597fa640 10 client.?.objecter ms_handle_connect 0x7f9b64058070 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7f9b597fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644850337 0 0) 0x7fa67c0b3b00 con 0x7fa67c0ba350 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 10 monclient(hunting): my global_id is 4468 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa648003610 con 0x7fa67c0ba350 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fb21dffb640 10 client.?.objecter ms_handle_connect 0x7fb230159a70 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fb21dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757312287 0 0) 0x7fa67c0b2bf0 con 0x7fa67c0b9f80 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 10 monclient(hunting): my global_id is 4458 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c0b3b00 con 0x7fa67c0b9f80 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873909687 0 0) 0x7fc0a41fc0c0 con 0x7fc0a40b9f80 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fc08affd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fc08affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fc08affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fc08affd640 10 monclient(hunting): my global_id is 4471 2026-02-25T15:13:04.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.457+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc070003610 con 0x7fc0a40b9f80 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b71ffb640 1 -- 10.20.193.78:0/4235849377 <== osd.3 v1:10.20.193.174:6804/3507256265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7f6b840b8e90 con 0x7f6b540a1250 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b71ffb640 10 client.4407.objecter ms_dispatch2 0x7f6b84000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b71ffb640 10 client.4407.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b71ffb640 20 client.4407.objecter put_session s=0x7f6b540a0ba0 osd=3 4 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b71ffb640 15 client.4407.objecter _session_command_op_remove 3 2 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3301073026 0 0) 0x7f1534003610 con 0x7f15680585e0 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1568163e90 con 0x7f15680585e0 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f155c003190 con 0x7f15680585e0 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f15477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f15477fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f15477fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.523 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f15477fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 10 librados: watch_flush enter 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 10 librados: watch_flush exit 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 10 client.4407.objecter close_session for osd.3 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 >> v1:10.20.193.174:6804/3507256265 conn(0x7f6b540a1250 legacy=0x7f6b540c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 20 client.4407.objecter put_session s=0x7f6b540a0ba0 osd=3 1 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 20 client.4407.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 10 client.4407.objecter successfully canceled tick 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161324376 0 0) 0x7fb4200acf20 con 0x7fb4200b4c30 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7fb406ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7fb406ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7fb406ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7fb406ffd640 10 monclient(hunting): my global_id is 4474 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4200ad1f0 con 0x7fb4200b4c30 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6b54077d20 legacy=0x7f6b540981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.458+0000 7f6b8b66e640 10 monclient: shutdown 2026-02-25T15:13:04.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f6b8b66e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 >> v1:10.20.193.78:6789/0 conn(0x7f6b840b9f80 legacy=0x7f6b841fc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f6b89be4640 1 -- 10.20.193.78:0/4235849377 reap_dead start 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 shutdown_connections 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 >> 10.20.193.78:0/4235849377 conn(0x7f6b840b7990 msgr2=0x7f6b8415bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 shutdown_connections 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f6b8b66e640 1 -- 10.20.193.78:0/4235849377 wait complete. 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f6b8b66e640 1 librados: shutdown 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 892356419 0 0) 0x7f141c1fd6b0 con 0x7f141c0ba350 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f141c1fd0f0 con 0x7f141c0ba350 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1418003360 con 0x7f141c0ba350 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f1409ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f1409ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f1409ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7f1409ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2901946067 0 0) 0x7fd7d0003610 con 0x7fd800164d00 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8000abc80 con 0x7fd800164d00 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd7fc003750 con 0x7fd800164d00 2026-02-25T15:13:04.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7fd7ee7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7fd7ee7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.459+0000 7fd7ee7fc640 10 monclient(hunting): dump: 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 211163905 0 0) 0x7fe17c0a7c80 con 0x7fe17c0b4c30 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 >> v1:10.20.193.167:6789/0 conn(0x7fe17c1a7ac0 legacy=0x7fe17c162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 >> v1:10.20.193.78:6789/0 conn(0x7fe17c15d3b0 legacy=0x7fe17c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 1 monclient: found mon.b 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c0a8240 con 0x7fe17c0b4c30 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe157fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 5 monclient: authenticate success, global_id 4447 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 10 monclient: _renew_subs 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe17c0a8520 con 0x7fe17c0b4c30 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 10 client.4447.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 10 monclient: _renew_subs 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe17c0a9430 con 0x7fe17c0b4c30 2026-02-25T15:13:04.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 1 librados: init done 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b3805bbc0 con 0x7f7b3815b350 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7f7b1effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7b34004df0 con 0x7f7b3815b350 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7f7b1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7f7b1effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7f7b3cd3a640 4 set_mon_vals no callback set 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7f7b1effd640 10 monclient: dump: 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2403735163 0 0) 0x7fb420126bc0 con 0x7fb42015d3b0 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fb406ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fb406ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fb406ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fb406ffd640 10 monclient(hunting): my global_id is 4448 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4200acf20 con 0x7fb42015d3b0 2026-02-25T15:13:04.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 10 client.4447.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 15 client.4447.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 20 client.4447.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 10 client.4447.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.460+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe17c0531e0 con 0x7fe17c0b4c30 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f7b34004fd0 con 0x7f7b3815b350 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f7b3e53d640 10 monclient: get_auth_request con 0x7f7b08077cc0 auth_method 0 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f7b1effd640 10 client.4418.objecter ms_handle_connect 0x7f7b08077cc0 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 10 client.4414.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 15 client.4414.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 20 client.4414.objecter _get_session s=0x7f20c80a0cf0 osd=2 3 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 20 client.4414.objecter put_session s=0x7f20c80a0cf0 osd=2 3 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 20 client.4414.objecter _get_session s=0x7f20c80a0cf0 osd=2 3 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 15 client.4414.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 20 client.4414.objecter get_session s=0x7f20c80a0cf0 osd=2 3 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 15 client.4414.objecter _session_command_op_assign 2 2 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 20 client.4414.objecter put_session s=0x7f20c80a0cf0 osd=2 4 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 10 client.4414.objecter _send_command 2 2026-02-25T15:13:04.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.461+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 --> v1:10.20.193.167:6808/3985671893 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20f815a520 con 0x7f20c80a13a0 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f7b34093580 con 0x7f7b3815b350 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 10 client.4418.objecter ms_dispatch2 0x7f7b38000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 3 client.4418.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 3 client.4418.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 10 client.4418.objecter checking command 1 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 20 client.4418.objecter _get_session s=0x7f7b080a0ba0 osd=12 3 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 20 client.4418.objecter put_session s=0x7f7b080a0ba0 osd=12 3 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 15 client.4418.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 20 client.4418.objecter _get_session s=0x7f7b080a0ba0 osd=12 3 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 20 client.4418.objecter get_session s=0x7f7b080a0ba0 osd=12 3 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 15 client.4418.objecter _session_command_op_assign 12 1 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 20 client.4418.objecter put_session s=0x7f7b080a0ba0 osd=12 4 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 10 client.4418.objecter _send_command 1 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.78:6809/3800864779 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b080c2e50 con 0x7f7b080a1250 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 20 client.4418.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b3dd3c640 10 monclient: get_auth_request con 0x7f7b080a1250 auth_method 0 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f7b34059c20 con 0x7f7b3815b350 2026-02-25T15:13:04.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.462+0000 7f7b1effd640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2336073417 0 0) 0x7f783013bf70 con 0x7f78300ba300 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 >> v1:10.20.193.155:6789/0 conn(0x7f78300b9f30 legacy=0x7f783016a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 >> v1:10.20.193.78:6789/0 conn(0x7f78300b7110 legacy=0x7f7830148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 1 monclient: found mon.c 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78300ae9b0 con 0x7f78300ba300 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f780f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 5 monclient: authenticate success, global_id 4424 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 10 monclient: _renew_subs 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78300b14a0 con 0x7f78300ba300 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f9b597fa640 10 client.?.objecter ms_handle_connect 0x7f9b64159e40 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f9b597fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 10 client.4424.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 10 monclient: _renew_subs 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f783013b790 con 0x7f78300ba300 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 1 librados: init done 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 10 client.4424.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 15 client.4424.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 20 client.4424.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 10 client.4424.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f783016b9d0 con 0x7f78300ba300 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.463+0000 7f7b1effd640 10 client.4418.objecter ms_handle_connect 0x7f7b080a1250 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20f4ff9640 1 -- 10.20.193.78:0/1731020707 <== osd.2 v1:10.20.193.167:6808/3985671893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f20f815a520 con 0x7f20c80a13a0 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20f4ff9640 10 client.4414.objecter ms_dispatch2 0x7f20f8000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20f4ff9640 10 client.4414.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20f4ff9640 20 client.4414.objecter put_session s=0x7f20c80a0cf0 osd=2 4 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20f4ff9640 15 client.4414.objecter _session_command_op_remove 2 2 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 10 librados: watch_flush enter 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 10 librados: watch_flush exit 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 10 client.4414.objecter close_session for osd.2 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 >> v1:10.20.193.167:6808/3985671893 conn(0x7f20c80a13a0 legacy=0x7f20c80c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 20 client.4414.objecter put_session s=0x7f20c80a0cf0 osd=2 1 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 20 client.4414.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 10 client.4414.objecter successfully canceled tick 2026-02-25T15:13:04.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 >> v1:10.20.193.78:6800/3497602169 conn(0x7f20c8077e70 legacy=0x7f20c8098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 10 monclient: shutdown 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 >> v1:10.20.193.155:6789/0 conn(0x7f20f8156ab0 legacy=0x7f20f8126460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fc8f9640 1 -- 10.20.193.78:0/1731020707 reap_dead start 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 shutdown_connections 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 >> 10.20.193.78:0/1731020707 conn(0x7f20f80b2ef0 msgr2=0x7f20f80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 shutdown_connections 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 1 -- 10.20.193.78:0/1731020707 wait complete. 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.464+0000 7f20fe383640 1 librados: shutdown 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.465+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1639434162 0 0) 0x7fb200003610 con 0x7fb230058070 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.465+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2300b35f0 con 0x7fb230058070 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.465+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb2200032f0 con 0x7fb230058070 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.465+0000 7fb21dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.465+0000 7fb21dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.465+0000 7fb21dffb640 10 monclient(hunting): dump: 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.465+0000 7fb21dffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.533 INFO:teuthology.orchestra.run.trial078.stdout:94489280517 2026-02-25T15:13:04.533 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T15:13:04.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.469+0000 7f1213fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f12140ba350 0x7f1214160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37068/0 (socket says 10.20.193.78:37068) 2026-02-25T15:13:04.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.469+0000 7f1213fff640 1 -- 10.20.193.78:0/840803162 learned_addr learned my addr 10.20.193.78:0/840803162 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.469+0000 7f11effff640 10 client.?.objecter ms_handle_connect 0x7f12140ba350 2026-02-25T15:13:04.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.469+0000 7f11effff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.533 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fb21dffb640 10 client.?.objecter ms_handle_connect 0x7fb230159e40 2026-02-25T15:13:04.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fb21dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.534 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1729023942 0 0) 0x7fd8000af5f0 con 0x7fd800157b50 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 >> v1:10.20.193.155:6789/0 conn(0x7fd800164d00 legacy=0x7fd8001feb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 >> v1:10.20.193.78:6789/0 conn(0x7fd800157780 legacy=0x7fd8001fc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 1 monclient: found mon.c 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8000af8d0 con 0x7fd800157b50 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd7ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 658353356 0 0) 0x7f15681fcde0 con 0x7f15680b9f80 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1534003610 con 0x7f15680b9f80 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 5 monclient: authenticate success, global_id 4430 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 10 monclient: _renew_subs 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd8000afbb0 con 0x7fd800157b50 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1550003180 con 0x7f15680b9f80 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7f15477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7f15477fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7f15477fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 10 client.4430.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 10 monclient: _renew_subs 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd8000b0170 con 0x7fd800157b50 2026-02-25T15:13:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 1 librados: init done 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3782855120 0 0) 0x7fa67c0b3de0 con 0x7fa67c0585e0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 >> v1:10.20.193.155:6789/0 conn(0x7fa67c0ba350 legacy=0x7fa67c0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 >> v1:10.20.193.78:6789/0 conn(0x7fa67c0b9f80 legacy=0x7fa67c165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 1 monclient: found mon.c 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0b40c0 con 0x7fa67c0585e0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa662ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 5 monclient: authenticate success, global_id 4439 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 10 monclient: _renew_subs 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c0b43a0 con 0x7fa67c0585e0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 10 client.4439.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 10 monclient: _renew_subs 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa67c1630e0 con 0x7fa67c0585e0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fa680c46640 1 librados: init done 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 10 client.4430.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 15 client.4430.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 20 client.4430.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 10 client.4430.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.473+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd800165700 con 0x7fd800157b50 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1297665270 0 0) 0x7f5a7c13b590 con 0x7f5a7c0b0630 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a7c13b2b0 con 0x7f5a7c0b0630 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5a70003090 con 0x7f5a7c0b0630 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7f5a5b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7f5a5b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7f5a5b7fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7fa680c46640 10 client.4439.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7fa680c46640 15 client.4439.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7fa680c46640 20 client.4439.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7fa680c46640 10 client.4439.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7fa680c46640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.474+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa67c0b64c0 con 0x7fa67c0585e0 2026-02-25T15:13:04.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.477+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4112787326 0 0) 0x7fb3ec003610 con 0x7fb4201a7ac0 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.477+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb420126bc0 con 0x7fb4201a7ac0 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.477+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb410003330 con 0x7fb4201a7ac0 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.477+0000 7fb406ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.477+0000 7fb406ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.477+0000 7fb406ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.477+0000 7fb406ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3385967466 0 0) 0x7f5a7c13b870 con 0x7f5a7c15b050 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 >> v1:10.20.193.167:6789/0 conn(0x7f5a7c0b0630 legacy=0x7f5a7c160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 >> v1:10.20.193.155:6789/0 conn(0x7f5a7c0b0a00 legacy=0x7f5a7c1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 1 monclient: found mon.a 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c13bb50 con 0x7f5a7c15b050 2026-02-25T15:13:04.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 5 monclient: authenticate success, global_id 4431 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 10 monclient: _renew_subs 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c13be30 con 0x7f5a7c15b050 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 10 client.4431.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 10 monclient: _renew_subs 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a7c159bf0 con 0x7f5a7c15b050 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 1 librados: init done 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 10 client.4431.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 15 client.4431.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 20 client.4431.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f783016b9d0 con 0x7f78300ba300 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f780f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7820004c50 con 0x7f78300ba300 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f780f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f780f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f780f7fe640 10 monclient: dump: 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.539 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 10 client.4431.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5a7c13c630 con 0x7f5a7c15b050 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f782d7fa640 4 set_mon_vals no callback set 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2153085982 0 0) 0x7fc754165ee0 con 0x7fc7540ba350 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc754156d30 con 0x7fc7540ba350 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.479+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2867467360 0 0) 0x7f15681fcb00 con 0x7f15680ba350 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc748003400 con 0x7fc7540ba350 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fc72ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fc72ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fc72ffff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fc72ffff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15681fcde0 con 0x7f15680ba350 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f15580034f0 con 0x7f15680ba350 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7f15477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7f15477fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7f15477fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 729673432 0 0) 0x7fb2300b38d0 con 0x7fb230159a70 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fb21dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fb21dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fb21dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fb21dffb640 10 monclient(hunting): my global_id is 4480 2026-02-25T15:13:04.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb200003610 con 0x7fb230159a70 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.480+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f782001dac0 con 0x7f78300ba300 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.481+0000 7f782effd640 10 monclient: get_auth_request con 0x7f77fc077ec0 auth_method 0 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.481+0000 7f780f7fe640 10 client.4424.objecter ms_handle_connect 0x7f77fc077ec0 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.481+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1118720832 0 0) 0x7fc070003610 con 0x7fc0a40b9f80 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.481+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0a41fc0c0 con 0x7fc0a40b9f80 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.481+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc08c003190 con 0x7fc0a40b9f80 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.481+0000 7fc08affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.481+0000 7fc08affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.481+0000 7fc08affd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f7820093420 con 0x7f78300ba300 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 10 client.4424.objecter ms_dispatch2 0x7f7830000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 3 client.4424.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 3 client.4424.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2402730542 0 0) 0x7f1568163e90 con 0x7f15680585e0 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 >> v1:10.20.193.167:6789/0 conn(0x7f15680ba350 legacy=0x7f15680b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 >> v1:10.20.193.78:6789/0 conn(0x7f15680b9f80 legacy=0x7f1568155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 1 monclient: found mon.b 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15681fd0c0 con 0x7f15680585e0 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f15477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 10 client.4424.objecter checking command 1 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 5 monclient: authenticate success, global_id 4456 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 10 monclient: _renew_subs 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15681fd3a0 con 0x7f15680585e0 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 20 client.4424.objecter _get_session s=0x7f77fc0a0d40 osd=1 3 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 20 client.4424.objecter put_session s=0x7f77fc0a0d40 osd=1 3 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 15 client.4424.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 20 client.4424.objecter _get_session s=0x7f77fc0a0d40 osd=1 3 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 20 client.4424.objecter get_session s=0x7f77fc0a0d40 osd=1 3 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 15 client.4424.objecter _session_command_op_assign 1 1 2026-02-25T15:13:04.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 20 client.4424.objecter put_session s=0x7f77fc0a0d40 osd=1 4 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 10 client.4424.objecter _send_command 1 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.155:6812/2301996681 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78200038b0 con 0x7f77fc0a13f0 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 20 client.4424.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 10 monclient: _renew_subs 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f15681fd960 con 0x7f15680585e0 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f156d72e640 1 librados: init done 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f7820059ac0 con 0x7f78300ba300 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.482+0000 7f780f7fe640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7f782e7fc640 10 monclient: get_auth_request con 0x7f77fc0a13f0 auth_method 0 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7f156d72e640 10 client.4456.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7f156d72e640 15 client.4456.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7f156d72e640 20 client.4456.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7f156d72e640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7f156d72e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f156813bfb0 con 0x7f15680585e0 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 163654724 0 0) 0x7fc0a415efa0 con 0x7fc0a40585e0 2026-02-25T15:13:04.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 >> v1:10.20.193.167:6789/0 conn(0x7fc0a40ba350 legacy=0x7fc0a413a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 >> v1:10.20.193.155:6789/0 conn(0x7fc0a40b9f80 legacy=0x7fc0a415fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 1 monclient: found mon.a 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a415f280 con 0x7fc0a40585e0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc08affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 5 monclient: authenticate success, global_id 4443 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 10 monclient: _renew_subs 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a415f560 con 0x7fc0a40585e0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 10 monclient: _renew_subs 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0a415ec50 con 0x7fc0a40585e0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.483+0000 7fc0a8f02640 1 librados: init done 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f780f7fe640 10 client.4424.objecter ms_handle_connect 0x7f77fc0a13f0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7fc0a8f02640 10 client.4443.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7fc0a8f02640 15 client.4443.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7fc0a8f02640 20 client.4443.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7fc0a8f02640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7fc0a8f02640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc0a4166600 con 0x7fc0a40585e0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== osd.12 v1:10.20.193.78:6809/3800864779 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f7b080c2e50 con 0x7f7b080a1250 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f7b1effd640 10 client.4418.objecter ms_dispatch2 0x7f7b38000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f7b1effd640 10 client.4418.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f7b1effd640 20 client.4418.objecter put_session s=0x7f7b080a0ba0 osd=12 4 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f7b1effd640 15 client.4418.objecter _session_command_op_remove 12 1 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808530710 0 0) 0x7f9b6415b940 con 0x7f9b64159a70 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f9b597fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f9b597fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f9b597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.484+0000 7f9b597fa640 10 monclient(hunting): my global_id is 4461 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.485+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b34003610 con 0x7f9b64159a70 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.485+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727065764 0 0) 0x7f1214159ea0 con 0x7f12140ba350 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.485+0000 7f11effff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.485+0000 7f11effff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.485+0000 7f11effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.485+0000 7f11effff640 10 monclient(hunting): my global_id is 4464 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.485+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11e4003610 con 0x7f12140ba350 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe17c0531e0 con 0x7fe17c0b4c30 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fe157fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1680039b0 con 0x7fe17c0b4c30 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fe157fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fe157fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fe157fff640 10 monclient: dump: 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fe179ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2992382502 0 0) 0x7fb2300b35f0 con 0x7fb230058070 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 >> v1:10.20.193.167:6789/0 conn(0x7fb230159e40 legacy=0x7fb2300b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 >> v1:10.20.193.155:6789/0 conn(0x7fb230159a70 legacy=0x7fb23015f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 1 monclient: found mon.a 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2300b3e90 con 0x7fb230058070 2026-02-25T15:13:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb21dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 5 monclient: authenticate success, global_id 4452 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 10 monclient: _renew_subs 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2300b4170 con 0x7fb230058070 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 10 client.4452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 10 monclient: _renew_subs 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2300b3350 con 0x7fb230058070 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.486+0000 7fb237a6a640 1 librados: init done 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1424765460 0 0) 0x7f141c1fd3d0 con 0x7f141c0585e0 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f141c1fd6b0 con 0x7f141c0585e0 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f140c0030b0 con 0x7f141c0585e0 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7f1409ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7f1409ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7f1409ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7fb237a6a640 10 client.4452.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7fb237a6a640 15 client.4452.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7fb237a6a640 20 client.4452.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7fb237a6a640 10 client.4452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7fb237a6a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb2300b7ed0 con 0x7fb230058070 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.487+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fe168003bc0 con 0x7fe17c0b4c30 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe17affd640 10 monclient: get_auth_request con 0x7fe14c077ce0 auth_method 0 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 10 client.4447.objecter ms_handle_connect 0x7fe14c077ce0 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fe168093200 con 0x7fe17c0b4c30 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 10 client.4447.objecter ms_dispatch2 0x7fe17c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 3 client.4447.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 3 client.4447.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 10 client.4447.objecter checking command 1 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 20 client.4447.objecter _get_session s=0x7fe14c0a0b60 osd=11 3 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 20 client.4447.objecter put_session s=0x7fe14c0a0b60 osd=11 3 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 15 client.4447.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 20 client.4447.objecter _get_session s=0x7fe14c0a0b60 osd=11 3 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 20 client.4447.objecter get_session s=0x7fe14c0a0b60 osd=11 3 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 15 client.4447.objecter _session_command_op_assign 11 1 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 20 client.4447.objecter put_session s=0x7fe14c0a0b60 osd=11 4 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 10 client.4447.objecter _send_command 1 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.174:6800/1887691036 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe14c0c2e10 con 0x7fe14c0a1210 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 20 client.4447.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fe1680598a0 con 0x7fe17c0b4c30 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7fe157fff640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271501435 0 0) 0x7f9b64162400 con 0x7f9b64058070 2026-02-25T15:13:04.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7f9b597fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7f9b597fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7f9b597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7f9b597fa640 10 monclient(hunting): my global_id is 4477 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.488+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b6415b940 con 0x7f9b64058070 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.489+0000 7fe17bfff640 10 monclient: get_auth_request con 0x7fe14c0a1210 auth_method 0 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.489+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 198602857 0 0) 0x7fc754166170 con 0x7fc7540585e0 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.489+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc754165ee0 con 0x7fc7540585e0 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.489+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc740002d30 con 0x7fc7540585e0 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.489+0000 7fc72ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.489+0000 7fc72ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.489+0000 7fc72ffff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.490+0000 7fe157fff640 10 client.4447.objecter ms_handle_connect 0x7fe14c0a1210 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.491+0000 7f11effff640 10 client.?.objecter ms_handle_connect 0x7f12140585e0 2026-02-25T15:13:04.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.491+0000 7f11effff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2216631936 0 0) 0x7f13ec003610 con 0x7f141c0b9f80 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f141c1fd3d0 con 0x7f141c0b9f80 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1410003350 con 0x7f141c0b9f80 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f1409ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f1409ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f1409ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 10 client.4418.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 15 client.4418.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 20 client.4418.objecter _get_session s=0x7f7b080a0ba0 osd=12 3 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 20 client.4418.objecter put_session s=0x7f7b080a0ba0 osd=12 3 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 20 client.4418.objecter _get_session s=0x7f7b080a0ba0 osd=12 3 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 15 client.4418.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 20 client.4418.objecter get_session s=0x7f7b080a0ba0 osd=12 3 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 15 client.4418.objecter _session_command_op_assign 12 2 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 20 client.4418.objecter put_session s=0x7f7b080a0ba0 osd=12 4 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 10 client.4418.objecter _send_command 2 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.492+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 --> v1:10.20.193.78:6809/3800864779 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b3815ee50 con 0x7f7b080a1250 2026-02-25T15:13:04.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.493+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535252460 0 0) 0x7f9b641faff0 con 0x7f9b64159e40 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.493+0000 7f9b597fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.493+0000 7f9b597fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.493+0000 7f9b597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.493+0000 7f9b597fa640 10 monclient(hunting): my global_id is 4451 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.493+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b64162400 con 0x7f9b64159e40 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.495+0000 7f7b1effd640 1 -- 10.20.193.78:0/889199527 <== osd.12 v1:10.20.193.78:6809/3800864779 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f7b3815ee50 con 0x7f7b080a1250 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.495+0000 7f7b1effd640 10 client.4418.objecter ms_dispatch2 0x7f7b38000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.495+0000 7f7b1effd640 10 client.4418.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.495+0000 7f7b1effd640 20 client.4418.objecter put_session s=0x7f7b080a0ba0 osd=12 4 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.495+0000 7f7b1effd640 15 client.4418.objecter _session_command_op_remove 12 2 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.495+0000 7f7b407c8640 10 librados: watch_flush enter 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.495+0000 7f7b407c8640 10 librados: watch_flush exit 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 10 client.4418.objecter close_session for osd.12 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 >> v1:10.20.193.78:6809/3800864779 conn(0x7f7b080a1250 legacy=0x7f7b080c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 20 client.4418.objecter put_session s=0x7f7b080a0ba0 osd=12 1 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 20 client.4418.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 10 client.4418.objecter successfully canceled tick 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7b08077cc0 legacy=0x7f7b08098170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 10 monclient: shutdown 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 >> v1:10.20.193.167:6789/0 conn(0x7f7b3815b350 legacy=0x7f7b38163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b3ed3e640 1 -- 10.20.193.78:0/889199527 reap_dead start 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 shutdown_connections 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 >> 10.20.193.78:0/889199527 conn(0x7f7b380b5270 msgr2=0x7f7b381618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 shutdown_connections 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 1 -- 10.20.193.78:0/889199527 wait complete. 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7f7b407c8640 1 librados: shutdown 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2119053301 0 0) 0x7fb420126bc0 con 0x7fb4201a7ac0 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 >> v1:10.20.193.167:6789/0 conn(0x7fb42015d3b0 legacy=0x7fb42015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 >> v1:10.20.193.155:6789/0 conn(0x7fb4200b4c30 legacy=0x7fb4200ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 1 monclient: found mon.a 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb420126ea0 con 0x7fb4201a7ac0 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb406ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 5 monclient: authenticate success, global_id 4455 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 10 monclient: _renew_subs 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb420127180 con 0x7fb4201a7ac0 2026-02-25T15:13:04.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 10 client.4455.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 10 monclient: _renew_subs 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb420127740 con 0x7fb4201a7ac0 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.496+0000 7fb424e46640 1 librados: init done 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fb424e46640 10 client.4455.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fb424e46640 15 client.4455.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fb424e46640 20 client.4455.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fb424e46640 10 client.4455.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fb424e46640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb4200531e0 con 0x7fb4201a7ac0 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd800165700 con 0x7fd800157b50 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fd7ee7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd7f40039b0 con 0x7fd800157b50 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fd7ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fd7ee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fd7ee7fc640 10 monclient: dump: 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.497+0000 7fd7effff640 4 set_mon_vals no callback set 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.498+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fd7f4003bc0 con 0x7fd800157b50 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.498+0000 7fd805b07640 10 monclient: get_auth_request con 0x7fd7d0077e60 auth_method 0 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.499+0000 7fd7ee7fc640 10 client.4430.objecter ms_handle_connect 0x7fd7d0077e60 2026-02-25T15:13:04.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fd7f4093200 con 0x7fd800157b50 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 10 client.4430.objecter ms_dispatch2 0x7fd800000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 3 client.4430.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 3 client.4430.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.555 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 10 client.4430.objecter checking command 1 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 20 client.4430.objecter _get_session s=0x7fd7d00a0d40 osd=5 3 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 20 client.4430.objecter put_session s=0x7fd7d00a0d40 osd=5 3 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 15 client.4430.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 20 client.4430.objecter _get_session s=0x7fd7d00a0d40 osd=5 3 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 20 client.4430.objecter get_session s=0x7fd7d00a0d40 osd=5 3 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 15 client.4430.objecter _session_command_op_assign 5 1 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 20 client.4430.objecter put_session s=0x7fd7d00a0d40 osd=5 4 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 10 client.4430.objecter _send_command 1 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.155:6804/3530698425 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7d00c2ff0 con 0x7fd7d00a13f0 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 20 client.4430.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fd7f40598a0 con 0x7fd800157b50 2026-02-25T15:13:04.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.503+0000 7fd7ee7fc640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1380235272 0 0) 0x7fc724003610 con 0x7fc7540b9f80 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc754166170 con 0x7fc7540b9f80 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc7440030f0 con 0x7fc7540b9f80 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7fc72ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7fd806308640 10 monclient: get_auth_request con 0x7fd7d00a13f0 auth_method 0 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7fc72ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7fc72ffff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== osd.1 v1:10.20.193.155:6812/2301996681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f78200038b0 con 0x7f77fc0a13f0 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7f780f7fe640 10 client.4424.objecter ms_dispatch2 0x7f7830000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7f780f7fe640 10 client.4424.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7f780f7fe640 20 client.4424.objecter put_session s=0x7f77fc0a0d40 osd=1 4 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.504+0000 7f780f7fe640 15 client.4424.objecter _session_command_op_remove 1 1 2026-02-25T15:13:04.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.505+0000 7fd7ee7fc640 10 client.4430.objecter ms_handle_connect 0x7fd7d00a13f0 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1544196678 0 0) 0x7fc754156d30 con 0x7fc7540ba350 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 >> v1:10.20.193.167:6789/0 conn(0x7fc7540b9f80 legacy=0x7fc754156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 >> v1:10.20.193.78:6789/0 conn(0x7fc7540585e0 legacy=0x7fc7541657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 1 monclient: found mon.b 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc754166450 con 0x7fc7540ba350 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc72ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 5 monclient: authenticate success, global_id 4462 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 10 monclient: _renew_subs 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc7541fb2e0 con 0x7fc7540ba350 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 10 monclient: _renew_subs 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc7541fb8a0 con 0x7fc7540ba350 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 1 librados: init done 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 10 client.4462.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 15 client.4462.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 20 client.4462.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.506+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc7540b96a0 con 0x7fc7540ba350 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.507+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3935248769 0 0) 0x7f9b34003610 con 0x7f9b64159a70 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.507+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b641faff0 con 0x7f9b64159a70 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.507+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9b4c003140 con 0x7f9b64159a70 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.507+0000 7f9b597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.507+0000 7f9b597fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.507+0000 7f9b597fa640 10 monclient(hunting): dump: 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.507+0000 7f9b597fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f11effff640 10 client.?.objecter ms_handle_connect 0x7f12140b9f80 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f11effff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2750281074 0 0) 0x7f141c1fd6b0 con 0x7f141c0585e0 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 >> v1:10.20.193.167:6789/0 conn(0x7f141c0b9f80 legacy=0x7f141c1f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 >> v1:10.20.193.155:6789/0 conn(0x7f141c0ba350 legacy=0x7f141c161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 1 monclient: found mon.a 2026-02-25T15:13:04.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c1fd990 con 0x7f141c0585e0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1409ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 5 monclient: authenticate success, global_id 4440 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 10 monclient: _renew_subs 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f141c1fdc70 con 0x7f141c0585e0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 10 monclient: _renew_subs 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f141c1f9560 con 0x7f141c0585e0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.508+0000 7f1423624640 1 librados: init done 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7f1423624640 10 client.4440.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7f1423624640 15 client.4440.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7f1423624640 20 client.4440.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7f1423624640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7f1423624640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f141c0b64c0 con 0x7f141c0585e0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== osd.11 v1:10.20.193.174:6800/1887691036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe14c0c2e10 con 0x7fe14c0a1210 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7fe157fff640 10 client.4447.objecter ms_dispatch2 0x7fe17c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7fe157fff640 10 client.4447.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7fe157fff640 20 client.4447.objecter put_session s=0x7fe14c0a0b60 osd=11 4 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.509+0000 7fe157fff640 15 client.4447.objecter _session_command_op_remove 11 1 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.511+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa67c0b64c0 con 0x7fa67c0585e0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.511+0000 7fa662ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.511+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa670004a70 con 0x7fa67c0585e0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.511+0000 7fa662ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.511+0000 7fa662ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.511+0000 7fa662ffd640 10 monclient: dump: 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.559 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.511+0000 7fa678d72640 4 set_mon_vals no callback set 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f156813bfb0 con 0x7f15680585e0 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f15477fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f155c0039b0 con 0x7f15680585e0 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f15477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f15477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f15657fa640 4 set_mon_vals no callback set 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f15477fe640 10 monclient: dump: 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 10 client.4424.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 15 client.4424.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 20 client.4424.objecter _get_session s=0x7f77fc0a0d40 osd=1 3 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 20 client.4424.objecter put_session s=0x7f77fc0a0d40 osd=1 3 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 20 client.4424.objecter _get_session s=0x7f77fc0a0d40 osd=1 3 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 15 client.4424.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 20 client.4424.objecter get_session s=0x7f77fc0a0d40 osd=1 3 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fa670004c80 con 0x7fa67c0585e0 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 15 client.4424.objecter _session_command_op_assign 1 2 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 20 client.4424.objecter put_session s=0x7f77fc0a0d40 osd=1 4 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 10 client.4424.objecter _send_command 2 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.512+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 --> v1:10.20.193.155:6812/2301996681 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f783013c420 con 0x7f77fc0a13f0 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f155c003b90 con 0x7f15680585e0 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7fa679d74640 10 monclient: get_auth_request con 0x7fa648077e20 auth_method 0 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7fa662ffd640 10 client.4439.objecter ms_handle_connect 0x7fa648077e20 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7f15667fc640 10 monclient: get_auth_request con 0x7f1534077ea0 auth_method 0 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7f15477fe640 10 client.4456.objecter ms_handle_connect 0x7f1534077ea0 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fa670093270 con 0x7fa67c0585e0 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7fa662ffd640 10 client.4439.objecter ms_dispatch2 0x7fa67c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7fa662ffd640 3 client.4439.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.513+0000 7fa662ffd640 3 client.4439.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 10 client.4439.objecter checking command 1 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 20 client.4439.objecter _get_session s=0x7fa6480a0ca0 osd=6 3 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 20 client.4439.objecter put_session s=0x7fa6480a0ca0 osd=6 3 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 15 client.4439.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 20 client.4439.objecter _get_session s=0x7fa6480a0ca0 osd=6 3 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 20 client.4439.objecter get_session s=0x7fa6480a0ca0 osd=6 3 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 15 client.4439.objecter _session_command_op_assign 6 1 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 20 client.4439.objecter put_session s=0x7fa6480a0ca0 osd=6 4 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 10 client.4439.objecter _send_command 1 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.167:6812/762620751 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6480c2f50 con 0x7fa6480a1350 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa662ffd640 20 client.4439.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.514+0000 7fa67ad76640 10 monclient: get_auth_request con 0x7fa6480a1350 auth_method 0 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fa670059910 con 0x7fa67c0585e0 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7fa662ffd640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f155c0930d0 con 0x7f15680585e0 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 10 client.4456.objecter ms_dispatch2 0x7f1568000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 3 client.4456.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 3 client.4456.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 10 client.4456.objecter checking command 1 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 20 client.4456.objecter _get_session s=0x7f15340a0d20 osd=14 3 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 20 client.4456.objecter put_session s=0x7f15340a0d20 osd=14 3 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 15 client.4456.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 20 client.4456.objecter _get_session s=0x7f15340a0d20 osd=14 3 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 20 client.4456.objecter get_session s=0x7f15340a0d20 osd=14 3 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 15 client.4456.objecter _session_command_op_assign 14 1 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 20 client.4456.objecter put_session s=0x7f15340a0d20 osd=14 4 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 10 client.4456.objecter _send_command 1 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.167:6800/376081176 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15340c2fd0 con 0x7f15340a13d0 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 20 client.4456.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f155c059770 con 0x7f15680585e0 2026-02-25T15:13:04.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15477fe640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f780f7fe640 1 -- 10.20.193.78:0/2026144358 <== osd.1 v1:10.20.193.155:6812/2301996681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f7818007860 con 0x7f77fc0a13f0 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f780f7fe640 10 client.4424.objecter ms_dispatch2 0x7f7830000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f780f7fe640 10 client.4424.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f780f7fe640 20 client.4424.objecter put_session s=0x7f77fc0a0d40 osd=1 4 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f780f7fe640 15 client.4424.objecter _session_command_op_remove 1 2 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f15677fe640 10 monclient: get_auth_request con 0x7f15340a13d0 auth_method 0 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 10 librados: watch_flush enter 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 10 librados: watch_flush exit 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 10 client.4424.objecter close_session for osd.1 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 >> v1:10.20.193.155:6812/2301996681 conn(0x7f77fc0a13f0 legacy=0x7f77fc0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 20 client.4424.objecter put_session s=0x7f77fc0a0d40 osd=1 1 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 20 client.4424.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 10 client.4424.objecter successfully canceled tick 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 >> v1:10.20.193.78:6800/3497602169 conn(0x7f77fc077ec0 legacy=0x7f77fc098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 10 monclient: shutdown 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 >> v1:10.20.193.167:6789/0 conn(0x7f78300ba300 legacy=0x7f783013b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f782f7fe640 1 -- 10.20.193.78:0/2026144358 reap_dead start 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 shutdown_connections 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 >> 10.20.193.78:0/2026144358 conn(0x7f78300b7990 msgr2=0x7f78300b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7fa662ffd640 10 client.4439.objecter ms_handle_connect 0x7fa6480a1350 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.515+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 shutdown_connections 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f7835613640 1 -- 10.20.193.78:0/2026144358 wait complete. 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119324873 0 0) 0x7f12141fb450 con 0x7f12140585e0 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f11effff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f11effff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f11effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f7835613640 1 librados: shutdown 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f11effff640 10 monclient(hunting): my global_id is 4483 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1214159ea0 con 0x7f12140585e0 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3918245373 0 0) 0x7f9b6415b940 con 0x7f9b64058070 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b34003610 con 0x7f9b64058070 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9b54002fb0 con 0x7f9b64058070 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f9b597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f9b597fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.516+0000 7f9b597fa640 10 monclient(hunting): dump: 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.564 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7f15477fe640 10 client.4456.objecter ms_handle_connect 0x7f15340a13d0 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 10 client.4447.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 15 client.4447.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 20 client.4447.objecter _get_session s=0x7fe14c0a0b60 osd=11 3 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 20 client.4447.objecter put_session s=0x7fe14c0a0b60 osd=11 3 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 20 client.4447.objecter _get_session s=0x7fe14c0a0b60 osd=11 3 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 15 client.4447.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 20 client.4447.objecter get_session s=0x7fe14c0a0b60 osd=11 3 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 15 client.4447.objecter _session_command_op_assign 11 2 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 20 client.4447.objecter put_session s=0x7fe14c0a0b60 osd=11 4 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 10 client.4447.objecter _send_command 2 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.517+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 --> v1:10.20.193.174:6800/1887691036 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe17c162d80 con 0x7fe14c0a1210 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.518+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201761908 0 0) 0x7f12141fb730 con 0x7f12140b9f80 2026-02-25T15:13:04.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.518+0000 7f11effff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.518+0000 7f11effff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.518+0000 7f11effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.518+0000 7f11effff640 10 monclient(hunting): my global_id is 4457 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.518+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12141fb450 con 0x7f12140b9f80 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.520+0000 7fe157fff640 1 -- 10.20.193.78:0/432585760 <== osd.11 v1:10.20.193.174:6800/1887691036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7fe17c162d80 con 0x7fe14c0a1210 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.520+0000 7fe157fff640 10 client.4447.objecter ms_dispatch2 0x7fe17c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.520+0000 7fe157fff640 10 client.4447.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.520+0000 7fe157fff640 20 client.4447.objecter put_session s=0x7fe14c0a0b60 osd=11 4 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.520+0000 7fe157fff640 15 client.4447.objecter _session_command_op_remove 11 2 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 10 librados: watch_flush enter 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 10 librados: watch_flush exit 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 10 client.4447.objecter close_session for osd.11 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 >> v1:10.20.193.174:6800/1887691036 conn(0x7fe14c0a1210 legacy=0x7fe14c0c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 20 client.4447.objecter put_session s=0x7fe14c0a0b60 osd=11 1 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 20 client.4447.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 10 client.4447.objecter successfully canceled tick 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 >> v1:10.20.193.78:6800/3497602169 conn(0x7fe14c077ce0 legacy=0x7fe14c098190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 10 monclient: shutdown 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 >> v1:10.20.193.155:6789/0 conn(0x7fe17c0b4c30 legacy=0x7fe17c129340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe17bfff640 1 -- 10.20.193.78:0/432585760 reap_dead start 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 shutdown_connections 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 >> 10.20.193.78:0/432585760 conn(0x7fe17c0b4120 msgr2=0x7fe17c0b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 shutdown_connections 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 1 -- 10.20.193.78:0/432585760 wait complete. 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.521+0000 7fe181bd9640 1 librados: shutdown 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.524+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc098002ea0 con 0x7fc0a40585e0 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.524+0000 7fc08affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.524+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc098004d20 con 0x7fc0a40585e0 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.524+0000 7fc08affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.524+0000 7fc08affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.524+0000 7fc08affd640 10 monclient: dump: 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.524+0000 7fc0a0d72640 4 set_mon_vals no callback set 2026-02-25T15:13:04.567 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.568 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fc098004f30 con 0x7fc0a40585e0 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2903331005 0 0) 0x7f9b64162400 con 0x7f9b64159e40 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b6415b940 con 0x7f9b64159e40 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9b60003690 con 0x7f9b64159e40 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f9b597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f9b597fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f9b597fa640 10 monclient(hunting): dump: 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 761331686 0 0) 0x7f12141fb450 con 0x7f12140b9f80 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12141fb730 con 0x7f12140b9f80 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1204003180 con 0x7f12140b9f80 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f11effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f11effff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f11effff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7f11effff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7540b96a0 con 0x7fc7540ba350 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc72ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc748003c20 con 0x7fc7540ba350 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc72ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc72ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc72ffff640 10 monclient: dump: 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.569 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc751ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== osd.5 v1:10.20.193.155:6804/3530698425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd7d00c2ff0 con 0x7fd7d00a13f0 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fd7ee7fc640 10 client.4430.objecter ms_dispatch2 0x7fd800000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fd7ee7fc640 10 client.4430.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fd7ee7fc640 20 client.4430.objecter put_session s=0x7fd7d00a0d40 osd=5 4 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fd7ee7fc640 15 client.4430.objecter _session_command_op_remove 5 1 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc0a1d74640 10 monclient: get_auth_request con 0x7fc070077e50 auth_method 0 2026-02-25T15:13:04.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.525+0000 7fc08affd640 10 client.4443.objecter ms_handle_connect 0x7fc070077e50 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.526+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fc74801ca90 con 0x7fc7540ba350 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.526+0000 7fc7537fe640 10 monclient: get_auth_request con 0x7fc724077ef0 auth_method 0 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.526+0000 7fc72ffff640 10 client.4462.objecter ms_handle_connect 0x7fc724077ef0 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fc748092080 con 0x7fc7540ba350 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 10 client.4462.objecter ms_dispatch2 0x7fc754000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 3 client.4462.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 3 client.4462.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 10 client.4462.objecter checking command 1 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 20 client.4462.objecter _get_session s=0x7fc7240a0d70 osd=8 3 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 20 client.4462.objecter put_session s=0x7fc7240a0d70 osd=8 3 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 15 client.4462.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 20 client.4462.objecter _get_session s=0x7fc7240a0d70 osd=8 3 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 20 client.4462.objecter get_session s=0x7fc7240a0d70 osd=8 3 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 15 client.4462.objecter _session_command_op_assign 8 1 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 20 client.4462.objecter put_session s=0x7fc7240a0d70 osd=8 4 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 10 client.4462.objecter _send_command 1 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.78:6810/1740746686 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7240c3020 con 0x7fc7240a1420 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fc748058720 con 0x7fc7540ba350 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.527+0000 7fc72ffff640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.528+0000 7fc752ffd640 10 monclient: get_auth_request con 0x7fc7240a1420 auth_method 0 2026-02-25T15:13:04.571 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.572 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a6c0033f0 con 0x7f5a7c15b050 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f5a5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5a6c003c20 con 0x7f5a7c15b050 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f5a5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f5a5b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f5a5b7fe640 10 monclient: dump: 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f5a79573640 4 set_mon_vals no callback set 2026-02-25T15:13:04.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7fc72ffff640 10 client.4462.objecter ms_handle_connect 0x7fc7240a1420 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2255714633 0 0) 0x7f9b6415b940 con 0x7f9b64159e40 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 >> v1:10.20.193.155:6789/0 conn(0x7f9b64058070 legacy=0x7f9b6413ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 >> v1:10.20.193.78:6789/0 conn(0x7f9b64159a70 legacy=0x7f9b6413bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 1 monclient: found mon.c 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b641fb2d0 con 0x7f9b64159e40 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 5 monclient: authenticate success, global_id 4451 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 10 monclient: _renew_subs 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b641fb5b0 con 0x7f9b64159e40 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3895241017 0 0) 0x7f12141fb730 con 0x7f12140b9f80 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 >> v1:10.20.193.155:6789/0 conn(0x7f12140585e0 legacy=0x7f1214159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 >> v1:10.20.193.78:6789/0 conn(0x7f12140ba350 legacy=0x7f1214160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 1 monclient: found mon.c 2026-02-25T15:13:04.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 10 monclient: _renew_subs 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b641fbb70 con 0x7f9b64159e40 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f9b6b013640 1 librados: init done 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12141fba10 con 0x7f12140b9f80 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f11effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 5 monclient: authenticate success, global_id 4457 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 10 monclient: _renew_subs 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f12141fbcf0 con 0x7f12140b9f80 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 10 monclient: _renew_subs 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f121415faf0 con 0x7f12140b9f80 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f1219cfb640 1 librados: init done 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.529+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f5a6c01ca90 con 0x7f5a7c15b050 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f9b6b013640 10 client.4451.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f9b6b013640 15 client.4451.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f9b6b013640 20 client.4451.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f9b6b013640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f9b6b013640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f9b64158640 con 0x7f9b64159e40 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f5a7ad76640 10 monclient: get_auth_request con 0x7f5a48077e70 auth_method 0 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f1219cfb640 10 client.4457.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f1219cfb640 15 client.4457.objecter _session_command_op_assign -1 1 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f1219cfb640 20 client.4457.objecter _get_session osd=-1 returning homeless 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f1219cfb640 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f1219cfb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f121415e210 con 0x7f12140b9f80 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.530+0000 7f5a5b7fe640 10 client.4431.objecter ms_handle_connect 0x7f5a48077e70 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fc098093380 con 0x7fc0a40585e0 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 10 client.4443.objecter ms_dispatch2 0x7fc0a4000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 3 client.4443.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 3 client.4443.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 10 client.4443.objecter checking command 1 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 20 client.4443.objecter _get_session s=0x7fc0700a0cd0 osd=10 3 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 20 client.4443.objecter put_session s=0x7fc0700a0cd0 osd=10 3 2026-02-25T15:13:04.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 15 client.4443.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 20 client.4443.objecter _get_session s=0x7fc0700a0cd0 osd=10 3 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 20 client.4443.objecter get_session s=0x7fc0700a0cd0 osd=10 3 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 15 client.4443.objecter _session_command_op_assign 10 1 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 20 client.4443.objecter put_session s=0x7fc0700a0cd0 osd=10 4 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 10 client.4443.objecter _send_command 1 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.167:6804/601461155 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0700c2f80 con 0x7fc0700a1380 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 20 client.4443.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fc098059a20 con 0x7fc0a40585e0 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc08affd640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.532+0000 7fc0a2d76640 10 monclient: get_auth_request con 0x7fc0700a1380 auth_method 0 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 10 client.4430.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 15 client.4430.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 20 client.4430.objecter _get_session s=0x7fd7d00a0d40 osd=5 3 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 20 client.4430.objecter put_session s=0x7fd7d00a0d40 osd=5 3 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 20 client.4430.objecter _get_session s=0x7fd7d00a0d40 osd=5 3 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 15 client.4430.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 20 client.4430.objecter get_session s=0x7fd7d00a0d40 osd=5 3 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 15 client.4430.objecter _session_command_op_assign 5 2 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 20 client.4430.objecter put_session s=0x7fd7d00a0d40 osd=5 4 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 10 client.4430.objecter _send_command 2 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.533+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 --> v1:10.20.193.155:6804/3530698425 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd80005c860 con 0x7fd7d00a13f0 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.534+0000 7fc08affd640 10 client.4443.objecter ms_handle_connect 0x7fc0700a1380 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.534+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== osd.6 v1:10.20.193.167:6812/762620751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fa6480c2f50 con 0x7fa6480a1350 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.534+0000 7fa662ffd640 10 client.4439.objecter ms_dispatch2 0x7fa67c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.534+0000 7fa662ffd640 10 client.4439.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.534+0000 7fa662ffd640 20 client.4439.objecter put_session s=0x7fa6480a0ca0 osd=6 4 2026-02-25T15:13:04.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.534+0000 7fa662ffd640 15 client.4439.objecter _session_command_op_remove 6 1 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f5a6c0921a0 con 0x7f5a7c15b050 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 10 client.4431.objecter ms_dispatch2 0x7f5a7c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 3 client.4431.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 3 client.4431.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 10 client.4431.objecter checking command 1 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 20 client.4431.objecter _get_session s=0x7f5a480a0cf0 osd=7 3 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 20 client.4431.objecter put_session s=0x7f5a480a0cf0 osd=7 3 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 15 client.4431.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 20 client.4431.objecter _get_session s=0x7f5a480a0cf0 osd=7 3 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 20 client.4431.objecter get_session s=0x7f5a480a0cf0 osd=7 3 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 15 client.4431.objecter _session_command_op_assign 7 1 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 20 client.4431.objecter put_session s=0x7f5a480a0cf0 osd=7 4 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 10 client.4431.objecter _send_command 1 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.174:6809/463709274 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a480c2fa0 con 0x7f5a480a13a0 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 20 client.4431.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f5a6c058840 con 0x7f5a7c15b050 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.535+0000 7f5a5b7fe640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd7ee7fc640 1 -- 10.20.193.78:0/2500858317 <== osd.5 v1:10.20.193.155:6804/3530698425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fd80005c860 con 0x7fd7d00a13f0 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd7ee7fc640 10 client.4430.objecter ms_dispatch2 0x7fd800000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd7ee7fc640 10 client.4430.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd7ee7fc640 20 client.4430.objecter put_session s=0x7fd7d00a0d40 osd=5 4 2026-02-25T15:13:04.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd7ee7fc640 15 client.4430.objecter _session_command_op_remove 5 2 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 10 librados: watch_flush enter 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 10 librados: watch_flush exit 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 10 client.4430.objecter close_session for osd.5 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 >> v1:10.20.193.155:6804/3530698425 conn(0x7fd7d00a13f0 legacy=0x7fd7d00c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 20 client.4430.objecter put_session s=0x7fd7d00a0d40 osd=5 1 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 20 client.4430.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 10 client.4430.objecter successfully canceled tick 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 >> v1:10.20.193.78:6800/3497602169 conn(0x7fd7d0077e60 legacy=0x7fd7d0098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 10 monclient: shutdown 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 >> v1:10.20.193.167:6789/0 conn(0x7fd800157b50 legacy=0x7fd8000ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd806308640 1 -- 10.20.193.78:0/2500858317 reap_dead start 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7f5a7a575640 10 monclient: get_auth_request con 0x7f5a480a13a0 auth_method 0 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 shutdown_connections 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 >> 10.20.193.78:0/2500858317 conn(0x7fd8000b2ef0 msgr2=0x7fd800058000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 shutdown_connections 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 1 -- 10.20.193.78:0/2500858317 wait complete. 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.536+0000 7fd807d92640 1 librados: shutdown 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.537+0000 7f5a5b7fe640 10 client.4431.objecter ms_handle_connect 0x7f5a480a13a0 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.539+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4200531e0 con 0x7fb4201a7ac0 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.539+0000 7fb406ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.539+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb410003c20 con 0x7fb4201a7ac0 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.539+0000 7fb406ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.539+0000 7fb406ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.539+0000 7fb406ffd640 10 monclient: dump: 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.539+0000 7fb41cd72640 4 set_mon_vals no callback set 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.540+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== osd.14 v1:10.20.193.167:6800/376081176 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f15340c2fd0 con 0x7f15340a13d0 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.540+0000 7f15477fe640 10 client.4456.objecter ms_dispatch2 0x7f1568000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.540+0000 7f15477fe640 10 client.4456.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.540+0000 7f15477fe640 20 client.4456.objecter put_session s=0x7f15340a0d20 osd=14 4 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.540+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fb410003e00 con 0x7fb4201a7ac0 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.540+0000 7f15477fe640 15 client.4456.objecter _session_command_op_remove 14 1 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.540+0000 7fb41e575640 10 monclient: get_auth_request con 0x7fb3ec077df0 auth_method 0 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.540+0000 7fb406ffd640 10 client.4455.objecter ms_handle_connect 0x7fb3ec077df0 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.541+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b64158640 con 0x7f9b64159e40 2026-02-25T15:13:04.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.541+0000 7f9b597fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.541+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9b600032c0 con 0x7f9b64159e40 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.541+0000 7f9b597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.541+0000 7f9b597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.541+0000 7f9b597fa640 10 monclient: dump: 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.541+0000 7f9b5affd640 4 set_mon_vals no callback set 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.542+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f9b6001c7b0 con 0x7f9b64159e40 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.542+0000 7f9b68d88640 10 monclient: get_auth_request con 0x7f9b34077f40 auth_method 0 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7f9b597fa640 10 client.4451.objecter ms_handle_connect 0x7f9b34077f40 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 10 client.4439.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 15 client.4439.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 20 client.4439.objecter _get_session s=0x7fa6480a0ca0 osd=6 3 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 20 client.4439.objecter put_session s=0x7fa6480a0ca0 osd=6 3 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 20 client.4439.objecter _get_session s=0x7fa6480a0ca0 osd=6 3 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 15 client.4439.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 20 client.4439.objecter get_session s=0x7fa6480a0ca0 osd=6 3 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 15 client.4439.objecter _session_command_op_assign 6 2 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 20 client.4439.objecter put_session s=0x7fa6480a0ca0 osd=6 4 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 10 client.4439.objecter _send_command 2 2026-02-25T15:13:04.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.543+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 --> v1:10.20.193.167:6812/762620751 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa67c0b94f0 con 0x7fa6480a1350 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stdout:90194313220 2026-02-25T15:13:04.581 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f121415e210 con 0x7f12140b9f80 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7f11effff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1204003700 con 0x7f12140b9f80 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7f11effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7f11effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7f11effff640 10 monclient: dump: 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7f1211ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:04.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2300b7ed0 con 0x7fb230058070 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7fb21dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fb4100921c0 con 0x7fb4201a7ac0 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 10 client.4455.objecter ms_dispatch2 0x7fb420000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 3 client.4455.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 3 client.4455.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb220003500 con 0x7fb230058070 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7fb21dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb21dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.545+0000 7fb21f7fe640 4 set_mon_vals no callback set 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb21dffb640 10 monclient: dump: 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 10 client.4455.objecter checking command 1 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 20 client.4455.objecter _get_session s=0x7fb3ec0a0c70 osd=9 3 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 20 client.4455.objecter put_session s=0x7fb3ec0a0c70 osd=9 3 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 15 client.4455.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 20 client.4455.objecter _get_session s=0x7fb3ec0a0c70 osd=9 3 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 20 client.4455.objecter get_session s=0x7fb3ec0a0c70 osd=9 3 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 15 client.4455.objecter _session_command_op_assign 9 1 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 20 client.4455.objecter put_session s=0x7fb3ec0a0c70 osd=9 4 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 10 client.4455.objecter _send_command 1 2026-02-25T15:13:04.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.155:6805/976780597 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3ec0c2f20 con 0x7fb3ec0a1320 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 20 client.4455.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fb410058860 con 0x7fb4201a7ac0 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb406ffd640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f120401c570 con 0x7f12140b9f80 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fb22001d850 con 0x7fb230058070 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7fb41dd74640 10 monclient: get_auth_request con 0x7fb3ec0a1320 auth_method 0 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.546+0000 7f12137fe640 10 monclient: get_auth_request con 0x7f11e4077ee0 auth_method 0 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7f11effff640 10 client.4457.objecter ms_handle_connect 0x7f11e4077ee0 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa662ffd640 1 -- 10.20.193.78:0/4113924773 <== osd.6 v1:10.20.193.167:6812/762620751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7fa67c0b94f0 con 0x7fa6480a1350 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa662ffd640 10 client.4439.objecter ms_dispatch2 0x7fa67c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa662ffd640 10 client.4439.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa662ffd640 20 client.4439.objecter put_session s=0x7fa6480a0ca0 osd=6 4 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa662ffd640 15 client.4439.objecter _session_command_op_remove 6 2 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fb234fde640 10 monclient: get_auth_request con 0x7fb200077f30 auth_method 0 2026-02-25T15:13:04.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fb21dffb640 10 client.4452.objecter ms_handle_connect 0x7fb200077f30 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 10 librados: watch_flush enter 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 10 librados: watch_flush exit 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 10 client.4439.objecter close_session for osd.6 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 >> v1:10.20.193.167:6812/762620751 conn(0x7fa6480a1350 legacy=0x7fa6480c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 20 client.4439.objecter put_session s=0x7fa6480a0ca0 osd=6 1 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 20 client.4439.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 10 client.4439.objecter successfully canceled tick 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 >> v1:10.20.193.78:6800/3497602169 conn(0x7fa648077e20 legacy=0x7fa6480982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 10 monclient: shutdown 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 >> v1:10.20.193.167:6789/0 conn(0x7fa67c0585e0 legacy=0x7fa67c1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa67ad76640 1 -- 10.20.193.78:0/4113924773 reap_dead start 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 shutdown_connections 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 >> 10.20.193.78:0/4113924773 conn(0x7fa67c0b7990 msgr2=0x7fa67c15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 shutdown_connections 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 1 -- 10.20.193.78:0/4113924773 wait complete. 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.547+0000 7fa680c46640 1 librados: shutdown 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f9b60091e30 con 0x7f9b64159e40 2026-02-25T15:13:04.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 10 client.4451.objecter ms_dispatch2 0x7f9b64000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 3 client.4451.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 3 client.4451.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 10 client.4451.objecter checking command 1 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 20 client.4451.objecter _get_session s=0x7f9b340a0dc0 osd=4 3 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 20 client.4451.objecter put_session s=0x7f9b340a0dc0 osd=4 3 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 15 client.4451.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 20 client.4451.objecter _get_session s=0x7f9b340a0dc0 osd=4 3 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 20 client.4451.objecter get_session s=0x7f9b340a0dc0 osd=4 3 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 15 client.4451.objecter _session_command_op_assign 4 1 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 20 client.4451.objecter put_session s=0x7f9b340a0dc0 osd=4 4 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 10 client.4451.objecter _send_command 1 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.78:6805/2928350245 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b340c3070 con 0x7f9b340a1470 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b597fa640 20 client.4451.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7fb406ffd640 10 client.4455.objecter ms_handle_connect 0x7fb3ec0a1320 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f9b5bfff640 10 monclient: get_auth_request con 0x7f9b340a1470 auth_method 0 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 10 client.4456.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 15 client.4456.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 20 client.4456.objecter _get_session s=0x7f15340a0d20 osd=14 3 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 20 client.4456.objecter put_session s=0x7f15340a0d20 osd=14 3 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 20 client.4456.objecter _get_session s=0x7f15340a0d20 osd=14 3 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 15 client.4456.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 20 client.4456.objecter get_session s=0x7f15340a0d20 osd=14 3 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 15 client.4456.objecter _session_command_op_assign 14 2 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 20 client.4456.objecter put_session s=0x7f15340a0d20 osd=14 4 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 10 client.4456.objecter _send_command 2 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.548+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 --> v1:10.20.193.167:6800/376081176 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f156813bcd0 con 0x7f15340a13d0 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7f9b597fa640 10 client.4451.objecter ms_handle_connect 0x7f9b340a1470 2026-02-25T15:13:04.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fb220093120 con 0x7fb230058070 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7fb21dffb640 10 client.4452.objecter ms_dispatch2 0x7fb230000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7fb21dffb640 3 client.4452.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7fb21dffb640 3 client.4452.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f1204091ef0 con 0x7f12140b9f80 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7f11effff640 10 client.4457.objecter ms_dispatch2 0x7f1214000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7f11effff640 3 client.4457.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.549+0000 7f11effff640 3 client.4457.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 10 client.4452.objecter checking command 1 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f9b6005bf30 con 0x7f9b64159e40 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f9b597fa640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 20 client.4452.objecter _get_session s=0x7fb2000a0db0 osd=13 3 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 20 client.4452.objecter put_session s=0x7fb2000a0db0 osd=13 3 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 15 client.4452.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 20 client.4452.objecter _get_session s=0x7fb2000a0db0 osd=13 3 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 20 client.4452.objecter get_session s=0x7fb2000a0db0 osd=13 3 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 15 client.4452.objecter _session_command_op_assign 13 1 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 20 client.4452.objecter put_session s=0x7fb2000a0db0 osd=13 4 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 10 client.4452.objecter _send_command 1 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.155:6800/4105183277 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb220002fa0 con 0x7fb2000a1460 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 20 client.4452.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fb22005d220 con 0x7fb230058070 2026-02-25T15:13:04.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb21dffb640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 10 client.4457.objecter checking command 1 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 20 client.4457.objecter _get_session s=0x7f11e40a0da0 osd=15 3 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 20 client.4457.objecter put_session s=0x7f11e40a0da0 osd=15 3 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 15 client.4457.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 20 client.4457.objecter _get_session s=0x7f11e40a0da0 osd=15 3 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 20 client.4457.objecter get_session s=0x7f11e40a0da0 osd=15 3 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== osd.8 v1:10.20.193.78:6810/1740746686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc7240c3020 con 0x7fc7240a1420 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fc72ffff640 10 client.4462.objecter ms_dispatch2 0x7fc754000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fc72ffff640 10 client.4462.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fc72ffff640 20 client.4462.objecter put_session s=0x7fc7240a0d70 osd=8 4 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 15 client.4457.objecter _session_command_op_assign 15 1 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 20 client.4457.objecter put_session s=0x7f11e40a0da0 osd=15 4 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 10 client.4457.objecter _send_command 1 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.174:6808/2760611848 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1204002960 con 0x7f11e40a1450 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f11effff640 20 client.4457.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fc72ffff640 15 client.4462.objecter _session_command_op_remove 8 1 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7fb235fe0640 10 monclient: get_auth_request con 0x7fb2000a1460 auth_method 0 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.550+0000 7f1213fff640 10 monclient: get_auth_request con 0x7f11e40a1450 auth_method 0 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f15477fe640 1 -- 10.20.193.78:0/3679755628 <== osd.14 v1:10.20.193.167:6800/376081176 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f156813bcd0 con 0x7f15340a13d0 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f15477fe640 10 client.4456.objecter ms_dispatch2 0x7f1568000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f15477fe640 10 client.4456.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f15477fe640 20 client.4456.objecter put_session s=0x7f15340a0d20 osd=14 4 2026-02-25T15:13:04.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f15477fe640 15 client.4456.objecter _session_command_op_remove 14 2 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 10 librados: watch_flush enter 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 10 librados: watch_flush exit 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 10 client.4456.objecter close_session for osd.14 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 >> v1:10.20.193.167:6800/376081176 conn(0x7f15340a13d0 legacy=0x7f15340c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 20 client.4456.objecter put_session s=0x7f15340a0d20 osd=14 1 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 20 client.4456.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 10 client.4456.objecter successfully canceled tick 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 >> v1:10.20.193.78:6800/3497602169 conn(0x7f1534077ea0 legacy=0x7f1534098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 10 monclient: shutdown 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 >> v1:10.20.193.155:6789/0 conn(0x7f15680585e0 legacy=0x7f15681fde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f15677fe640 1 -- 10.20.193.78:0/3679755628 reap_dead start 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 shutdown_connections 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 >> 10.20.193.78:0/3679755628 conn(0x7f15680b7990 msgr2=0x7f1568158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 shutdown_connections 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 1 -- 10.20.193.78:0/3679755628 wait complete. 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f156d72e640 1 librados: shutdown 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f120405bff0 con 0x7f12140b9f80 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.551+0000 7f11effff640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.552+0000 7fb21dffb640 10 client.4452.objecter ms_handle_connect 0x7fb2000a1460 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.552+0000 7f11effff640 10 client.4457.objecter ms_handle_connect 0x7f11e40a1450 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.554+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== osd.10 v1:10.20.193.167:6804/601461155 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc0700c2f80 con 0x7fc0700a1380 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.554+0000 7fc08affd640 10 client.4443.objecter ms_dispatch2 0x7fc0a4000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.554+0000 7fc08affd640 10 client.4443.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.554+0000 7fc08affd640 20 client.4443.objecter put_session s=0x7fc0700a0cd0 osd=10 4 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.554+0000 7fc08affd640 15 client.4443.objecter _session_command_op_remove 10 1 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.589 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== osd.7 v1:10.20.193.174:6809/463709274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f5a480c2fa0 con 0x7f5a480a13a0 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7f5a5b7fe640 10 client.4431.objecter ms_dispatch2 0x7f5a7c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7f5a5b7fe640 10 client.4431.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7f5a5b7fe640 20 client.4431.objecter put_session s=0x7f5a480a0cf0 osd=7 4 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7f5a5b7fe640 15 client.4431.objecter _session_command_op_remove 7 1 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 10 client.4462.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 15 client.4462.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 20 client.4462.objecter _get_session s=0x7fc7240a0d70 osd=8 3 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 20 client.4462.objecter put_session s=0x7fc7240a0d70 osd=8 3 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 20 client.4462.objecter _get_session s=0x7fc7240a0d70 osd=8 3 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 15 client.4462.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 20 client.4462.objecter get_session s=0x7fc7240a0d70 osd=8 3 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 15 client.4462.objecter _session_command_op_assign 8 2 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 20 client.4462.objecter put_session s=0x7fc7240a0d70 osd=8 4 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 10 client.4462.objecter _send_command 2 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.557+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 --> v1:10.20.193.78:6810/1740746686 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7540b93c0 con 0x7fc7240a1420 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.590 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-25T15:13:04.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.560+0000 7fc72ffff640 1 -- 10.20.193.78:0/1546102419 <== osd.8 v1:10.20.193.78:6810/1740746686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7fc7540b93c0 con 0x7fc7240a1420 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.560+0000 7fc72ffff640 10 client.4462.objecter ms_dispatch2 0x7fc754000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.560+0000 7fc72ffff640 10 client.4462.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.560+0000 7fc72ffff640 20 client.4462.objecter put_session s=0x7fc7240a0d70 osd=8 4 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.560+0000 7fc72ffff640 15 client.4462.objecter _session_command_op_remove 8 2 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 10 librados: watch_flush enter 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 10 librados: watch_flush exit 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 10 client.4462.objecter close_session for osd.8 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 >> v1:10.20.193.78:6810/1740746686 conn(0x7fc7240a1420 legacy=0x7fc7240c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 20 client.4462.objecter put_session s=0x7fc7240a0d70 osd=8 1 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 10 client.4462.objecter successfully canceled tick 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 >> v1:10.20.193.78:6800/3497602169 conn(0x7fc724077ef0 legacy=0x7fc7240983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 10 monclient: shutdown 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 >> v1:10.20.193.155:6789/0 conn(0x7fc7540ba350 legacy=0x7fc7541645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc753fff640 1 -- 10.20.193.78:0/1546102419 reap_dead start 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 shutdown_connections 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 >> 10.20.193.78:0/1546102419 conn(0x7fc7540b7990 msgr2=0x7fc75415acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 shutdown_connections 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 1 -- 10.20.193.78:0/1546102419 wait complete. 2026-02-25T15:13:04.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.561+0000 7fc759d98640 1 librados: shutdown 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.562+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f141c0b64c0 con 0x7f141c0585e0 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.562+0000 7f1409ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.562+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f140c0038a0 con 0x7f141c0585e0 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.562+0000 7f1409ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.562+0000 7f1409ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.562+0000 7f1409ffb640 10 monclient: dump: 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.562+0000 7f140b7fe640 4 set_mon_vals no callback set 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.563+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f140c01c710 con 0x7f141c0585e0 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.563+0000 7f1420b98640 10 monclient: get_auth_request con 0x7f13ec077f40 auth_method 0 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.563+0000 7f1409ffb640 10 client.4440.objecter ms_handle_connect 0x7f13ec077f40 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 10 client.4443.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 15 client.4443.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 20 client.4443.objecter _get_session s=0x7fc0700a0cd0 osd=10 3 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 20 client.4443.objecter put_session s=0x7fc0700a0cd0 osd=10 3 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 20 client.4443.objecter _get_session s=0x7fc0700a0cd0 osd=10 3 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 15 client.4443.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 20 client.4443.objecter get_session s=0x7fc0700a0cd0 osd=10 3 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 15 client.4443.objecter _session_command_op_assign 10 2 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 20 client.4443.objecter put_session s=0x7fc0700a0cd0 osd=10 4 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 10 client.4443.objecter _send_command 2 2026-02-25T15:13:04.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 --> v1:10.20.193.167:6804/601461155 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0a40b64c0 con 0x7fc0700a1380 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f140c091d00 con 0x7f141c0585e0 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 10 client.4440.objecter ms_dispatch2 0x7f141c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 3 client.4440.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 3 client.4440.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 10 client.4440.objecter checking command 1 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 20 client.4440.objecter _get_session s=0x7f13ec0a0dc0 osd=0 3 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 20 client.4440.objecter put_session s=0x7f13ec0a0dc0 osd=0 3 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 15 client.4440.objecter _session_command_op_remove -1 1 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 20 client.4440.objecter _get_session s=0x7f13ec0a0dc0 osd=0 3 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 20 client.4440.objecter get_session s=0x7f13ec0a0dc0 osd=0 3 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 15 client.4440.objecter _session_command_op_assign 0 1 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 20 client.4440.objecter put_session s=0x7f13ec0a0dc0 osd=0 4 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 10 client.4440.objecter _send_command 1 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.78:6801/3604255984 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13ec0c3070 con 0x7f13ec0a1470 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 20 client.4440.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f140c0583a0 con 0x7f141c0585e0 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f1409ffb640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 10 client.4431.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 15 client.4431.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 20 client.4431.objecter _get_session s=0x7f5a480a0cf0 osd=7 3 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 20 client.4431.objecter put_session s=0x7f5a480a0cf0 osd=7 3 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 20 client.4431.objecter _get_session s=0x7f5a480a0cf0 osd=7 3 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 15 client.4431.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 20 client.4431.objecter get_session s=0x7f5a480a0cf0 osd=7 3 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 15 client.4431.objecter _session_command_op_assign 7 2 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 20 client.4431.objecter put_session s=0x7f5a480a0cf0 osd=7 4 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 10 client.4431.objecter _send_command 2 2026-02-25T15:13:04.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.564+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 --> v1:10.20.193.174:6809/463709274 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a7c13c3f0 con 0x7f5a480a13a0 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.565+0000 7f1421b9a640 10 monclient: get_auth_request con 0x7f13ec0a1470 auth_method 0 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.566+0000 7fc08affd640 1 -- 10.20.193.78:0/3144343708 <== osd.10 v1:10.20.193.167:6804/601461155 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7fc0a40b64c0 con 0x7fc0700a1380 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.566+0000 7fc08affd640 10 client.4443.objecter ms_dispatch2 0x7fc0a4000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.566+0000 7fc08affd640 10 client.4443.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.566+0000 7fc08affd640 20 client.4443.objecter put_session s=0x7fc0700a0cd0 osd=10 4 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.566+0000 7fc08affd640 15 client.4443.objecter _session_command_op_remove 10 2 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.566+0000 7f1409ffb640 10 client.4440.objecter ms_handle_connect 0x7f13ec0a1470 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 10 librados: watch_flush enter 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 10 librados: watch_flush exit 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 10 client.4443.objecter close_session for osd.10 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 >> v1:10.20.193.167:6804/601461155 conn(0x7fc0700a1380 legacy=0x7fc0700c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 20 client.4443.objecter put_session s=0x7fc0700a0cd0 osd=10 1 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 20 client.4443.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 10 client.4443.objecter successfully canceled tick 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 >> v1:10.20.193.78:6800/3497602169 conn(0x7fc070077e50 legacy=0x7fc070098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 10 monclient: shutdown 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 >> v1:10.20.193.78:6789/0 conn(0x7fc0a40585e0 legacy=0x7fc0a4155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a2d76640 1 -- 10.20.193.78:0/3144343708 reap_dead start 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 shutdown_connections 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 >> 10.20.193.78:0/3144343708 conn(0x7fc0a40b7990 msgr2=0x7fc0a40b9270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 shutdown_connections 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 1 -- 10.20.193.78:0/3144343708 wait complete. 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fc0a8f02640 1 librados: shutdown 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== osd.9 v1:10.20.193.155:6805/976780597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fb3ec0c2f20 con 0x7fb3ec0a1320 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fb406ffd640 10 client.4455.objecter ms_dispatch2 0x7fb420000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fb406ffd640 10 client.4455.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fb406ffd640 20 client.4455.objecter put_session s=0x7fb3ec0a0c70 osd=9 4 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7fb406ffd640 15 client.4455.objecter _session_command_op_remove 9 1 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7f5a5b7fe640 1 -- 10.20.193.78:0/638847339 <== osd.7 v1:10.20.193.174:6809/463709274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f5a7c13c3f0 con 0x7f5a480a13a0 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7f5a5b7fe640 10 client.4431.objecter ms_dispatch2 0x7f5a7c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7f5a5b7fe640 10 client.4431.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7f5a5b7fe640 20 client.4431.objecter put_session s=0x7f5a480a0cf0 osd=7 4 2026-02-25T15:13:04.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.567+0000 7f5a5b7fe640 15 client.4431.objecter _session_command_op_remove 7 2 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 10 librados: watch_flush enter 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 10 librados: watch_flush exit 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 10 client.4431.objecter close_session for osd.7 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 >> v1:10.20.193.174:6809/463709274 conn(0x7f5a480a13a0 legacy=0x7f5a480c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 20 client.4431.objecter put_session s=0x7f5a480a0cf0 osd=7 1 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 20 client.4431.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 10 client.4431.objecter successfully canceled tick 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 >> v1:10.20.193.78:6800/3497602169 conn(0x7f5a48077e70 legacy=0x7f5a48098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 10 monclient: shutdown 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 >> v1:10.20.193.78:6789/0 conn(0x7f5a7c15b050 legacy=0x7f5a7c139f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a7b577640 1 -- 10.20.193.78:0/638847339 reap_dead start 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 shutdown_connections 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 >> 10.20.193.78:0/638847339 conn(0x7f5a7c0b7360 msgr2=0x7f5a7c056a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 shutdown_connections 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 1 -- 10.20.193.78:0/638847339 wait complete. 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.568+0000 7f5a81213640 1 librados: shutdown 2026-02-25T15:13:04.596 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.596 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.571+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== osd.4 v1:10.20.193.78:6805/2928350245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f9b340c3070 con 0x7f9b340a1470 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.571+0000 7f9b597fa640 10 client.4451.objecter ms_dispatch2 0x7f9b64000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.571+0000 7f9b597fa640 10 client.4451.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.571+0000 7f9b597fa640 20 client.4451.objecter put_session s=0x7f9b340a0dc0 osd=4 4 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.571+0000 7f9b597fa640 15 client.4451.objecter _session_command_op_remove 4 1 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== osd.13 v1:10.20.193.155:6800/4105183277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fb220002fa0 con 0x7fb2000a1460 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7fb21dffb640 10 client.4452.objecter ms_dispatch2 0x7fb230000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7fb21dffb640 10 client.4452.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7fb21dffb640 20 client.4452.objecter put_session s=0x7fb2000a0db0 osd=13 4 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7fb21dffb640 15 client.4452.objecter _session_command_op_remove 13 1 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== osd.15 v1:10.20.193.174:6808/2760611848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f1204002960 con 0x7f11e40a1450 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7f11effff640 10 client.4457.objecter ms_dispatch2 0x7f1214000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7f11effff640 10 client.4457.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7f11effff640 20 client.4457.objecter put_session s=0x7f11e40a0da0 osd=15 4 2026-02-25T15:13:04.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.572+0000 7f11effff640 15 client.4457.objecter _session_command_op_remove 15 1 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stdout:94489280517 2026-02-25T15:13:04.598 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 10 client.4455.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 15 client.4455.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 20 client.4455.objecter _get_session s=0x7fb3ec0a0c70 osd=9 3 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 20 client.4455.objecter put_session s=0x7fb3ec0a0c70 osd=9 3 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 20 client.4455.objecter _get_session s=0x7fb3ec0a0c70 osd=9 3 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 15 client.4455.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 20 client.4455.objecter get_session s=0x7fb3ec0a0c70 osd=9 3 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 15 client.4455.objecter _session_command_op_assign 9 2 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 20 client.4455.objecter put_session s=0x7fb3ec0a0c70 osd=9 4 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 10 client.4455.objecter _send_command 2 2026-02-25T15:13:04.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.575+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 --> v1:10.20.193.155:6805/976780597 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb42015e0f0 con 0x7fb3ec0a1320 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.599 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb406ffd640 1 -- 10.20.193.78:0/2353111462 <== osd.9 v1:10.20.193.155:6805/976780597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3529919842) 0x7fb42015e0f0 con 0x7fb3ec0a1320 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb406ffd640 10 client.4455.objecter ms_dispatch2 0x7fb420000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb406ffd640 10 client.4455.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb406ffd640 20 client.4455.objecter put_session s=0x7fb3ec0a0c70 osd=9 4 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb406ffd640 15 client.4455.objecter _session_command_op_remove 9 2 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 10 librados: watch_flush enter 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 10 librados: watch_flush exit 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 10 client.4455.objecter close_session for osd.9 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 >> v1:10.20.193.155:6805/976780597 conn(0x7fb3ec0a1320 legacy=0x7fb3ec0c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 20 client.4455.objecter put_session s=0x7fb3ec0a0c70 osd=9 1 2026-02-25T15:13:04.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 20 client.4455.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 10 client.4455.objecter successfully canceled tick 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 >> v1:10.20.193.78:6800/3497602169 conn(0x7fb3ec077df0 legacy=0x7fb3ec0982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 10 monclient: shutdown 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 >> v1:10.20.193.78:6789/0 conn(0x7fb4201a7ac0 legacy=0x7fb4200ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb41ed76640 1 -- 10.20.193.78:0/2353111462 reap_dead start 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 shutdown_connections 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 >> 10.20.193.78:0/2353111462 conn(0x7fb4200b4120 msgr2=0x7fb4200b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 shutdown_connections 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 1 -- 10.20.193.78:0/2353111462 wait complete. 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.578+0000 7fb424e46640 1 librados: shutdown 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 10 client.4451.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 15 client.4451.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 20 client.4451.objecter _get_session s=0x7f9b340a0dc0 osd=4 3 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 20 client.4451.objecter put_session s=0x7f9b340a0dc0 osd=4 3 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 20 client.4451.objecter _get_session s=0x7f9b340a0dc0 osd=4 3 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 15 client.4451.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 20 client.4451.objecter get_session s=0x7f9b340a0dc0 osd=4 3 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 15 client.4451.objecter _session_command_op_assign 4 2 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 20 client.4451.objecter put_session s=0x7f9b340a0dc0 osd=4 4 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 10 client.4451.objecter _send_command 2 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.579+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 --> v1:10.20.193.78:6805/2928350245 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b64158360 con 0x7f9b340a1470 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 10 client.4452.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 15 client.4452.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 20 client.4452.objecter _get_session s=0x7fb2000a0db0 osd=13 3 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 20 client.4452.objecter put_session s=0x7fb2000a0db0 osd=13 3 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 20 client.4452.objecter _get_session s=0x7fb2000a0db0 osd=13 3 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 15 client.4452.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 20 client.4452.objecter get_session s=0x7fb2000a0db0 osd=13 3 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 15 client.4452.objecter _session_command_op_assign 13 2 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 20 client.4452.objecter put_session s=0x7fb2000a0db0 osd=13 4 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 10 client.4452.objecter _send_command 2 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.580+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 --> v1:10.20.193.155:6800/4105183277 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2300b7bf0 con 0x7fb2000a1460 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 10 client.4457.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 15 client.4457.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 20 client.4457.objecter _get_session s=0x7f11e40a0da0 osd=15 3 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 20 client.4457.objecter put_session s=0x7f11e40a0da0 osd=15 3 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 20 client.4457.objecter _get_session s=0x7f11e40a0da0 osd=15 3 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 15 client.4457.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 20 client.4457.objecter get_session s=0x7f11e40a0da0 osd=15 3 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 15 client.4457.objecter _session_command_op_assign 15 2 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 20 client.4457.objecter put_session s=0x7f11e40a0da0 osd=15 4 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 10 client.4457.objecter _send_command 2 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.581+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 --> v1:10.20.193.174:6808/2760611848 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1214157dc0 con 0x7f11e40a1450 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.582+0000 7f9b597fa640 1 -- 10.20.193.78:0/366159292 <== osd.4 v1:10.20.193.78:6805/2928350245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f9b64158360 con 0x7f9b340a1470 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.582+0000 7f9b597fa640 10 client.4451.objecter ms_dispatch2 0x7f9b64000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.582+0000 7f9b597fa640 10 client.4451.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.582+0000 7f9b597fa640 20 client.4451.objecter put_session s=0x7f9b340a0dc0 osd=4 4 2026-02-25T15:13:04.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.582+0000 7f9b597fa640 15 client.4451.objecter _session_command_op_remove 4 2 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 10 librados: watch_flush enter 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 10 librados: watch_flush exit 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 10 client.4451.objecter close_session for osd.4 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 >> v1:10.20.193.78:6805/2928350245 conn(0x7f9b340a1470 legacy=0x7f9b340c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 20 client.4451.objecter put_session s=0x7f9b340a0dc0 osd=4 1 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 20 client.4451.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 10 client.4451.objecter successfully canceled tick 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 >> v1:10.20.193.78:6800/3497602169 conn(0x7f9b34077f40 legacy=0x7f9b340983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 10 monclient: shutdown 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 >> v1:10.20.193.167:6789/0 conn(0x7f9b64159e40 legacy=0x7f9b64161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b69589640 1 -- 10.20.193.78:0/366159292 reap_dead start 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 shutdown_connections 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 >> 10.20.193.78:0/366159292 conn(0x7f9b640b7780 msgr2=0x7f9b640b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 shutdown_connections 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 1 -- 10.20.193.78:0/366159292 wait complete. 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7f9b6b013640 1 librados: shutdown 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb21dffb640 1 -- 10.20.193.78:0/681108985 <== osd.13 v1:10.20.193.155:6800/4105183277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fb2300b7bf0 con 0x7fb2000a1460 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb21dffb640 10 client.4452.objecter ms_dispatch2 0x7fb230000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb21dffb640 10 client.4452.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb21dffb640 20 client.4452.objecter put_session s=0x7fb2000a0db0 osd=13 4 2026-02-25T15:13:04.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb21dffb640 15 client.4452.objecter _session_command_op_remove 13 2 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 10 librados: watch_flush enter 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 10 librados: watch_flush exit 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 10 client.4452.objecter close_session for osd.13 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 >> v1:10.20.193.155:6800/4105183277 conn(0x7fb2000a1460 legacy=0x7fb2000c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 20 client.4452.objecter put_session s=0x7fb2000a0db0 osd=13 1 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 20 client.4452.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 10 client.4452.objecter successfully canceled tick 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 >> v1:10.20.193.78:6800/3497602169 conn(0x7fb200077f30 legacy=0x7fb2000983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 10 monclient: shutdown 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 >> v1:10.20.193.78:6789/0 conn(0x7fb230058070 legacy=0x7fb230162dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb235fe0640 1 -- 10.20.193.78:0/681108985 reap_dead start 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 shutdown_connections 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.583+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 >> 10.20.193.78:0/681108985 conn(0x7fb2300b7780 msgr2=0x7fb230058460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 shutdown_connections 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7fb237a6a640 1 -- 10.20.193.78:0/681108985 wait complete. 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7fb237a6a640 1 librados: shutdown 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f11effff640 1 -- 10.20.193.78:0/840803162 <== osd.15 v1:10.20.193.174:6808/2760611848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f1214157dc0 con 0x7f11e40a1450 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f11effff640 10 client.4457.objecter ms_dispatch2 0x7f1214000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f11effff640 10 client.4457.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f11effff640 20 client.4457.objecter put_session s=0x7f11e40a0da0 osd=15 4 2026-02-25T15:13:04.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f11effff640 15 client.4457.objecter _session_command_op_remove 15 2 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 10 librados: watch_flush enter 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 10 librados: watch_flush exit 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 10 client.4457.objecter close_session for osd.15 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 >> v1:10.20.193.174:6808/2760611848 conn(0x7f11e40a1450 legacy=0x7f11e40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 20 client.4457.objecter put_session s=0x7f11e40a0da0 osd=15 1 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 20 client.4457.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 10 client.4457.objecter successfully canceled tick 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 >> v1:10.20.193.78:6800/3497602169 conn(0x7f11e4077ee0 legacy=0x7f11e4098390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 10 monclient: shutdown 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 >> v1:10.20.193.167:6789/0 conn(0x7f12140b9f80 legacy=0x7f121415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1213fff640 1 -- 10.20.193.78:0/840803162 reap_dead start 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 shutdown_connections 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.584+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 >> 10.20.193.78:0/840803162 conn(0x7f12140b7990 msgr2=0x7f121415ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.585+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 shutdown_connections 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.585+0000 7f1219cfb640 1 -- 10.20.193.78:0/840803162 wait complete. 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.585+0000 7f1219cfb640 1 librados: shutdown 2026-02-25T15:13:04.604 INFO:teuthology.orchestra.run.trial078.stdout:94489280518 2026-02-25T15:13:04.605 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-25T15:13:04.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.589+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== osd.0 v1:10.20.193.78:6801/3604255984 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f13ec0c3070 con 0x7f13ec0a1470 2026-02-25T15:13:04.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.589+0000 7f1409ffb640 10 client.4440.objecter ms_dispatch2 0x7f141c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:13:04.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.589+0000 7f1409ffb640 10 client.4440.objecter _finish_command 1 = system:0 2026-02-25T15:13:04.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.589+0000 7f1409ffb640 20 client.4440.objecter put_session s=0x7f13ec0a0dc0 osd=0 4 2026-02-25T15:13:04.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.589+0000 7f1409ffb640 15 client.4440.objecter _session_command_op_remove 0 1 2026-02-25T15:13:04.605 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.605 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-25T15:13:04.606 INFO:teuthology.orchestra.run.trial078.stdout:90194313220 2026-02-25T15:13:04.606 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-25T15:13:04.606 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.606 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 10 client.4440.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 15 client.4440.objecter _session_command_op_assign -1 2 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 20 client.4440.objecter _get_session s=0x7f13ec0a0dc0 osd=0 3 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 20 client.4440.objecter put_session s=0x7f13ec0a0dc0 osd=0 3 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 20 client.4440.objecter _get_session s=0x7f13ec0a0dc0 osd=0 3 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 15 client.4440.objecter _session_command_op_remove -1 2 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 20 client.4440.objecter get_session s=0x7f13ec0a0dc0 osd=0 3 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 15 client.4440.objecter _session_command_op_assign 0 2 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 20 client.4440.objecter put_session s=0x7f13ec0a0dc0 osd=0 4 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 10 client.4440.objecter _send_command 2 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.597+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 --> v1:10.20.193.78:6801/3604255984 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f141c15acf0 con 0x7f13ec0a1470 2026-02-25T15:13:04.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1409ffb640 1 -- 10.20.193.78:0/2821587187 <== osd.0 v1:10.20.193.78:6801/3604255984 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f141c15acf0 con 0x7f13ec0a1470 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1409ffb640 10 client.4440.objecter ms_dispatch2 0x7f141c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1409ffb640 10 client.4440.objecter _finish_command 2 = system:0 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1409ffb640 20 client.4440.objecter put_session s=0x7f13ec0a0dc0 osd=0 4 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1409ffb640 15 client.4440.objecter _session_command_op_remove 0 2 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 10 librados: watch_flush enter 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 10 librados: watch_flush exit 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 10 client.4440.objecter close_session for osd.0 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 >> v1:10.20.193.78:6801/3604255984 conn(0x7f13ec0a1470 legacy=0x7f13ec0c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 20 client.4440.objecter put_session s=0x7f13ec0a0dc0 osd=0 1 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 20 client.4440.objecter shutdown clearing up homeless session... 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 10 client.4440.objecter successfully canceled tick 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 >> v1:10.20.193.78:6800/3497602169 conn(0x7f13ec077f40 legacy=0x7f13ec0983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 10 monclient: shutdown 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 >> v1:10.20.193.78:6789/0 conn(0x7f141c0585e0 legacy=0x7f141c0b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1421b9a640 1 -- 10.20.193.78:0/2821587187 reap_dead start 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 shutdown_connections 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 >> 10.20.193.78:0/2821587187 conn(0x7f141c0b7990 msgr2=0x7f141c15b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 shutdown_connections 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 1 -- 10.20.193.78:0/2821587187 wait complete. 2026-02-25T15:13:04.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.600+0000 7f1423624640 1 librados: shutdown 2026-02-25T15:13:04.612 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:04.612 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.653+0000 7f03ec32e640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.653+0000 7f03ec32e640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.653+0000 7f03ec32e640 10 monclient: monmap: 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.654464+0000 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.654464+0000 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.655 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.654+0000 7f03ec32e640 1 Processor -- start 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.654+0000 7f03ec32e640 1 -- start start 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.654+0000 7f03ec32e640 10 monclient: init 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 10 monclient(hunting): picked mon.noname-c con 0x7f03e40b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 10 monclient(hunting): picked mon.noname-b con 0x7f03e40ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 10 monclient(hunting): picked mon.noname-a con 0x7f03e40585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e4163930 con 0x7f03e40585e0 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e4163bb0 con 0x7f03e40ba350 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e4163e90 con 0x7f03e40b9f80 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ec32e640 10 monclient(hunting): authenticate will time out at 3354.244272s 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ea0a3640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f03e40b9f80 0x7f03e4163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50824/0 (socket says 10.20.193.78:50824) 2026-02-25T15:13:04.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.655+0000 7f03ea0a3640 1 -- 10.20.193.78:0/2650289852 learned_addr learned my addr 10.20.193.78:0/2650289852 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2295135436 0 0) 0x7f03e4163bb0 con 0x7f03e40ba350 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 10 monclient(hunting): my global_id is 4486 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03cc003610 con 0x7f03e40ba350 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694612042 0 0) 0x7f03e4163e90 con 0x7f03e40b9f80 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 10 monclient(hunting): my global_id is 4460 2026-02-25T15:13:04.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.657+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03e4163bb0 con 0x7f03e40b9f80 2026-02-25T15:13:04.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.658+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767683489 0 0) 0x7f03e0002c90 con 0x7f03e40585e0 2026-02-25T15:13:04.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.658+0000 7f03e90a1640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.658+0000 7f03e90a1640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.658+0000 7f03e90a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.658+0000 7f03e90a1640 10 monclient(hunting): my global_id is 4467 2026-02-25T15:13:04.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.658+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03e4163e90 con 0x7f03e40585e0 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1123076071 0 0) 0x7f03cc003610 con 0x7f03e40ba350 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 >> v1:10.20.193.167:6789/0 conn(0x7f03e40b9f80 legacy=0x7f03e4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 >> v1:10.20.193.78:6789/0 conn(0x7f03e40585e0 legacy=0x7f03e4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e40573f0 con 0x7f03e40ba350 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f03d8002df0 con 0x7f03e40ba350 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03ec32e640 5 monclient: authenticate success, global_id 4486 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03ec32e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03e90a1640 10 monclient: dump: 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.661 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f03ec32e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f6bc7de3640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f6bc7de3640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.659+0000 7f6bc7de3640 10 monclient: monmap: 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.660863+0000 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.660863+0000 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.660+0000 7f6bc7de3640 1 Processor -- start 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.660+0000 7f6bc7de3640 1 -- start start 2026-02-25T15:13:04.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.660+0000 7f6bc7de3640 10 monclient: init 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 10 monclient(hunting): picked mon.noname-a con 0x7f6bc0157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 10 monclient(hunting): picked mon.noname-c con 0x7f6bc0157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 10 monclient(hunting): picked mon.noname-b con 0x7f6bc0164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc005de70 con 0x7f6bc0157780 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc0055b20 con 0x7f6bc0164d00 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc0055e00 con 0x7f6bc0157b50 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.661+0000 7f6bc7de3640 10 monclient(hunting): authenticate will time out at 3354.250673s 2026-02-25T15:13:04.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03d8003000 con 0x7f03e40ba350 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f03e90a1640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f03e90a1640 1 -- 10.20.193.78:0/2650289852 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f03d8003400 con 0x7f03e40ba350 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f03ec32e640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f03ec32e640 4 set_mon_vals no callback set 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f03e90a1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f03e90a1640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f6bc5b58640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6bc0157780 0x7f6bc0056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37086/0 (socket says 10.20.193.78:37086) 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f6bc5b58640 1 -- 10.20.193.78:0/3094868143 learned_addr learned my addr 10.20.193.78:0/3094868143 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.662+0000 7f03e90a1640 10 monclient: dump: 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.663+0000 7f03ec32e640 10 monclient: shutdown 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.663+0000 7f03ec32e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.663+0000 7f03ec32e640 1 -- 10.20.193.78:0/2650289852 >> v1:10.20.193.155:6789/0 conn(0x7f03e40ba350 legacy=0x7f03e4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.663+0000 7f03ec32e640 1 -- 10.20.193.78:0/2650289852 shutdown_connections 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.663+0000 7f03ec32e640 1 -- 10.20.193.78:0/2650289852 >> 10.20.193.78:0/2650289852 conn(0x7f03e40b7990 msgr2=0x7f03e40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.663+0000 7f03ec32e640 1 -- 10.20.193.78:0/2650289852 shutdown_connections 2026-02-25T15:13:04.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.663+0000 7f03ec32e640 1 -- 10.20.193.78:0/2650289852 wait complete. 2026-02-25T15:13:04.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107784674 0 0) 0x7f6bc0055b20 con 0x7f6bc0164d00 2026-02-25T15:13:04.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): my global_id is 4489 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ba8003610 con 0x7f6bc0164d00 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853758764 0 0) 0x7f6bc005de70 con 0x7f6bc0157780 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): my global_id is 4470 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc0055b20 con 0x7f6bc0157780 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054641564 0 0) 0x7f6bc0055e00 con 0x7f6bc0157b50 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 10 monclient(hunting): my global_id is 4463 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc005de70 con 0x7f6bc0157b50 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 10 monclient: monmap: 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 1 librados: starting msgr at 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 1 librados: starting objecter 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 1 Processor -- start 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 1 -- start start 2026-02-25T15:13:04.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 1 librados: setting wanted keys 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 1 librados: calling monclient init 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.664+0000 7f03ec32e640 10 monclient: init 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 10 monclient(hunting): picked mon.noname-b con 0x7f03e40585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 10 monclient(hunting): picked mon.noname-a con 0x7f03e40b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 10 monclient(hunting): picked mon.noname-c con 0x7f03e40ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e41fca90 con 0x7f03e40b9f80 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e41fcd70 con 0x7f03e40585e0 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e41fd050 con 0x7f03e40ba350 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.665+0000 7f03ec32e640 10 monclient(hunting): authenticate will time out at 3354.254695s 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3813996982 0 0) 0x7f6ba8003610 con 0x7f6bc0164d00 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 >> v1:10.20.193.167:6789/0 conn(0x7f6bc0157b50 legacy=0x7f6bc01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 >> v1:10.20.193.78:6789/0 conn(0x7f6bc0157780 legacy=0x7f6bc0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc00560e0 con 0x7f6bc0164d00 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f03ea8a4640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f03e40ba350 0x7f03e40b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50844/0 (socket says 10.20.193.78:50844) 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f03ea8a4640 1 -- 10.20.193.78:0/2141159309 learned_addr learned my addr 10.20.193.78:0/2141159309 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6bbc003170 con 0x7f6bc0164d00 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc4b56640 10 monclient: dump: 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc7de3640 5 monclient: authenticate success, global_id 4489 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f6bc7de3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f03caffd640 10 client.?.objecter ms_handle_connect 0x7f03e40ba350 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f03caffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f03caffd640 10 client.?.objecter ms_handle_connect 0x7f03e40585e0 2026-02-25T15:13:04.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.666+0000 7f03caffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f03caffd640 10 client.?.objecter ms_handle_connect 0x7f03e40b9f80 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f03caffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bbc003310 con 0x7f6bc0164d00 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f6bc4b56640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f6bc4b56640 1 -- 10.20.193.78:0/3094868143 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6bbc003720 con 0x7f6bc0164d00 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f6bc7de3640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f6bc7de3640 4 set_mon_vals no callback set 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f6bc4b56640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f6bc4b56640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.667+0000 7f6bc4b56640 10 monclient: dump: 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291018859 0 0) 0x7f03e41fcd70 con 0x7f03e40585e0 2026-02-25T15:13:04.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f6bc7de3640 10 monclient: shutdown 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f6bc7de3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3094868143 >> v1:10.20.193.155:6789/0 conn(0x7f6bc0164d00 legacy=0x7f6bc01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 10 monclient(hunting): my global_id is 4492 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b4003610 con 0x7f03e40585e0 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3094868143 shutdown_connections 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3094868143 >> 10.20.193.78:0/3094868143 conn(0x7f6bc00b2ef0 msgr2=0x7f6bc00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1483937721 0 0) 0x7f03e41fd050 con 0x7f03e40ba350 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3094868143 shutdown_connections 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 10 monclient(hunting): my global_id is 4466 2026-02-25T15:13:04.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03e41fcd70 con 0x7f03e40ba350 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.668+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3094868143 wait complete. 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 10 monclient: monmap: 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 1 librados: starting msgr at 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 1 librados: starting objecter 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 1 Processor -- start 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 1 -- start start 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 1 librados: setting wanted keys 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 1 librados: calling monclient init 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.669+0000 7f6bc7de3640 10 monclient: init 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802540473 0 0) 0x7f03e41fca90 con 0x7f03e40b9f80 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f03caffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f03caffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f03caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f03caffd640 10 monclient(hunting): my global_id is 4473 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03e41fd050 con 0x7f03e40b9f80 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 10 monclient(hunting): picked mon.noname-c con 0x7f6bc0157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 10 monclient(hunting): picked mon.noname-b con 0x7f6bc0157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 10 monclient(hunting): picked mon.noname-a con 0x7f6bc0164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc00aee30 con 0x7f6bc0164d00 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc0152d10 con 0x7f6bc0157b50 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc0152fb0 con 0x7f6bc0157780 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.670+0000 7f6bc7de3640 10 monclient(hunting): authenticate will time out at 3354.259645s 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1135007757 0 0) 0x7f03e41fcd70 con 0x7f03e40ba350 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03e41fca90 con 0x7f03e40ba350 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f03e0003440 con 0x7f03e40ba350 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f6bc5b58640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f6bc0157780 0x7f6bc00b1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:50850/0 (socket says 10.20.193.78:50850) 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f6bc5b58640 1 -- 10.20.193.78:0/3933005757 learned_addr learned my addr 10.20.193.78:0/3933005757 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 206485873 0 0) 0x7f03b4003610 con 0x7f03e40585e0 2026-02-25T15:13:04.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03e41fcd70 con 0x7f03e40585e0 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f03d4002fa0 con 0x7f03e40585e0 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.671+0000 7f03caffd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.672+0000 7f6bae7fc640 10 client.?.objecter ms_handle_connect 0x7f6bc0157b50 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.672+0000 7f6bae7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f6bae7fc640 10 client.?.objecter ms_handle_connect 0x7f6bc0157780 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f6bae7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1249046648 0 0) 0x7f03e41fca90 con 0x7f03e40ba350 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 >> v1:10.20.193.155:6789/0 conn(0x7f03e40585e0 legacy=0x7f03e41fde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 >> v1:10.20.193.78:6789/0 conn(0x7f03e40b9f80 legacy=0x7f03e4155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 1 monclient: found mon.c 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e41fd330 con 0x7f03e40ba350 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 5 monclient: authenticate success, global_id 4466 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 10 monclient: _renew_subs 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03e41fd610 con 0x7f03e40ba350 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 10 client.4466.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 10 monclient: _renew_subs 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f03e41f91b0 con 0x7f03e40ba350 2026-02-25T15:13:04.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.673+0000 7f03ec32e640 1 librados: init done 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f03c8ff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f03c8ff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f03c8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f03c8ff9640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a4005180 con 0x7f03e40ba350 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f90e1783640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f90e1783640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f90e1783640 10 monclient: monmap: 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.675432+0000 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.675432+0000 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3971984548 0 0) 0x7f6bc0152fb0 con 0x7f6bc0157780 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f6bae7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f6bae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f6bae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.674+0000 7f6bae7fc640 10 monclient(hunting): my global_id is 4469 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b90003610 con 0x7f6bc0157780 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773660083 0 0) 0x7f6bc0152d10 con 0x7f6bc0157b50 2026-02-25T15:13:04.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 10 monclient(hunting): my global_id is 4495 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc0152fb0 con 0x7f6bc0157b50 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 1 Processor -- start 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 1 -- start start 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 10 monclient: init 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 10 client.?.objecter ms_handle_connect 0x7f6bc0164d00 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f6bae7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 10 monclient(hunting): picked mon.noname-b con 0x7f90dc159da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 10 monclient(hunting): picked mon.noname-c con 0x7f90dc165880 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 10 monclient(hunting): picked mon.noname-a con 0x7f90dc056090 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90dc15a170 con 0x7f90dc056090 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90dc0b4650 con 0x7f90dc159da0 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90dc0b4930 con 0x7f90dc165880 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.675+0000 7f90e1783640 10 monclient(hunting): authenticate will time out at 3354.264995s 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.676+0000 7ff2be934640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.676+0000 7ff2be934640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.676+0000 7ff2be934640 10 monclient: monmap: 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.677019+0000 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.677019+0000 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.676+0000 7ff2be934640 1 Processor -- start 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.676+0000 7ff2be934640 1 -- start start 2026-02-25T15:13:04.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.676+0000 7ff2be934640 10 monclient: init 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 10 monclient(hunting): picked mon.noname-c con 0x7ff2b8157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 10 monclient(hunting): picked mon.noname-b con 0x7ff2b8157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 10 monclient(hunting): picked mon.noname-a con 0x7ff2b8164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b805de70 con 0x7ff2b8164d00 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4262508824 0 0) 0x7f6bc0152fb0 con 0x7f6bc0157b50 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bc0152d10 con 0x7f6bc0157b50 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b8055b20 con 0x7ff2b8157b50 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b8055e00 con 0x7ff2b8157780 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7ff2be934640 10 monclient(hunting): authenticate will time out at 3354.266685s 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6bb40031a0 con 0x7f6bc0157b50 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f6bae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f6bae7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f6bae7fc640 10 monclient(hunting): dump: 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.679 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f6bae7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f90daffd640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f90dc159da0 0x7f90dc165170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:57998/0 (socket says 10.20.193.78:57998) 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.677+0000 7f90daffd640 1 -- 10.20.193.78:0/1921126379 learned_addr learned my addr 10.20.193.78:0/1921126379 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.678+0000 7ff2b77fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7ff2b8157b50 0x7ff2b81645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58010/0 (socket says 10.20.193.78:58010) 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.678+0000 7ff2b77fe640 1 -- 10.20.193.78:0/524669612 learned_addr learned my addr 10.20.193.78:0/524669612 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.678+0000 7fa3493ed640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.678+0000 7fa3493ed640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.678+0000 7fa3493ed640 10 monclient: monmap: 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.679609+0000 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.679609+0000 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.679+0000 7fa3493ed640 1 Processor -- start 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.679+0000 7fa3493ed640 1 -- start start 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.679+0000 7fa3493ed640 10 monclient: init 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.679+0000 7f284689f640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.679+0000 7f284689f640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.679+0000 7f284689f640 10 monclient: monmap: 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.680549+0000 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.680549+0000 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 1 Processor -- start 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 1 -- start start 2026-02-25T15:13:04.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 10 monclient: init 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 10 monclient(hunting): picked mon.noname-c con 0x7fa3440b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 10 monclient(hunting): picked mon.noname-b con 0x7fa3440ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 10 monclient(hunting): picked mon.noname-a con 0x7fa3440585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa344163930 con 0x7fa3440585e0 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354093826 0 0) 0x7f6bc00560e0 con 0x7f6bc0164d00 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f6bae7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f6bae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa344163bb0 con 0x7fa3440ba350 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f6bae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f6bae7fc640 10 monclient(hunting): my global_id is 4476 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc0152fb0 con 0x7f6bc0164d00 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 10 monclient(hunting): picked mon.noname-b con 0x7f28400b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa344163e90 con 0x7fa3440b9f80 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7fa3493ed640 10 monclient(hunting): authenticate will time out at 3354.269649s 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 10 monclient(hunting): picked mon.noname-c con 0x7f28400ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 10 monclient(hunting): picked mon.noname-a con 0x7f28400585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2840163930 con 0x7f28400585e0 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2840163bb0 con 0x7f28400b9f80 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2840163e90 con 0x7f28400ba350 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.680+0000 7f284689f640 10 monclient(hunting): authenticate will time out at 3354.269780s 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2141116645 0 0) 0x7f6bc0152d10 con 0x7f6bc0157b50 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 >> v1:10.20.193.167:6789/0 conn(0x7f6bc0157780 legacy=0x7f6bc00b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 >> v1:10.20.193.78:6789/0 conn(0x7f6bc0164d00 legacy=0x7f6bc01348f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 1 monclient: found mon.b 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc0153290 con 0x7f6bc0157b50 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 5 monclient: authenticate success, global_id 4495 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 10 monclient: _renew_subs 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc0153570 con 0x7f6bc0157b50 2026-02-25T15:13:04.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 10 client.4495.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 10 monclient: _renew_subs 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6bc0153b30 con 0x7f6bc0157b50 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f6bc7de3640 1 librados: init done 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597012869 0 0) 0x7f90dc0b4650 con 0x7f90dc159da0 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f90d9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f90d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f90d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.681+0000 7f90d9ffb640 10 monclient(hunting): my global_id is 4498 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90c8003610 con 0x7f90dc159da0 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7f6bc7de3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7f6bc7de3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7f6bc7de3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc00b0810 con 0x7f6bc0157b50 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3044813562 0 0) 0x7ff2b8055b20 con 0x7ff2b8157b50 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7ff2b6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7ff2b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7ff2b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7ff2b6ffd640 10 monclient(hunting): my global_id is 4501 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff29c003610 con 0x7ff2b8157b50 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7fa3427fc640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fa3440ba350 0x7fa344057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58018/0 (socket says 10.20.193.78:58018) 2026-02-25T15:13:04.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7fa3427fc640 1 -- 10.20.193.78:0/3198375306 learned_addr learned my addr 10.20.193.78:0/3198375306 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7f283ffff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f28400b9f80 0x7f2840163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58032/0 (socket says 10.20.193.78:58032) 2026-02-25T15:13:04.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.682+0000 7f283ffff640 1 -- 10.20.193.78:0/2065659943 learned_addr learned my addr 10.20.193.78:0/2065659943 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.687+0000 7f49f42cd640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.687+0000 7f49f42cd640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.687+0000 7f49f42cd640 10 monclient: monmap: 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.688794+0000 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.688794+0000 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f49f42cd640 1 Processor -- start 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850901620 0 0) 0x7f90dc15a170 con 0x7f90dc056090 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f90d9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f90d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f90d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f90d9ffb640 10 monclient(hunting): my global_id is 4479 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90dc0b4650 con 0x7f90dc056090 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f49f42cd640 1 -- start start 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f49f42cd640 10 monclient: init 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796753680 0 0) 0x7ff2b805de70 con 0x7ff2b8164d00 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7ff2b6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7ff2b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7ff2b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7ff2b6ffd640 10 monclient(hunting): my global_id is 4482 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2b8055b20 con 0x7ff2b8164d00 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f193a09c640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f193a09c640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7f193a09c640 10 monclient: monmap: 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.689472+0000 2026-02-25T15:13:04.690 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.689472+0000 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7fa277632640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7fa277632640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.688+0000 7fa277632640 10 monclient: monmap: 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.689736+0000 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.689736+0000 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 10 monclient(hunting): picked mon.noname-b con 0x7f49ec15dde0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 10 monclient(hunting): picked mon.noname-a con 0x7f49ec0ba140 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 10 monclient(hunting): picked mon.noname-c con 0x7f49ec0b1f20 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ec0adf50 con 0x7f49ec0ba140 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ec0b56f0 con 0x7f49ec15dde0 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ec0b59d0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f49f42cd640 10 monclient(hunting): authenticate will time out at 3354.278185s 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 1 Processor -- start 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 1 -- start start 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 10 monclient: init 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f7714482640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f7714482640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f7714482640 10 monclient: monmap: 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.690112+0000 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.690112+0000 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7fa277632640 1 Processor -- start 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7fa277632640 1 -- start start 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7fa277632640 10 monclient: init 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7fe9737e1640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7fe9737e1640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7fe9737e1640 10 monclient: monmap: 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.692 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.690684+0000 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.690684+0000 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 10 monclient(hunting): picked mon.noname-c con 0x7f1934161430 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 10 monclient(hunting): picked mon.noname-a con 0x7f1934161800 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 10 monclient(hunting): picked mon.noname-b con 0x7f193416ad30 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340b1800 con 0x7f1934161800 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340b1ae0 con 0x7f193416ad30 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340b1dc0 con 0x7f1934161430 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7f193a09c640 10 monclient(hunting): authenticate will time out at 3354.278892s 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.689+0000 7fa277632640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 10 monclient(hunting): picked mon.noname-b con 0x7fa2700b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 10 monclient(hunting): picked mon.noname-c con 0x7fa2700ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 10 monclient(hunting): picked mon.noname-a con 0x7fa2700585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa270163930 con 0x7fa2700585e0 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa270163bb0 con 0x7fa2700b9f80 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa270163e90 con 0x7fa2700ba350 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa277632640 10 monclient(hunting): authenticate will time out at 3354.279077s 2026-02-25T15:13:04.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 1 Processor -- start 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 1 -- start start 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 10 monclient: init 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fe9737e1640 1 Processor -- start 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fe9737e1640 1 -- start start 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fe9737e1640 10 monclient: init 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286206716 0 0) 0x7fa334002c90 con 0x7fa3440585e0 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa341ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa341ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa341ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa341ffb640 10 monclient(hunting): my global_id is 4485 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa330003610 con 0x7fa3440585e0 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 10 monclient(hunting): picked mon.noname-a con 0x7f770c0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 10 monclient(hunting): picked mon.noname-b con 0x7f770c0ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 10 monclient(hunting): picked mon.noname-c con 0x7f770c0585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770c163930 con 0x7f770c0b9f80 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770c163bb0 con 0x7f770c0ba350 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770c163e90 con 0x7f770c0585e0 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.690+0000 7f7714482640 10 monclient(hunting): authenticate will time out at 3354.279983s 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 10 monclient(hunting): picked mon.noname-a con 0x7fe96c0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 10 monclient(hunting): picked mon.noname-c con 0x7fe96c0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 10 monclient(hunting): picked mon.noname-b con 0x7fe96c0585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96c163930 con 0x7fe96c0b9f80 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96c163bb0 con 0x7fe96c0585e0 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96c163e90 con 0x7fe96c0ba350 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fe9737e1640 10 monclient(hunting): authenticate will time out at 3354.280396s 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293764104 0 0) 0x7fa344163bb0 con 0x7fa3440ba350 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fa341ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fa341ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fa341ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fa341ffb640 10 monclient(hunting): my global_id is 4504 2026-02-25T15:13:04.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa334002c90 con 0x7fa3440ba350 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1982117300 0 0) 0x7ff29c003610 con 0x7ff2b8157b50 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 >> v1:10.20.193.167:6789/0 conn(0x7ff2b8157780 legacy=0x7ff2b8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 >> v1:10.20.193.78:6789/0 conn(0x7ff2b8164d00 legacy=0x7ff2b81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 1 monclient: found mon.noname-b 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b80560e0 con 0x7ff2b8157b50 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff2a8002df0 con 0x7ff2b8157b50 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2b6ffd640 10 monclient: dump: 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2be934640 5 monclient: authenticate success, global_id 4501 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.691+0000 7ff2be934640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.693+0000 7f3ed212c640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.693+0000 7f3ed212c640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.693+0000 7f3ed212c640 10 monclient: monmap: 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.694461+0000 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.694461+0000 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.696 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.693+0000 7f7bf2ad0640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.693+0000 7f7bf2ad0640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.693+0000 7f7bf2ad0640 10 monclient: monmap: 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.694449+0000 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.694449+0000 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 1 Processor -- start 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 1 -- start start 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 10 monclient: init 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f3ed212c640 1 Processor -- start 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f3ed212c640 1 -- start start 2026-02-25T15:13:04.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f3ed212c640 10 monclient: init 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 10 monclient(hunting): picked mon.noname-c con 0x7f7bec157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 10 monclient(hunting): picked mon.noname-b con 0x7f7bec157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 10 monclient(hunting): picked mon.noname-a con 0x7f7bec164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bec05de70 con 0x7f7bec164d00 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093929170 0 0) 0x7f2834002c90 con 0x7f28400585e0 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bec055b20 con 0x7f7bec157b50 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f283effd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f283effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f283effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f283effd640 10 monclient(hunting): my global_id is 4488 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2824003610 con 0x7f28400585e0 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bec055e00 con 0x7f7bec157780 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.694+0000 7f7bf2ad0640 10 monclient(hunting): authenticate will time out at 3354.283974s 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f49f1841640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f49ec0ba140 0x7f49ec0ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37174/0 (socket says 10.20.193.78:37174) 2026-02-25T15:13:04.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f49f1841640 1 -- 10.20.193.78:0/2672532816 learned_addr learned my addr 10.20.193.78:0/2672532816 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1057874314 0 0) 0x7fa330003610 con 0x7fa3440585e0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 >> v1:10.20.193.167:6789/0 conn(0x7fa3440b9f80 legacy=0x7fa344163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 >> v1:10.20.193.155:6789/0 conn(0x7fa3440ba350 legacy=0x7fa344057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3440573f0 con 0x7fa3440585e0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa334003340 con 0x7fa3440585e0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa341ffb640 10 monclient: dump: 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa3493ed640 5 monclient: authenticate success, global_id 4485 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7fa3493ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 10 monclient(hunting): picked mon.noname-a con 0x7f3ecc0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 10 monclient(hunting): picked mon.noname-b con 0x7f3ecc0ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 10 monclient(hunting): picked mon.noname-c con 0x7f3ecc0585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ecc163930 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ecc163bb0 con 0x7f3ecc0ba350 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ecc163e90 con 0x7f3ecc0585e0 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f3ed212c640 10 monclient(hunting): authenticate will time out at 3354.284531s 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f6f6cfa2640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f6f6cfa2640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.695+0000 7f6f6cfa2640 10 monclient: monmap: 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.696536+0000 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.696536+0000 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 1 Processor -- start 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 1 -- start start 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 10 monclient: init 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 10 monclient(hunting): picked mon.noname-a con 0x7f6f680b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 10 monclient(hunting): picked mon.noname-c con 0x7f6f680ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 10 monclient(hunting): picked mon.noname-b con 0x7f6f680585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f68163930 con 0x7f6f680b9f80 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f68163bb0 con 0x7f6f680585e0 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f68163e90 con 0x7f6f680ba350 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.696+0000 7f6f6cfa2640 10 monclient(hunting): authenticate will time out at 3354.285946s 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 63616654 0 0) 0x7f90dc0b4650 con 0x7f90dc056090 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 >> v1:10.20.193.167:6789/0 conn(0x7f90dc165880 legacy=0x7f90dc055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 >> v1:10.20.193.155:6789/0 conn(0x7f90dc159da0 legacy=0x7f90dc165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc0b4c10 con 0x7f90dc056090 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f90cc003170 con 0x7f90dc056090 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90e1783640 5 monclient: authenticate success, global_id 4479 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90d9ffb640 10 monclient: dump: 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.699+0000 7f90e1783640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7fbb927fa640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7fbb927fa640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7fbb927fa640 10 monclient: monmap: 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.700941+0000 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.700941+0000 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7f77121f7640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f770c0b9f80 0x7f770c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37208/0 (socket says 10.20.193.78:37208) 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7f77121f7640 1 -- 10.20.193.78:0/1884788952 learned_addr learned my addr 10.20.193.78:0/1884788952 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7fbb927fa640 1 Processor -- start 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7fa275ba8640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa2700585e0 0x7fa270166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37192/0 (socket says 10.20.193.78:37192) 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7fa275ba8640 1 -- 10.20.193.78:0/3398375082 learned_addr learned my addr 10.20.193.78:0/3398375082 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7fbb927fa640 1 -- start start 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7fbb927fa640 10 monclient: init 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7f1932ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f1934161800 0x7f1934168c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37186/0 (socket says 10.20.193.78:37186) 2026-02-25T15:13:04.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.700+0000 7f1932ffd640 1 -- 10.20.193.78:0/2865886643 learned_addr learned my addr 10.20.193.78:0/2865886643 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 10 monclient(hunting): picked mon.noname-a con 0x7fbb8c0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 10 monclient(hunting): picked mon.noname-c con 0x7fbb8c0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 10 monclient(hunting): picked mon.noname-b con 0x7fbb8c0585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c163930 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c163bb0 con 0x7fbb8c0585e0 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c163e90 con 0x7fbb8c0ba350 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.701+0000 7fbb927fa640 10 monclient(hunting): authenticate will time out at 3354.290304s 2026-02-25T15:13:04.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.703+0000 7fe971556640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe96c0b9f80 0x7fe96c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37216/0 (socket says 10.20.193.78:37216) 2026-02-25T15:13:04.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.703+0000 7f3ecb7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3ecc0b9f80 0x7f3ecc163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37244/0 (socket says 10.20.193.78:37244) 2026-02-25T15:13:04.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.703+0000 7fe971556640 1 -- 10.20.193.78:0/4171629696 learned_addr learned my addr 10.20.193.78:0/4171629696 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.703+0000 7f3ecb7fe640 1 -- 10.20.193.78:0/740681351 learned_addr learned my addr 10.20.193.78:0/740681351 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.703+0000 7f7bf1046640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7bec164d00 0x7f7bec1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37232/0 (socket says 10.20.193.78:37232) 2026-02-25T15:13:04.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.703+0000 7f7bf1046640 1 -- 10.20.193.78:0/634737187 learned_addr learned my addr 10.20.193.78:0/634737187 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa334003550 con 0x7fa3440585e0 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa341ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa341ffb640 1 -- 10.20.193.78:0/3198375306 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa334003a80 con 0x7fa3440585e0 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa341ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa341ffb640 10 monclient: dump: 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.706 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 4 set_mon_vals no callback set 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 10 monclient: shutdown 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 1 -- 10.20.193.78:0/3198375306 >> v1:10.20.193.78:6789/0 conn(0x7fa3440585e0 legacy=0x7fa344166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 1 -- 10.20.193.78:0/3198375306 shutdown_connections 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 1 -- 10.20.193.78:0/3198375306 >> 10.20.193.78:0/3198375306 conn(0x7fa3440b7990 msgr2=0x7fa3440b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 1 -- 10.20.193.78:0/3198375306 shutdown_connections 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7fa3493ed640 1 -- 10.20.193.78:0/3198375306 wait complete. 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7f6f66575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6f680b9f80 0x7f6f68163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37254/0 (socket says 10.20.193.78:37254) 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7f6f66575640 1 -- 10.20.193.78:0/133191278 learned_addr learned my addr 10.20.193.78:0/133191278 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.705+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2756961002 0 0) 0x7f2824003610 con 0x7f28400585e0 2026-02-25T15:13:04.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 >> v1:10.20.193.167:6789/0 conn(0x7f28400ba350 legacy=0x7f2840057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 >> v1:10.20.193.155:6789/0 conn(0x7f28400b9f80 legacy=0x7f2840163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28400573f0 con 0x7f28400585e0 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2834003340 con 0x7f28400585e0 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f283effd640 10 monclient: dump: 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f284689f640 5 monclient: authenticate success, global_id 4488 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f284689f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 10 monclient: monmap: 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.708 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 1 librados: starting msgr at 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 1 librados: starting objecter 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 1 Processor -- start 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2716007639 0 0) 0x7f49ec0adf50 con 0x7f49ec0ba140 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f49f1040640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f49f1040640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f49f1040640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f49f1040640 10 monclient(hunting): my global_id is 4491 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49d4003610 con 0x7f49ec0ba140 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 1 -- start start 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 1 librados: setting wanted keys 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 1 librados: calling monclient init 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.706+0000 7fa3493ed640 10 monclient: init 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 10 monclient(hunting): picked mon.noname-b con 0x7fa3440585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 10 monclient(hunting): picked mon.noname-a con 0x7fa3440b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 10 monclient(hunting): picked mon.noname-c con 0x7fa3440ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3441fd360 con 0x7fa3440b9f80 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3441fd640 con 0x7fa3440585e0 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3441fd920 con 0x7fa3440ba350 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.707+0000 7fa3493ed640 10 monclient(hunting): authenticate will time out at 3354.296216s 2026-02-25T15:13:04.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.708+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571588534 0 0) 0x7f19340b1800 con 0x7f1934161800 2026-02-25T15:13:04.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.708+0000 7f19327fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.708+0000 7f19327fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.708+0000 7f19327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.708+0000 7f19327fc640 10 monclient(hunting): my global_id is 4500 2026-02-25T15:13:04.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.708+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1918003610 con 0x7f1934161800 2026-02-25T15:13:04.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.710+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097836348 0 0) 0x7f7bec05de70 con 0x7f7bec164d00 2026-02-25T15:13:04.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.710+0000 7f7be37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.710+0000 7f7be37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.710+0000 7f7be37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.710+0000 7f7be37fe640 10 monclient(hunting): my global_id is 4509 2026-02-25T15:13:04.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.710+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd8003610 con 0x7f7bec164d00 2026-02-25T15:13:04.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.711+0000 7fbb8bfff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbb8c0b9f80 0x7fbb8c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37262/0 (socket says 10.20.193.78:37262) 2026-02-25T15:13:04.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.711+0000 7fbb8bfff640 1 -- 10.20.193.78:0/2367579667 learned_addr learned my addr 10.20.193.78:0/2367579667 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.711+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495314923 0 0) 0x7f76fc002910 con 0x7f770c0b9f80 2026-02-25T15:13:04.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.711+0000 7f77111f5640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.711+0000 7f77111f5640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.711+0000 7f77111f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.711+0000 7f77111f5640 10 monclient(hunting): my global_id is 4494 2026-02-25T15:13:04.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.711+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76f4003610 con 0x7f770c0b9f80 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558351381 0 0) 0x7fe960002910 con 0x7fe96c0b9f80 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fe95ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fe95ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fe95ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fe95ffff640 10 monclient(hunting): my global_id is 4503 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe954003610 con 0x7fe96c0b9f80 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497706859 0 0) 0x7fa26c002c90 con 0x7fa2700585e0 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fa25ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fa25ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fa25ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fa25ffff640 10 monclient(hunting): my global_id is 4497 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.712+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa258003610 con 0x7fa2700585e0 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276017447 0 0) 0x7f6f5c002910 con 0x7f6f680b9f80 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f6f65573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f6f65573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f6f65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f6f65573640 10 monclient(hunting): my global_id is 4512 2026-02-25T15:13:04.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f54003610 con 0x7f6f680b9f80 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f90cc003380 con 0x7f90dc056090 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f90d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f90e1783640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f90d9ffb640 1 -- 10.20.193.78:0/1921126379 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f90cc0037c0 con 0x7f90dc056090 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303791455 0 0) 0x7f3eb8002910 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f3eca7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f3eca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f3eca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f3eca7fc640 10 monclient(hunting): my global_id is 4506 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f90d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f90e1783640 4 set_mon_vals no callback set 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f90d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f90d9ffb640 10 monclient: dump: 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.713+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eb0003610 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1388325894 0 0) 0x7f49d4003610 con 0x7f49ec0ba140 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 >> v1:10.20.193.167:6789/0 conn(0x7f49ec0b1f20 legacy=0x7f49ec0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 >> v1:10.20.193.155:6789/0 conn(0x7f49ec15dde0 legacy=0x7f49ec0b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 10 monclient: shutdown 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 1 -- 10.20.193.78:0/1921126379 >> v1:10.20.193.78:6789/0 conn(0x7f90dc056090 legacy=0x7f90dc0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec0b5cb0 con 0x7f49ec0ba140 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f49e0002df0 con 0x7f49ec0ba140 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 1 -- 10.20.193.78:0/1921126379 shutdown_connections 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 1 -- 10.20.193.78:0/1921126379 >> 10.20.193.78:0/1921126379 conn(0x7f90dc0b78c0 msgr2=0x7f90dc0b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f1040640 10 monclient: dump: 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.716 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f42cd640 5 monclient: authenticate success, global_id 4491 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f49f42cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 1 -- 10.20.193.78:0/1921126379 shutdown_connections 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 1 -- 10.20.193.78:0/1921126379 wait complete. 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2834003550 con 0x7f28400585e0 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f283effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f283effd640 1 -- 10.20.193.78:0/2065659943 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2834003a80 con 0x7f28400585e0 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f283effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f283effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f283effd640 10 monclient: dump: 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f284689f640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f284689f640 4 set_mon_vals no callback set 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f284689f640 10 monclient: shutdown 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f284689f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f284689f640 1 -- 10.20.193.78:0/2065659943 >> v1:10.20.193.78:6789/0 conn(0x7f28400585e0 legacy=0x7f2840166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f284689f640 1 -- 10.20.193.78:0/2065659943 shutdown_connections 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f284689f640 1 -- 10.20.193.78:0/2065659943 >> 10.20.193.78:0/2065659943 conn(0x7f28400b7990 msgr2=0x7f28400b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f90e1783640 10 monclient: monmap: 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.714+0000 7f284689f640 1 -- 10.20.193.78:0/2065659943 shutdown_connections 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 1 -- 10.20.193.78:0/2065659943 wait complete. 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f90e1783640 1 librados: starting msgr at 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f90e1783640 1 librados: starting objecter 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f90e1783640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f90e1783640 1 Processor -- start 2026-02-25T15:13:04.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f90e1783640 1 -- start start 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f90e1783640 1 librados: setting wanted keys 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f90e1783640 1 librados: calling monclient init 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f90e1783640 10 monclient: init 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 10 monclient: monmap: 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 1 librados: starting msgr at 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 1 librados: starting objecter 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 1 Processor -- start 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 1 -- start start 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 1 librados: setting wanted keys 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 1 librados: calling monclient init 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.715+0000 7f284689f640 10 monclient: init 2026-02-25T15:13:04.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 10 monclient(hunting): picked mon.noname-a con 0x7f28400585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 10 monclient(hunting): picked mon.noname-c con 0x7f28400b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 10 monclient(hunting): picked mon.noname-b con 0x7f90dc056090 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 10 monclient(hunting): picked mon.noname-c con 0x7f90dc159da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 10 monclient(hunting): picked mon.noname-a con 0x7f90dc165880 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90dc0b96d0 con 0x7f90dc165880 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90dc0b99b0 con 0x7f90dc056090 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90dc0b9c90 con 0x7f90dc159da0 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f90e1783640 10 monclient(hunting): authenticate will time out at 3354.305212s 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 10 monclient(hunting): picked mon.noname-b con 0x7f28400ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28400b1510 con 0x7f28400585e0 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f284015de00 con 0x7f28400ba350 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f284015f820 con 0x7f28400b9f80 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.716+0000 7f284689f640 10 monclient(hunting): authenticate will time out at 3354.305313s 2026-02-25T15:13:04.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.721+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261368638 0 0) 0x7fbb78002910 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.721+0000 7fbb8affd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.721+0000 7fbb8affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.721+0000 7fbb8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.721+0000 7fbb8affd640 10 monclient(hunting): my global_id is 4515 2026-02-25T15:13:04.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.721+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb70003610 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.721+0000 7fa3427fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa3440b9f80 0x7fa3441f9100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37276/0 (socket says 10.20.193.78:37276) 2026-02-25T15:13:04.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.721+0000 7fa3427fc640 1 -- 10.20.193.78:0/2318331755 learned_addr learned my addr 10.20.193.78:0/2318331755 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7fa3237fe640 10 client.?.objecter ms_handle_connect 0x7fa3440b9f80 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7fa3237fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 509162709 0 0) 0x7f1918003610 con 0x7f1934161800 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 >> v1:10.20.193.167:6789/0 conn(0x7f1934161430 legacy=0x7f19340b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 >> v1:10.20.193.155:6789/0 conn(0x7f193416ad30 legacy=0x7f193416b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19340b20a0 con 0x7f1934161800 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1924002df0 con 0x7f1934161800 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f19327fc640 10 monclient: dump: 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f193a09c640 5 monclient: authenticate success, global_id 4500 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.724+0000 7f193a09c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 555320082 0 0) 0x7fa258003610 con 0x7fa2700585e0 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 >> v1:10.20.193.167:6789/0 conn(0x7fa2700ba350 legacy=0x7fa270057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 >> v1:10.20.193.155:6789/0 conn(0x7fa2700b9f80 legacy=0x7fa270163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2700573f0 con 0x7fa2700585e0 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa26c003340 con 0x7fa2700585e0 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa25ffff640 10 monclient: dump: 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa277632640 5 monclient: authenticate success, global_id 4497 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7fa277632640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2096174843 0 0) 0x7f3eb0003610 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 >> v1:10.20.193.167:6789/0 conn(0x7f3ecc0585e0 legacy=0x7f3ecc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 >> v1:10.20.193.155:6789/0 conn(0x7f3ecc0ba350 legacy=0x7f3ecc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc0573f0 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3eb8002fc0 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3eca7fc640 10 monclient: dump: 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3ed212c640 5 monclient: authenticate success, global_id 4506 2026-02-25T15:13:04.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.725+0000 7f3ed212c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3660254712 0 0) 0x7f76f4003610 con 0x7f770c0b9f80 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 >> v1:10.20.193.167:6789/0 conn(0x7f770c0585e0 legacy=0x7f770c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 >> v1:10.20.193.155:6789/0 conn(0x7f770c0ba350 legacy=0x7f770c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c0573f0 con 0x7f770c0b9f80 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f76fc002fc0 con 0x7f770c0b9f80 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f77111f5640 10 monclient: dump: 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f7714482640 5 monclient: authenticate success, global_id 4494 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f7714482640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f49e0003000 con 0x7f49ec0ba140 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f49f1040640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f49f1040640 1 -- 10.20.193.78:0/2672532816 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f49e0003440 con 0x7f49ec0ba140 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f49f1040640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f49f1040640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f49f1040640 10 monclient: dump: 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f49f42cd640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.726+0000 7f49f42cd640 4 set_mon_vals no callback set 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 10 monclient: shutdown 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 1 -- 10.20.193.78:0/2672532816 >> v1:10.20.193.78:6789/0 conn(0x7f49ec0ba140 legacy=0x7f49ec0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2544388245 0 0) 0x7fe954003610 con 0x7fe96c0b9f80 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 >> v1:10.20.193.167:6789/0 conn(0x7fe96c0ba350 legacy=0x7fe96c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 >> v1:10.20.193.155:6789/0 conn(0x7fe96c0585e0 legacy=0x7fe96c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 1 -- 10.20.193.78:0/2672532816 shutdown_connections 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 1 -- 10.20.193.78:0/2672532816 >> 10.20.193.78:0/2672532816 conn(0x7f49ec0b7780 msgr2=0x7f49ec0b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 1 -- 10.20.193.78:0/2672532816 shutdown_connections 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96c0573f0 con 0x7fe96c0b9f80 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe960002fc0 con 0x7fe96c0b9f80 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe95ffff640 10 monclient: dump: 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe9737e1640 5 monclient: authenticate success, global_id 4503 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7fe9737e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 1 -- 10.20.193.78:0/2672532816 wait complete. 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7efcc3413640 10 monclient: get_monmap_and_config 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7efcc3413640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7efcc3413640 10 monclient: monmap: 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:04.728537+0000 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:04.728537+0000 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.731 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.727+0000 7f49f42cd640 10 monclient: monmap: 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 1 Processor -- start 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 librados: starting msgr at 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 librados: starting objecter 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 1 -- start start 2026-02-25T15:13:04.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 10 monclient: init 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 Processor -- start 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 -- start start 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 librados: setting wanted keys 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 librados: calling monclient init 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 10 monclient: init 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 10 monclient(hunting): picked mon.noname-b con 0x7f49ec0b1f20 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 10 monclient(hunting): picked mon.noname-c con 0x7f49ec0ba140 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 10 monclient(hunting): picked mon.noname-a con 0x7f49ec15dde0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ec0b1460 con 0x7f49ec15dde0 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ec13aef0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ec13b1d0 con 0x7f49ec0ba140 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7f49f42cd640 10 monclient(hunting): authenticate will time out at 3354.317775s 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 10 monclient(hunting): picked mon.noname-b con 0x7efcbc0b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 10 monclient(hunting): picked mon.noname-c con 0x7efcbc0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 10 monclient(hunting): picked mon.noname-a con 0x7efcbc0585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcbc163930 con 0x7efcbc0585e0 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcbc163bb0 con 0x7efcbc0b9f80 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcbc163e90 con 0x7efcbc0ba350 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.728+0000 7efcc3413640 10 monclient(hunting): authenticate will time out at 3354.317971s 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f283ffff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f28400585e0 0x7f28401f7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37296/0 (socket says 10.20.193.78:37296) 2026-02-25T15:13:04.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f283ffff640 1 -- 10.20.193.78:0/996927252 learned_addr learned my addr 10.20.193.78:0/996927252 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3323652670 0 0) 0x7f6f54003610 con 0x7f6f680b9f80 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 >> v1:10.20.193.167:6789/0 conn(0x7f6f680ba350 legacy=0x7f6f68057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 >> v1:10.20.193.155:6789/0 conn(0x7f6f680585e0 legacy=0x7f6f68166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f680573f0 con 0x7f6f680b9f80 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6f5c002fc0 con 0x7f6f680b9f80 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f6cfa2640 5 monclient: authenticate success, global_id 4512 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f6cfa2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f65573640 10 monclient: dump: 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.731+0000 7f6f6cfa2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 822014941 0 0) 0x7f7bd8003610 con 0x7f7bec164d00 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 >> v1:10.20.193.167:6789/0 conn(0x7f7bec157780 legacy=0x7f7bec056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 >> v1:10.20.193.155:6789/0 conn(0x7f7bec157b50 legacy=0x7f7bec1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec0560e0 con 0x7f7bec164d00 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7be8003170 con 0x7f7bec164d00 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7be37fe640 10 monclient: dump: 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7bf2ad0640 5 monclient: authenticate success, global_id 4509 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f7bf2ad0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f283cff9640 10 client.?.objecter ms_handle_connect 0x7f28400585e0 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7f283cff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217897742 0 0) 0x7fa3441fd360 con 0x7fa3440b9f80 2026-02-25T15:13:04.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7fa3237fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7fa3237fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7fa3237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7fa3237fe640 10 monclient(hunting): my global_id is 4518 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.732+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa310003610 con 0x7fa3440b9f80 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f90db7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f90dc165880 0x7f90dc1fe590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37290/0 (socket says 10.20.193.78:37290) 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f90db7fe640 1 -- 10.20.193.78:0/627999952 learned_addr learned my addr 10.20.193.78:0/627999952 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76fc0031d0 con 0x7f770c0b9f80 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f77111f5640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f77111f5640 1 -- 10.20.193.78:0/1884788952 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f76fc004990 con 0x7f770c0b9f80 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f77111f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f77111f5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f77111f5640 10 monclient: dump: 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f7714482640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.733+0000 7f7714482640 4 set_mon_vals no callback set 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 10 monclient: shutdown 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 1 -- 10.20.193.78:0/1884788952 >> v1:10.20.193.78:6789/0 conn(0x7f770c0b9f80 legacy=0x7f770c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 1 -- 10.20.193.78:0/1884788952 shutdown_connections 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 1 -- 10.20.193.78:0/1884788952 >> 10.20.193.78:0/1884788952 conn(0x7f770c0b7990 msgr2=0x7f770c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 1 -- 10.20.193.78:0/1884788952 shutdown_connections 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 1 -- 10.20.193.78:0/1884788952 wait complete. 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa26c003550 con 0x7fa2700585e0 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7fa25ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7fa25ffff640 1 -- 10.20.193.78:0/3398375082 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa26c004d10 con 0x7fa2700585e0 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7fa25ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7fa25ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7fa25ffff640 10 monclient: dump: 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7fa277632640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7fa277632640 4 set_mon_vals no callback set 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.734+0000 7f7714482640 10 monclient: monmap: 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.737 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 librados: starting msgr at 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 librados: starting objecter 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 10 monclient: shutdown 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 1 -- 10.20.193.78:0/3398375082 >> v1:10.20.193.78:6789/0 conn(0x7fa2700585e0 legacy=0x7fa270166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 Processor -- start 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f90bb7fe640 10 client.?.objecter ms_handle_connect 0x7f90dc165880 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 1 -- 10.20.193.78:0/3398375082 shutdown_connections 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 1 -- 10.20.193.78:0/3398375082 >> 10.20.193.78:0/3398375082 conn(0x7fa2700b7990 msgr2=0x7fa2700b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 1 -- 10.20.193.78:0/3398375082 shutdown_connections 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f90bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 1 -- 10.20.193.78:0/3398375082 wait complete. 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 -- start start 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 librados: setting wanted keys 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 librados: calling monclient init 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 10 monclient: init 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 10 monclient(hunting): picked mon.noname-c con 0x7f770c0585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 10 monclient(hunting): picked mon.noname-a con 0x7f770c0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 10 monclient(hunting): picked mon.noname-b con 0x7f770c0ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770c15f720 con 0x7f770c0b9f80 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7fa277632640 10 monclient: monmap: 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770c2009f0 con 0x7f770c0ba350 2026-02-25T15:13:04.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770c200cd0 con 0x7f770c0585e0 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.735+0000 7f7714482640 10 monclient(hunting): authenticate will time out at 3354.324872s 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.736+0000 7fa277632640 1 librados: starting msgr at 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.736+0000 7fa277632640 1 librados: starting objecter 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.736+0000 7fa277632640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.736+0000 7fa277632640 1 Processor -- start 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.736+0000 7fa277632640 1 -- start start 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.736+0000 7fa277632640 1 librados: setting wanted keys 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.736+0000 7fa277632640 1 librados: calling monclient init 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.736+0000 7fa277632640 10 monclient: init 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 10 monclient(hunting): picked mon.noname-b con 0x7fa2700585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 10 monclient(hunting): picked mon.noname-a con 0x7fa2700b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1464594648 0 0) 0x7fbb70003610 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 10 monclient(hunting): picked mon.noname-c con 0x7fa2700ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa270155880 con 0x7fa2700b9f80 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2701fd090 con 0x7fa2700585e0 2026-02-25T15:13:04.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2701fd370 con 0x7fa2700ba350 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fa277632640 10 monclient(hunting): authenticate will time out at 3354.326325s 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 >> v1:10.20.193.167:6789/0 conn(0x7fbb8c0ba350 legacy=0x7fbb8c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 >> v1:10.20.193.155:6789/0 conn(0x7fbb8c0585e0 legacy=0x7fbb8c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 1 monclient: found mon.noname-a 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c0573f0 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbb78002fc0 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb8affd640 10 monclient: dump: 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb927fa640 5 monclient: authenticate success, global_id 4515 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.737+0000 7fbb927fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3eb80031d0 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3eca7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3eca7fc640 1 -- 10.20.193.78:0/740681351 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3eb8004990 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3eca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3eca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3eca7fc640 10 monclient: dump: 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 4 set_mon_vals no callback set 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022234557 0 0) 0x7f28400b1510 con 0x7f28400585e0 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f283cff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f283cff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f283cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f283cff9640 10 monclient(hunting): my global_id is 4521 2026-02-25T15:13:04.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2810003610 con 0x7f28400585e0 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 10 monclient: shutdown 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 1 -- 10.20.193.78:0/740681351 >> v1:10.20.193.78:6789/0 conn(0x7f3ecc0b9f80 legacy=0x7f3ecc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 1 -- 10.20.193.78:0/740681351 shutdown_connections 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 1 -- 10.20.193.78:0/740681351 >> 10.20.193.78:0/740681351 conn(0x7f3ecc0b7990 msgr2=0x7f3ecc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 1 -- 10.20.193.78:0/740681351 shutdown_connections 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.738+0000 7f3ed212c640 1 -- 10.20.193.78:0/740681351 wait complete. 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 10 monclient: monmap: 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 1 librados: starting msgr at 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 1 librados: starting objecter 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 1 Processor -- start 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 1 -- start start 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 1 librados: setting wanted keys 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 1 librados: calling monclient init 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 10 monclient: init 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 10 monclient(hunting): picked mon.noname-b con 0x7f3ecc0585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 10 monclient(hunting): picked mon.noname-a con 0x7f3ecc0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 10 monclient(hunting): picked mon.noname-c con 0x7f3ecc0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ecc155880 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.739+0000 7f3ed212c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ecc1fd090 con 0x7f3ecc0585e0 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.740+0000 7f3ed212c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ecc1fd370 con 0x7f3ecc0ba350 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.740+0000 7f3ed212c640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.740+0000 7f3ed212c640 10 monclient(hunting): authenticate will time out at 3354.329013s 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.744+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9600031d0 con 0x7fe96c0b9f80 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.744+0000 7fe95ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.744+0000 7fe95ffff640 1 -- 10.20.193.78:0/4171629696 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe960004990 con 0x7fe96c0b9f80 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.744+0000 7fe95ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.744+0000 7fe95ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.744+0000 7fe95ffff640 10 monclient: dump: 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.744+0000 7fe9737e1640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.744+0000 7fe9737e1640 4 set_mon_vals no callback set 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 10 monclient: shutdown 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 1 -- 10.20.193.78:0/4171629696 >> v1:10.20.193.78:6789/0 conn(0x7fe96c0b9f80 legacy=0x7fe96c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 1 -- 10.20.193.78:0/4171629696 shutdown_connections 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 1 -- 10.20.193.78:0/4171629696 >> 10.20.193.78:0/4171629696 conn(0x7fe96c0b7990 msgr2=0x7fe96c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 1 -- 10.20.193.78:0/4171629696 shutdown_connections 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 1 -- 10.20.193.78:0/4171629696 wait complete. 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7fe9737e1640 10 monclient: monmap: 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f5c0031d0 con 0x7f6f680b9f80 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7f6f65573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7f6f65573640 1 -- 10.20.193.78:0/133191278 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6f5c004990 con 0x7f6f680b9f80 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7f6f65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7f6f65573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7f6f65573640 10 monclient: dump: 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7f6f6cfa2640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.745+0000 7f6f6cfa2640 4 set_mon_vals no callback set 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 1 librados: starting msgr at 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 1 librados: starting objecter 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 1 Processor -- start 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 759752388 0 0) 0x7fa310003610 con 0x7fa3440b9f80 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 1 -- start start 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 1 librados: setting wanted keys 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 1 librados: calling monclient init 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3441fd360 con 0x7fa3440b9f80 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa32c003050 con 0x7fa3440b9f80 2026-02-25T15:13:04.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fa3237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 10 monclient: init 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fa3237fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fa3237fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fa3237fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7f6f6cfa2640 10 monclient: shutdown 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7f6f6cfa2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/133191278 >> v1:10.20.193.78:6789/0 conn(0x7f6f680b9f80 legacy=0x7f6f68163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/133191278 shutdown_connections 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/133191278 >> 10.20.193.78:0/133191278 conn(0x7f6f680b7990 msgr2=0x7f6f680b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/133191278 shutdown_connections 2026-02-25T15:13:04.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/133191278 wait complete. 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.746+0000 7fe9737e1640 10 monclient(hunting): picked mon.noname-b con 0x7fe96c0585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7fe9737e1640 10 monclient(hunting): picked mon.noname-a con 0x7fe96c0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7fe9737e1640 10 monclient(hunting): picked mon.noname-c con 0x7fe96c0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7fe9737e1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96c155880 con 0x7fe96c0b9f80 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7fe9737e1640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96c1fd090 con 0x7fe96c0585e0 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7fe9737e1640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96c1fd370 con 0x7fe96c0ba350 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7fe9737e1640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7fe9737e1640 10 monclient(hunting): authenticate will time out at 3354.336082s 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 10 monclient: monmap: 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.750 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 1 librados: starting msgr at 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 1 librados: starting objecter 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 1 Processor -- start 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 1 -- start start 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 1 librados: setting wanted keys 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 1 librados: calling monclient init 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.747+0000 7f6f6cfa2640 10 monclient: init 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 10 monclient(hunting): picked mon.noname-a con 0x7f6f680585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 10 monclient(hunting): picked mon.noname-b con 0x7f6f680b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 10 monclient(hunting): picked mon.noname-c con 0x7f6f680ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f68155880 con 0x7f6f680585e0 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f681fd090 con 0x7f6f680b9f80 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f681fd370 con 0x7f6f680ba350 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.748+0000 7f6f6cfa2640 10 monclient(hunting): authenticate will time out at 3354.337610s 2026-02-25T15:13:04.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f49f2843640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f49ec15dde0 0x7f49ec0af7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37310/0 (socket says 10.20.193.78:37310) 2026-02-25T15:13:04.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f49f2843640 1 -- 10.20.193.78:0/447000205 learned_addr learned my addr 10.20.193.78:0/447000205 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1924003000 con 0x7f1934161800 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f19327fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f19327fc640 1 -- 10.20.193.78:0/2865886643 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1924003440 con 0x7f1934161800 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f19327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f19327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f19327fc640 10 monclient: dump: 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f193a09c640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f193a09c640 4 set_mon_vals no callback set 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f49d2ffd640 10 client.?.objecter ms_handle_connect 0x7f49ec15dde0 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f49d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285542467 0 0) 0x7f90dc0b96d0 con 0x7f90dc165880 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f90bb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f90bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f90bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f90bb7fe640 10 monclient(hunting): my global_id is 4524 2026-02-25T15:13:04.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.751+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a8003610 con 0x7f90dc165880 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 10 monclient: shutdown 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 -- 10.20.193.78:0/2865886643 >> v1:10.20.193.78:6789/0 conn(0x7f1934161800 legacy=0x7f1934168c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f77119f6640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f770c0b9f80 0x7f770c15daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37332/0 (socket says 10.20.193.78:37332) 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f77119f6640 1 -- 10.20.193.78:0/2316668971 learned_addr learned my addr 10.20.193.78:0/2316668971 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 -- 10.20.193.78:0/2865886643 shutdown_connections 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 -- 10.20.193.78:0/2865886643 >> 10.20.193.78:0/2865886643 conn(0x7f19340b2ef0 msgr2=0x7f19340b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 -- 10.20.193.78:0/2865886643 shutdown_connections 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 -- 10.20.193.78:0/2865886643 wait complete. 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 10 monclient: monmap: 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 librados: starting msgr at 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 librados: starting objecter 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 Processor -- start 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 -- start start 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 librados: setting wanted keys 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 1 librados: calling monclient init 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.752+0000 7f193a09c640 10 monclient: init 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7fa274ba6640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa2700b9f80 0x7fa270155170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37346/0 (socket says 10.20.193.78:37346) 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7fa274ba6640 1 -- 10.20.193.78:0/2664061988 learned_addr learned my addr 10.20.193.78:0/2664061988 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 10 monclient(hunting): picked mon.noname-b con 0x7f1934161430 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 10 monclient(hunting): picked mon.noname-c con 0x7f1934161800 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 10 monclient(hunting): picked mon.noname-a con 0x7f193416ad30 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340a4cf0 con 0x7f193416ad30 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340a7f60 con 0x7f1934161430 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340a8240 con 0x7f1934161800 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.753+0000 7f193a09c640 10 monclient(hunting): authenticate will time out at 3354.342493s 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.754+0000 7f76f2ffd640 10 client.?.objecter ms_handle_connect 0x7f770c0b9f80 2026-02-25T15:13:04.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.754+0000 7f76f2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.754+0000 7fa25dffb640 10 client.?.objecter ms_handle_connect 0x7fa2700b9f80 2026-02-25T15:13:04.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.754+0000 7fa25dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.754+0000 7efcc1989640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7efcbc0585e0 0x7efcbc166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37316/0 (socket says 10.20.193.78:37316) 2026-02-25T15:13:04.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.754+0000 7efcc1989640 1 -- 10.20.193.78:0/76061626 learned_addr learned my addr 10.20.193.78:0/76061626 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7be8003380 con 0x7f7bec164d00 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7be37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7be37fe640 1 -- 10.20.193.78:0/634737187 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7be80037c0 con 0x7f7bec164d00 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7be37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7be37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7be37fe640 10 monclient: dump: 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.758 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7bf2ad0640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7bf2ad0640 4 set_mon_vals no callback set 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb780031d0 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7fbb8affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7bf2ad0640 10 monclient: shutdown 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7bf2ad0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/634737187 >> v1:10.20.193.78:6789/0 conn(0x7f7bec164d00 legacy=0x7f7bec1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7fbb8affd640 1 -- 10.20.193.78:0/2367579667 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbb78004990 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7fbb8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7fbb8affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7fbb8affd640 10 monclient: dump: 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7fbb927fa640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.757+0000 7fbb927fa640 4 set_mon_vals no callback set 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/634737187 shutdown_connections 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/634737187 >> 10.20.193.78:0/634737187 conn(0x7f7bec0b2ef0 msgr2=0x7f7bec0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/634737187 shutdown_connections 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/634737187 wait complete. 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 10 monclient: shutdown 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 1 -- 10.20.193.78:0/2367579667 >> v1:10.20.193.78:6789/0 conn(0x7fbb8c0b9f80 legacy=0x7fbb8c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 1 -- 10.20.193.78:0/2367579667 shutdown_connections 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 1 -- 10.20.193.78:0/2367579667 >> 10.20.193.78:0/2367579667 conn(0x7fbb8c0b7990 msgr2=0x7fbb8c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 1 -- 10.20.193.78:0/2367579667 shutdown_connections 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 1 -- 10.20.193.78:0/2367579667 wait complete. 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f3ecaffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3ecc0b9f80 0x7f3ecc155170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37358/0 (socket says 10.20.193.78:37358) 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f3ecaffd640 1 -- 10.20.193.78:0/2765385530 learned_addr learned my addr 10.20.193.78:0/2765385530 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 10 monclient: monmap: 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.760 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 librados: starting msgr at 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 librados: starting objecter 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 Processor -- start 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7fbb927fa640 10 monclient: monmap: 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 -- start start 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 librados: setting wanted keys 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 1 librados: calling monclient init 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.758+0000 7f7bf2ad0640 10 monclient: init 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f3ea7fff640 10 client.?.objecter ms_handle_connect 0x7f3ecc0b9f80 2026-02-25T15:13:04.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f3ea7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 librados: starting msgr at 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 librados: starting objecter 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 Processor -- start 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 -- start start 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 librados: setting wanted keys 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 librados: calling monclient init 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 10 monclient: init 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2260669747 0 0) 0x7fa3441fd360 con 0x7fa3440b9f80 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 >> v1:10.20.193.167:6789/0 conn(0x7fa3440ba350 legacy=0x7fa3441650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 >> v1:10.20.193.155:6789/0 conn(0x7fa3440585e0 legacy=0x7fa344155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 1 monclient: found mon.a 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3441fdc00 con 0x7fa3440b9f80 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 5 monclient: authenticate success, global_id 4518 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 10 monclient: _renew_subs 2026-02-25T15:13:04.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3441fdee0 con 0x7fa3440b9f80 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 10 monclient(hunting): picked mon.noname-b con 0x7f7bec157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 10 monclient(hunting): picked mon.noname-c con 0x7f7bec157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 10 client.4518.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 10 monclient: _renew_subs 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3441f9810 con 0x7fa3440b9f80 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fa3493ed640 1 librados: init done 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 10 monclient(hunting): picked mon.noname-a con 0x7f7bec164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bec0ab160 con 0x7f7bec164d00 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bec0ab440 con 0x7f7bec157780 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bec0ab720 con 0x7f7bec157b50 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7f7bf2ad0640 10 monclient(hunting): authenticate will time out at 3354.348483s 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 10 monclient(hunting): picked mon.noname-b con 0x7fbb8c0585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 10 monclient(hunting): picked mon.noname-a con 0x7fbb8c0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 10 monclient(hunting): picked mon.noname-c con 0x7fbb8c0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c155880 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c1fd090 con 0x7fbb8c0585e0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c1fd370 con 0x7fbb8c0ba350 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.759+0000 7fbb927fa640 10 monclient(hunting): authenticate will time out at 3354.348783s 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7fa3493ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7fa3493ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7fa3493ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3440b8fe0 con 0x7fa3440b9f80 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786259305 0 0) 0x7f770c15f720 con 0x7f770c0b9f80 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f76f2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f76f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f76f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f76f2ffd640 10 monclient(hunting): my global_id is 4533 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76dc003610 con 0x7f770c0b9f80 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3556464282 0 0) 0x7f2810003610 con 0x7f28400585e0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28400b1510 con 0x7f28400585e0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f282c003010 con 0x7f28400585e0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f283cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f283cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f283cff9640 10 monclient(hunting): dump: 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7f283cff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7fe970d55640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe96c0b9f80 0x7fe96c155170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37370/0 (socket says 10.20.193.78:37370) 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.760+0000 7fe970d55640 1 -- 10.20.193.78:0/2405635917 learned_addr learned my addr 10.20.193.78:0/2405635917 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.763+0000 7fe95dffb640 10 client.?.objecter ms_handle_connect 0x7fe96c0b9f80 2026-02-25T15:13:04.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.763+0000 7fe95dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.765+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4164315743 0 0) 0x7f49ec0b1460 con 0x7f49ec15dde0 2026-02-25T15:13:04.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.765+0000 7f49d2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.765+0000 7f49d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.765+0000 7f49d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.765+0000 7f49d2ffd640 10 monclient(hunting): my global_id is 4527 2026-02-25T15:13:04.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.765+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49bc003610 con 0x7f49ec15dde0 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974921690 0 0) 0x7efcb8002c90 con 0x7efcbc0585e0 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7efcabfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7efcabfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7efcabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7efcabfff640 10 monclient(hunting): my global_id is 4536 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efca4003610 con 0x7efcbc0585e0 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080878084 0 0) 0x7fa270155880 con 0x7fa2700b9f80 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7fa25dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7fa25dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7fa25dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7fa25dffb640 10 monclient(hunting): my global_id is 4530 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.766+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa240003610 con 0x7fa2700b9f80 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f1933fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f193416ad30 0x7f193412db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37394/0 (socket says 10.20.193.78:37394) 2026-02-25T15:13:04.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f1933fff640 1 -- 10.20.193.78:0/3752183341 learned_addr learned my addr 10.20.193.78:0/3752183341 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f6f66575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6f680585e0 0x7f6f681fb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37378/0 (socket says 10.20.193.78:37378) 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f6f66575640 1 -- 10.20.193.78:0/1210364839 learned_addr learned my addr 10.20.193.78:0/1210364839 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 250177016 0 0) 0x7f90a8003610 con 0x7f90dc165880 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90dc0b96d0 con 0x7f90dc165880 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f90cc0036d0 con 0x7f90dc165880 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f90bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f90bb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f90bb7fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f90bb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f190ffff640 10 client.?.objecter ms_handle_connect 0x7f193416ad30 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.767+0000 7f190ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.768+0000 7f6f4effd640 10 client.?.objecter ms_handle_connect 0x7f6f680585e0 2026-02-25T15:13:04.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.768+0000 7f6f4effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.769+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03e00035e0 con 0x7f03e40ba350 2026-02-25T15:13:04.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.769+0000 7f03caffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.769+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f03e0003ce0 con 0x7f03e40ba350 2026-02-25T15:13:04.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.769+0000 7f03caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.769+0000 7f03caffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.769+0000 7f03caffd640 10 monclient: dump: 2026-02-25T15:13:04.770 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.770 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.769+0000 7f03e88a0640 4 set_mon_vals no callback set 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f03e0003ec0 con 0x7f03e40ba350 2026-02-25T15:13:04.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058737951 0 0) 0x7f3ecc155880 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f3ea7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f3ea7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f3ea7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f3ea7fff640 10 monclient(hunting): my global_id is 4539 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e9c003610 con 0x7f3ecc0b9f80 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f03ea0a3640 10 monclient: get_auth_request con 0x7f03b4077d30 auth_method 0 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f03caffd640 10 client.4466.objecter ms_handle_connect 0x7f03b4077d30 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f03e0093690 con 0x7f03e40ba350 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f03caffd640 10 client.4466.objecter ms_dispatch2 0x7f03e4000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f03caffd640 3 client.4466.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f03caffd640 3 client.4466.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.770+0000 7f03caffd640 20 client.4466.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 68807787 0 0) 0x7f28400b1510 con 0x7f28400585e0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 >> v1:10.20.193.167:6789/0 conn(0x7f28400b9f80 legacy=0x7f28400b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 >> v1:10.20.193.155:6789/0 conn(0x7f28400ba350 legacy=0x7f28401605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 1 monclient: found mon.a 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284015fb00 con 0x7f28400585e0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f283cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 5 monclient: authenticate success, global_id 4521 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 10 monclient: _renew_subs 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f284015fde0 con 0x7f28400585e0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 10 client.4521.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 10 monclient: _renew_subs 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2840160cf0 con 0x7f28400585e0 2026-02-25T15:13:04.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.771+0000 7f284689f640 1 librados: init done 2026-02-25T15:13:04.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.772+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f03e4163930 con 0x7f03e40ba350 2026-02-25T15:13:04.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.772+0000 7f03caffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.772+0000 7f03caffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:04.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.772+0000 7f284689f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.772+0000 7f284689f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.772+0000 7f284689f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.772+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2840159690 con 0x7f28400585e0 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.778+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bb40035f0 con 0x7f6bc0157b50 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.778+0000 7f6bae7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.778+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6bb4003940 con 0x7f6bc0157b50 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.778+0000 7f6bae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.778+0000 7f6bae7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.778+0000 7f6bae7fc640 10 monclient: dump: 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.778+0000 7f6baffff640 4 set_mon_vals no callback set 2026-02-25T15:13:04.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.779+0000 7f90bb7fe640 10 client.?.objecter ms_handle_connect 0x7f90dc159da0 2026-02-25T15:13:04.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.779+0000 7f90bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.779+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6bb401c7b0 con 0x7f6bc0157b50 2026-02-25T15:13:04.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.780+0000 7f6bc5b58640 10 monclient: get_auth_request con 0x7f6b90077d60 auth_method 0 2026-02-25T15:13:04.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.780+0000 7f6bae7fc640 10 client.4495.objecter ms_handle_connect 0x7f6b90077d60 2026-02-25T15:13:04.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f6bb4092200 con 0x7f6bc0157b50 2026-02-25T15:13:04.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f6bae7fc640 10 client.4495.objecter ms_dispatch2 0x7f6bc0000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f6bae7fc640 3 client.4495.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f6bae7fc640 3 client.4495.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f6bae7fc640 20 client.4495.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f76f2ffd640 10 client.?.objecter ms_handle_connect 0x7f770c0585e0 2026-02-25T15:13:04.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f76f2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f49d2ffd640 10 client.?.objecter ms_handle_connect 0x7f49ec0ba140 2026-02-25T15:13:04.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.781+0000 7f49d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.782+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6bb405cc30 con 0x7f6bc0157b50 2026-02-25T15:13:04.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.782+0000 7f6bae7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.782+0000 7f6bae7fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:04.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.785+0000 7fe95dffb640 10 client.?.objecter ms_handle_connect 0x7fe96c0ba350 2026-02-25T15:13:04.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.785+0000 7fe95dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.785+0000 7fa25dffb640 10 client.?.objecter ms_handle_connect 0x7fa2700ba350 2026-02-25T15:13:04.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.785+0000 7fa25dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.785+0000 7f3ea7fff640 10 client.?.objecter ms_handle_connect 0x7f3ecc0ba350 2026-02-25T15:13:04.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.785+0000 7f3ea7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.787+0000 7fbb90d70640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fbb8c0ba350 0x7fbb8c1f8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51066/0 (socket says 10.20.193.78:51066) 2026-02-25T15:13:04.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.787+0000 7fbb90d70640 1 -- 10.20.193.78:0/1753865406 learned_addr learned my addr 10.20.193.78:0/1753865406 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.788+0000 7fbb88ff9640 10 client.?.objecter ms_handle_connect 0x7fbb8c0ba350 2026-02-25T15:13:04.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.788+0000 7fbb88ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.788+0000 7f190ffff640 10 client.?.objecter ms_handle_connect 0x7f1934161800 2026-02-25T15:13:04.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.788+0000 7f190ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.789+0000 7f6f4effd640 10 client.?.objecter ms_handle_connect 0x7f6f680ba350 2026-02-25T15:13:04.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.789+0000 7f6f4effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.790+0000 7f90bb7fe640 10 client.?.objecter ms_handle_connect 0x7f90dc056090 2026-02-25T15:13:04.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.790+0000 7f90bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.790+0000 7f7be3fff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f7bec157b50 0x7f7bec059170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51050/0 (socket says 10.20.193.78:51050) 2026-02-25T15:13:04.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.790+0000 7f7be3fff640 1 -- 10.20.193.78:0/244447092 learned_addr learned my addr 10.20.193.78:0/244447092 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.791+0000 7f49d2ffd640 10 client.?.objecter ms_handle_connect 0x7f49ec0b1f20 2026-02-25T15:13:04.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.791+0000 7f49d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.792+0000 7f7be17fa640 10 client.?.objecter ms_handle_connect 0x7f7bec157b50 2026-02-25T15:13:04.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.792+0000 7f7be17fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7fa25dffb640 10 client.?.objecter ms_handle_connect 0x7fa2700585e0 2026-02-25T15:13:04.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7fa25dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f3ea7fff640 10 client.?.objecter ms_handle_connect 0x7f3ecc0585e0 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f3ea7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975587810 0 0) 0x7f770c200cd0 con 0x7f770c0585e0 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f76f2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f76f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f76f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f76f2ffd640 10 monclient(hunting): my global_id is 4481 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f770c15f720 con 0x7f770c0585e0 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582248277 0 0) 0x7f90dc0b9c90 con 0x7f90dc159da0 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f90bb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f90bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f90bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f90bb7fe640 10 monclient(hunting): my global_id is 4472 2026-02-25T15:13:04.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.793+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a8003610 con 0x7f90dc159da0 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286178934 0 0) 0x7efcbc163e90 con 0x7efcbc0ba350 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7efcabfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7efcabfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7efcabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7efcabfff640 10 monclient(hunting): my global_id is 4478 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb8002c90 con 0x7efcbc0ba350 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151145349 0 0) 0x7f3ecc1fd370 con 0x7f3ecc0ba350 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f3ea7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f3ea7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f3ea7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f3ea7fff640 10 monclient(hunting): my global_id is 4490 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ecc155880 con 0x7f3ecc0ba350 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257516427 0 0) 0x7fe96c1fd370 con 0x7fe96c0ba350 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7fe95dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7fe95dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7fe95dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7fe95dffb640 10 monclient(hunting): my global_id is 4484 2026-02-25T15:13:04.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe93c003610 con 0x7fe96c0ba350 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60666985 0 0) 0x7f6f681fd370 con 0x7f6f680ba350 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f6f4effd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f6f4effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f6f4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f6f4effd640 10 monclient(hunting): my global_id is 4499 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.794+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f34003610 con 0x7f6f680ba350 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158274778 0 0) 0x7fbb8c1fd370 con 0x7fbb8c0ba350 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fbb88ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fbb88ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fbb88ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fbb88ff9640 10 monclient(hunting): my global_id is 4496 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb5c003610 con 0x7fbb8c0ba350 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7f190ffff640 10 client.?.objecter ms_handle_connect 0x7f1934161430 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7f190ffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125972943 0 0) 0x7f49ec13b1d0 con 0x7f49ec0ba140 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7f49d2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7f49d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7f49d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7f49d2ffd640 10 monclient(hunting): my global_id is 4475 2026-02-25T15:13:04.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49ec0b1460 con 0x7f49ec0ba140 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939113542 0 0) 0x7fa2701fd370 con 0x7fa2700ba350 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fa25dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fa25dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fa25dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fa25dffb640 10 monclient(hunting): my global_id is 4487 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.795+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa270155880 con 0x7fa2700ba350 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.796+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780915752 0 0) 0x7f19340a8240 con 0x7f1934161800 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.796+0000 7f190ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.796+0000 7f190ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.796+0000 7f190ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.796+0000 7f190ffff640 10 monclient(hunting): my global_id is 4493 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.796+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1904003610 con 0x7f1934161800 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.796+0000 7f76f2ffd640 10 client.?.objecter ms_handle_connect 0x7f770c0ba350 2026-02-25T15:13:04.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.796+0000 7f76f2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.798+0000 7f7be17fa640 10 client.?.objecter ms_handle_connect 0x7f7bec157780 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.798+0000 7f7be17fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.798+0000 7fe95dffb640 10 client.?.objecter ms_handle_connect 0x7fe96c0585e0 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.798+0000 7fe95dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959000479 0 0) 0x7fa2701fd090 con 0x7fa2700585e0 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7fa25dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7fa25dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7fa25dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7fa25dffb640 10 monclient(hunting): my global_id is 4516 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2701fd370 con 0x7fa2700585e0 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872186317 0 0) 0x7f19340a7f60 con 0x7f1934161430 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7f190ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7f190ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7f190ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7f190ffff640 10 monclient(hunting): my global_id is 4528 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.799+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19340a8240 con 0x7f1934161430 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2a8003000 con 0x7ff2b8157b50 2026-02-25T15:13:04.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2b6ffd640 1 -- 10.20.193.78:0/524669612 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff2a8003440 con 0x7ff2b8157b50 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2b6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2b6ffd640 10 monclient: dump: 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 4 set_mon_vals no callback set 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122319566 0 0) 0x7f7bec0ab720 con 0x7f7bec157b50 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7f7be17fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7f7be17fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7f7be17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7f7be17fa640 10 monclient(hunting): my global_id is 4502 2026-02-25T15:13:04.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bbc003610 con 0x7f7bec157b50 2026-02-25T15:13:04.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 10 monclient: shutdown 2026-02-25T15:13:04.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 1 -- 10.20.193.78:0/524669612 >> v1:10.20.193.155:6789/0 conn(0x7ff2b8157b50 legacy=0x7ff2b81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 1 -- 10.20.193.78:0/524669612 shutdown_connections 2026-02-25T15:13:04.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 1 -- 10.20.193.78:0/524669612 >> 10.20.193.78:0/524669612 conn(0x7ff2b80b2ef0 msgr2=0x7ff2b80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 1 -- 10.20.193.78:0/524669612 shutdown_connections 2026-02-25T15:13:04.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.800+0000 7ff2be934640 1 -- 10.20.193.78:0/524669612 wait complete. 2026-02-25T15:13:04.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 10 monclient: monmap: 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 1 librados: starting msgr at 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 1 librados: starting objecter 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 1 Processor -- start 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 1 -- start start 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 1 librados: setting wanted keys 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 1 librados: calling monclient init 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.801+0000 7ff2be934640 10 monclient: init 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 10 monclient(hunting): picked mon.noname-c con 0x7ff2b8157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 10 monclient(hunting): picked mon.noname-b con 0x7ff2b8157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 10 monclient(hunting): picked mon.noname-a con 0x7ff2b8164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b812e820 con 0x7ff2b8164d00 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b805d7e0 con 0x7ff2b8157b50 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b805c030 con 0x7ff2b8157780 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.802+0000 7ff2be934640 10 monclient(hunting): authenticate will time out at 3354.391106s 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f6f4effd640 10 client.?.objecter ms_handle_connect 0x7f6f680b9f80 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f6f4effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933495612 0 0) 0x7f49ec13aef0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f49d2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f49d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f49d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f49d2ffd640 10 monclient(hunting): my global_id is 4513 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49ec13b1d0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232365871 0 0) 0x7f3ecc1fd090 con 0x7f3ecc0585e0 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f3ea7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f3ea7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f3ea7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.803+0000 7f3ea7fff640 10 monclient(hunting): my global_id is 4522 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.804+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ecc1fd370 con 0x7f3ecc0585e0 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.804+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 868581771 0 0) 0x7f770c15f720 con 0x7f770c0585e0 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.804+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f770c200cd0 con 0x7f770c0585e0 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.804+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f76fc0028f0 con 0x7f770c0585e0 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.804+0000 7f76f2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.804+0000 7f76f2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.804+0000 7f76f2ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.804+0000 7f76f2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4041054483 0 0) 0x7f90a8003610 con 0x7f90dc159da0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90dc0b9c90 con 0x7f90dc159da0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f90c4003eb0 con 0x7f90dc159da0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f90bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f90bb7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f90bb7fe640 10 monclient(hunting): dump: 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3428840956 0 0) 0x7fa2701fd370 con 0x7fa2700585e0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2701fd090 con 0x7fa2700585e0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa260002f70 con 0x7fa2700585e0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7fa25dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7fa25dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7fa25dffb640 10 monclient(hunting): dump: 2026-02-25T15:13:04.807 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7fa25dffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449094559 0 0) 0x7f7bec0ab440 con 0x7f7bec157780 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f7be17fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f7be17fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f7be17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f7be17fa640 10 monclient(hunting): my global_id is 4531 2026-02-25T15:13:04.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.805+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bec0ab720 con 0x7f7bec157780 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.807+0000 7fbb88ff9640 10 client.?.objecter ms_handle_connect 0x7fbb8c0585e0 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.807+0000 7fbb88ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.808+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3288498776 0 0) 0x7f3ecc155880 con 0x7f3ecc0ba350 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.808+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ecc1fd090 con 0x7f3ecc0ba350 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.808+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3ec0003240 con 0x7f3ecc0ba350 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.808+0000 7f3ea7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.808+0000 7f3ea7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.808+0000 7f3ea7fff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.809 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.808+0000 7f3ea7fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1711222647 0 0) 0x7efcb8002c90 con 0x7efcbc0ba350 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 >> v1:10.20.193.155:6789/0 conn(0x7efcbc0b9f80 legacy=0x7efcbc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 >> v1:10.20.193.78:6789/0 conn(0x7efcbc0585e0 legacy=0x7efcbc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 1 monclient: found mon.noname-c 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcbc0573f0 con 0x7efcbc0ba350 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efcb0002df0 con 0x7efcbc0ba350 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcabfff640 10 monclient: dump: 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.811 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.812 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.812 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcc3413640 5 monclient: authenticate success, global_id 4478 2026-02-25T15:13:04.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.809+0000 7efcc3413640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.814+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 929659027 0 0) 0x7f19340a8240 con 0x7f1934161430 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.814+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19340a7f60 con 0x7f1934161430 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.814+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1920002ed0 con 0x7f1934161430 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.814+0000 7f190ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.815+0000 7f190ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.815+0000 7f190ffff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.816 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.817 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.817 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.817 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.817 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.815+0000 7f190ffff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.817+0000 7ff2b77fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7ff2b8157b50 0x7ff2b805d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58240/0 (socket says 10.20.193.78:58240) 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.817+0000 7ff2b77fe640 1 -- 10.20.193.78:0/3672180789 learned_addr learned my addr 10.20.193.78:0/3672180789 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.817+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1281011753 0 0) 0x7f49ec13b1d0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.817+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49ec13aef0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.817+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f49dc002ed0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.817+0000 7f49d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.817+0000 7f49d2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.817+0000 7f49d2ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.819 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7f49d2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2177070789 0 0) 0x7f3ecc1fd370 con 0x7f3ecc0585e0 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ecc155880 con 0x7f3ecc0585e0 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3eb80028f0 con 0x7f3ecc0585e0 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7f3ea7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7f3ea7fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7f3ea7fff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.820 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7ff2b4ff9640 10 client.?.objecter ms_handle_connect 0x7ff2b8157b50 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.818+0000 7ff2b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572163466 0 0) 0x7f90dc0b99b0 con 0x7f90dc056090 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f90bb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f90bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f90bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f90bb7fe640 10 monclient(hunting): my global_id is 4510 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a8003610 con 0x7f90dc056090 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1127080270 0 0) 0x7f49ec0b1460 con 0x7f49ec0ba140 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49ec13b1d0 con 0x7f49ec0ba140 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f49e0003350 con 0x7f49ec0ba140 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f49d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f49d2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f49d2ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.821 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874559059 0 0) 0x7f770c2009f0 con 0x7f770c0ba350 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f76f2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f76f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f76f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f76f2ffd640 10 monclient(hunting): my global_id is 4525 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f770c15f720 con 0x7f770c0ba350 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043713731 0 0) 0x7fe96c1fd090 con 0x7fe96c0585e0 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fe95dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fe95dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fe95dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fe95dffb640 10 monclient(hunting): my global_id is 4534 2026-02-25T15:13:04.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe96c1fd370 con 0x7fe96c0585e0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 862663710 0 0) 0x7fa2701fd090 con 0x7fa2700585e0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 >> v1:10.20.193.167:6789/0 conn(0x7fa2700ba350 legacy=0x7fa2701f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 >> v1:10.20.193.78:6789/0 conn(0x7fa2700b9f80 legacy=0x7fa270155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 1 monclient: found mon.b 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2701fd650 con 0x7fa2700585e0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa25dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 5 monclient: authenticate success, global_id 4516 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 10 monclient: _renew_subs 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2701fd930 con 0x7fa2700585e0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 10 client.4516.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 10 monclient: _renew_subs 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2701f9510 con 0x7fa2700585e0 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7fa277632640 1 librados: init done 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2913867661 0 0) 0x7f6f34003610 con 0x7f6f680ba350 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f681fd370 con 0x7f6f680ba350 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6f58003240 con 0x7f6f680ba350 2026-02-25T15:13:04.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f6f4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f6f4effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f6f4effd640 10 monclient(hunting): dump: 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.819+0000 7f6f4effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3287858247 0 0) 0x7f770c200cd0 con 0x7f770c0585e0 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 >> v1:10.20.193.155:6789/0 conn(0x7f770c0ba350 legacy=0x7f770c2017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 >> v1:10.20.193.78:6789/0 conn(0x7f770c0b9f80 legacy=0x7f770c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 1 monclient: found mon.c 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c200fb0 con 0x7f770c0585e0 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f76f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 5 monclient: authenticate success, global_id 4481 2026-02-25T15:13:04.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 10 monclient: _renew_subs 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f770c201290 con 0x7f770c0585e0 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 10 client.4481.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 10 monclient: _renew_subs 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f770c166090 con 0x7f770c0585e0 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 1 librados: init done 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7fa277632640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7fa277632640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7fa277632640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa270159080 con 0x7fa2700585e0 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 290480552 0 0) 0x7f6f681fd090 con 0x7f6f680b9f80 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f6f4effd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f6f4effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f6f4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f6f4effd640 10 monclient(hunting): my global_id is 4537 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f34003610 con 0x7f6f680b9f80 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.820+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f770c159080 con 0x7f770c0585e0 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2655546846 0 0) 0x7fe93c003610 con 0x7fe96c0ba350 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe96c1fd090 con 0x7fe96c0ba350 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe968003240 con 0x7fe96c0ba350 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fe95dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fe95dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fe95dffb640 10 monclient(hunting): dump: 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fe95dffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726544390 0 0) 0x7fbb8c1fd090 con 0x7fbb8c0585e0 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fbb88ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fbb88ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fbb88ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fbb88ff9640 10 monclient(hunting): my global_id is 4540 2026-02-25T15:13:04.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.823+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb8c1fd370 con 0x7fbb8c0585e0 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1504344479 0 0) 0x7f1904003610 con 0x7f1934161800 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19340a8240 con 0x7f1934161800 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1924003350 con 0x7f1934161800 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f190ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f190ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f190ffff640 10 monclient(hunting): dump: 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7ff2b4ff9640 10 client.?.objecter ms_handle_connect 0x7ff2b8157780 2026-02-25T15:13:04.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7ff2b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2425872894 0 0) 0x7f7bbc003610 con 0x7f7bec157b50 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bec0ab440 con 0x7f7bec157b50 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bd4002fd0 con 0x7f7bec157b50 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f7be17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f7be17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f7be17fa640 10 monclient(hunting): dump: 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7f7be17fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.824+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1710999066 0 0) 0x7fbb5c003610 con 0x7fbb8c0ba350 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb8c1fd090 con 0x7fbb8c0ba350 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbb800032d0 con 0x7fbb8c0ba350 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7fbb88ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7fbb88ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7fbb88ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.828 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7fbb88ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 343603182 0 0) 0x7f7bec0ab720 con 0x7f7bec157780 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bbc003610 con 0x7f7bec157780 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bdc002f70 con 0x7f7bec157780 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f7be17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f7be17fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f7be17fa640 10 monclient(hunting): dump: 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.829 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2726689327 0 0) 0x7f49ec13aef0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 >> v1:10.20.193.167:6789/0 conn(0x7f49ec0ba140 legacy=0x7f49ec0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 >> v1:10.20.193.78:6789/0 conn(0x7f49ec15dde0 legacy=0x7f49ec0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 1 monclient: found mon.b 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec0aed10 con 0x7f49ec0b1f20 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 5 monclient: authenticate success, global_id 4513 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 10 monclient: _renew_subs 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f49ec0aeff0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 10 client.4513.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 10 monclient: _renew_subs 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f49ec0b00e0 con 0x7f49ec0b1f20 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f49f42cd640 1 librados: init done 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4116343109 0 0) 0x7f3ecc155880 con 0x7f3ecc0585e0 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 >> v1:10.20.193.167:6789/0 conn(0x7f3ecc0ba350 legacy=0x7f3ecc1f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 >> v1:10.20.193.78:6789/0 conn(0x7f3ecc0b9f80 legacy=0x7f3ecc155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 1 monclient: found mon.b 2026-02-25T15:13:04.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc1fd650 con 0x7f3ecc0585e0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ea7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 5 monclient: authenticate success, global_id 4522 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 10 monclient: _renew_subs 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc1fd930 con 0x7f3ecc0585e0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 10 client.4522.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 10 monclient: _renew_subs 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ecc1f9510 con 0x7f3ecc0585e0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.825+0000 7f3ed212c640 1 librados: init done 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.826+0000 7f49f42cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.826+0000 7f49f42cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.826+0000 7f49f42cd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.826+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ec0b3c70 con 0x7f49ec0b1f20 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.826+0000 7f3ed212c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.826+0000 7f3ed212c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.826+0000 7f3ed212c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.826+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ecc159080 con 0x7f3ecc0585e0 2026-02-25T15:13:04.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.831+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195897149 0 0) 0x7ff2b805d7e0 con 0x7ff2b8157b50 2026-02-25T15:13:04.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.831+0000 7ff2b4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.831+0000 7ff2b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.831+0000 7ff2b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.831+0000 7ff2b4ff9640 10 monclient(hunting): my global_id is 4543 2026-02-25T15:13:04.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.831+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff288003610 con 0x7ff2b8157b50 2026-02-25T15:13:04.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.863+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2468573933 0 0) 0x7fe96c155880 con 0x7fe96c0b9f80 2026-02-25T15:13:04.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.863+0000 7fe95dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.863+0000 7fe95dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.863+0000 7fe95dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.863+0000 7fe95dffb640 10 monclient(hunting): my global_id is 4542 2026-02-25T15:13:04.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.863+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe93c003610 con 0x7fe96c0b9f80 2026-02-25T15:13:04.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.864+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883160308 0 0) 0x7f19340a4cf0 con 0x7f193416ad30 2026-02-25T15:13:04.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.864+0000 7f190ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.864+0000 7f190ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.864+0000 7f190ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.864+0000 7f190ffff640 10 monclient(hunting): my global_id is 4545 2026-02-25T15:13:04.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.864+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1904003610 con 0x7f193416ad30 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.871+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa32c0048d0 con 0x7fa3440b9f80 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.871+0000 7fa3237fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.871+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa32c004ce0 con 0x7fa3440b9f80 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.871+0000 7fa3237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.871+0000 7fa3237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.871+0000 7fa3237fe640 10 monclient: dump: 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.871+0000 7fa3417fa640 4 set_mon_vals no callback set 2026-02-25T15:13:04.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.871+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fa32c004ec0 con 0x7fa3440b9f80 2026-02-25T15:13:04.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.872+0000 7fa342ffd640 10 monclient: get_auth_request con 0x7fa310077da0 auth_method 0 2026-02-25T15:13:04.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.872+0000 7fa3237fe640 10 client.4518.objecter ms_handle_connect 0x7fa310077da0 2026-02-25T15:13:04.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.877+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fa32c093470 con 0x7fa3440b9f80 2026-02-25T15:13:04.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.877+0000 7fa3237fe640 10 client.4518.objecter ms_dispatch2 0x7fa344000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.877+0000 7fa3237fe640 3 client.4518.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.877+0000 7fa3237fe640 3 client.4518.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.877+0000 7fa3237fe640 20 client.4518.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.877+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa3440b8fe0 con 0x7fa3440b9f80 2026-02-25T15:13:04.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.877+0000 7fa3237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.877+0000 7fa3237fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:04.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.880+0000 7f7be17fa640 10 client.?.objecter ms_handle_connect 0x7f7bec164d00 2026-02-25T15:13:04.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.880+0000 7f7be17fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.884+0000 7f03c8ff9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:13:04.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.884+0000 7f03c8ff9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:13:04.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.884+0000 7f03c8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.884+0000 7f03c8ff9640 1 -- 10.20.193.78:0/2141159309 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f03a4005470 con 0x7f03e40ba350 2026-02-25T15:13:04.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.897+0000 7f6bc7de3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:13:04.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.897+0000 7f6bc7de3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:13:04.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.897+0000 7f6bc7de3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.897+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6bc005bfa0 con 0x7f6bc0157b50 2026-02-25T15:13:04.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2744241004 0 0) 0x7f19340a7f60 con 0x7f1934161430 2026-02-25T15:13:04.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 >> v1:10.20.193.167:6789/0 conn(0x7f1934161800 legacy=0x7f19340a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 >> v1:10.20.193.78:6789/0 conn(0x7f193416ad30 legacy=0x7f193412db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 1 monclient: found mon.b 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19340a8520 con 0x7f1934161430 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f190ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 5 monclient: authenticate success, global_id 4528 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 10 monclient: _renew_subs 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f193415ef80 con 0x7f1934161430 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 10 client.4528.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 10 monclient: _renew_subs 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f19340a9610 con 0x7f1934161430 2026-02-25T15:13:04.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.915+0000 7f193a09c640 1 librados: init done 2026-02-25T15:13:04.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.916+0000 7f193a09c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.916+0000 7f193a09c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.916+0000 7f193a09c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:04.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.916+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193405bf60 con 0x7f1934161430 2026-02-25T15:13:04.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.921+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2447810228 0 0) 0x7f90dc0b9c90 con 0x7f90dc159da0 2026-02-25T15:13:04.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 >> v1:10.20.193.155:6789/0 conn(0x7f90dc056090 legacy=0x7f90dc1524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 >> v1:10.20.193.78:6789/0 conn(0x7f90dc165880 legacy=0x7f90dc1fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 1 monclient: found mon.c 2026-02-25T15:13:04.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc0b9f70 con 0x7f90dc159da0 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 5 monclient: authenticate success, global_id 4472 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 10 monclient: _renew_subs 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f90dc0b5810 con 0x7f90dc159da0 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 10 client.4472.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 10 monclient: _renew_subs 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f90dc152bb0 con 0x7f90dc159da0 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 1 librados: init done 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.922+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90dc0b4650 con 0x7f90dc159da0 2026-02-25T15:13:04.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448370481 0 0) 0x7ff2b805c030 con 0x7ff2b8157780 2026-02-25T15:13:04.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7ff2b4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7ff2b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7ff2b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7ff2b4ff9640 10 monclient(hunting): my global_id is 4505 2026-02-25T15:13:04.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2b805d7e0 con 0x7ff2b8157780 2026-02-25T15:13:04.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcb0003000 con 0x7efcbc0ba350 2026-02-25T15:13:04.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7efcabfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7efcabfff640 1 -- 10.20.193.78:0/76061626 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efcb0003400 con 0x7efcbc0ba350 2026-02-25T15:13:04.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7efcabfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7efcabfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7efcabfff640 10 monclient: dump: 2026-02-25T15:13:04.927 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.927 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7efcc3413640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:04.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7efcc3413640 4 set_mon_vals no callback set 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3305198508 0 0) 0x7f6f681fd370 con 0x7f6f680ba350 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 >> v1:10.20.193.155:6789/0 conn(0x7f6f680b9f80 legacy=0x7f6f68155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 >> v1:10.20.193.78:6789/0 conn(0x7f6f680585e0 legacy=0x7f6f681fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 1 monclient: found mon.c 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f681fd650 con 0x7f6f680ba350 2026-02-25T15:13:04.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 5 monclient: authenticate success, global_id 4499 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 10 monclient: _renew_subs 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f681fd930 con 0x7f6f680ba350 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 10 client.4499.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 10 monclient: _renew_subs 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f681f9510 con 0x7f6f680ba350 2026-02-25T15:13:04.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.924+0000 7f6f6cfa2640 1 librados: init done 2026-02-25T15:13:04.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2442748409 0 0) 0x7fe96c1fd090 con 0x7fe96c0ba350 2026-02-25T15:13:04.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 >> v1:10.20.193.155:6789/0 conn(0x7fe96c0585e0 legacy=0x7fe96c1fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 >> v1:10.20.193.78:6789/0 conn(0x7fe96c0b9f80 legacy=0x7fe96c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:04.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 1 monclient: found mon.c 2026-02-25T15:13:04.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:04.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96c1fd650 con 0x7fe96c0ba350 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe95dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 5 monclient: authenticate success, global_id 4484 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 10 monclient: _renew_subs 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe96c1fd930 con 0x7fe96c0ba350 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 10 monclient: _renew_subs 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe96c1f9510 con 0x7fe96c0ba350 2026-02-25T15:13:04.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 1 librados: init done 2026-02-25T15:13:04.933 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7efcc3413640 10 monclient: shutdown 2026-02-25T15:13:04.933 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7efcc3413640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:04.933 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7efcc3413640 1 -- 10.20.193.78:0/76061626 >> v1:10.20.193.167:6789/0 conn(0x7efcbc0ba350 legacy=0x7efcbc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:04.933 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7efcc3413640 1 -- 10.20.193.78:0/76061626 shutdown_connections 2026-02-25T15:13:04.933 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7efcc3413640 1 -- 10.20.193.78:0/76061626 >> 10.20.193.78:0/76061626 conn(0x7efcbc0b7990 msgr2=0x7efcbc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:04.933 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7efcc3413640 1 -- 10.20.193.78:0/76061626 shutdown_connections 2026-02-25T15:13:04.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7f6f6cfa2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7efcc3413640 1 -- 10.20.193.78:0/76061626 wait complete. 2026-02-25T15:13:04.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7f6f6cfa2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7f6f6cfa2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f68159080 con 0x7f6f680ba350 2026-02-25T15:13:04.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:04.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.925+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe96c159080 con 0x7fe96c0ba350 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 10 monclient: build_initial_monmap 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 10 monclient: monmap: 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 1 librados: starting msgr at 2026-02-25T15:13:04.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 1 librados: starting objecter 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 1 Processor -- start 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 1 -- start start 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 1 librados: setting wanted keys 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 1 librados: calling monclient init 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.926+0000 7efcc3413640 10 monclient: init 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 10 monclient(hunting): picked mon.noname-b con 0x7efcbc0585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 10 monclient(hunting): picked mon.noname-a con 0x7efcbc0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 10 monclient(hunting): picked mon.noname-c con 0x7efcbc0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcbc165ee0 con 0x7efcbc0b9f80 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcbc156d30 con 0x7efcbc0585e0 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcbc166170 con 0x7efcbc0ba350 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:04.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.927+0000 7efcc3413640 10 monclient(hunting): authenticate will time out at 3354.516289s 2026-02-25T15:13:04.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.928+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76fc003180 con 0x7f770c0585e0 2026-02-25T15:13:04.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.928+0000 7f76f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.928+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f76fc004c40 con 0x7f770c0585e0 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.928+0000 7f76f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.928+0000 7f76f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.928+0000 7f76f2ffd640 10 monclient: dump: 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.940 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.928+0000 7f77109f4640 4 set_mon_vals no callback set 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.929+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f76fc01dab0 con 0x7f770c0585e0 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.930+0000 7f77119f6640 10 monclient: get_auth_request con 0x7f76dc077d60 auth_method 0 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.930+0000 7f76f2ffd640 10 client.4481.objecter ms_handle_connect 0x7f76dc077d60 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.931+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f76fc093320 con 0x7f770c0585e0 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.931+0000 7f76f2ffd640 10 client.4481.objecter ms_dispatch2 0x7f770c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.931+0000 7f76f2ffd640 3 client.4481.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.931+0000 7f76f2ffd640 3 client.4481.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.931+0000 7f76f2ffd640 20 client.4481.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.933+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f770c159080 con 0x7f770c0585e0 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.933+0000 7f76f2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.933+0000 7f76f2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:04.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.977+0000 7fbb88ff9640 10 client.?.objecter ms_handle_connect 0x7fbb8c0b9f80 2026-02-25T15:13:04.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.977+0000 7fbb88ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.978+0000 7ff2b4ff9640 10 client.?.objecter ms_handle_connect 0x7ff2b8164d00 2026-02-25T15:13:04.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.978+0000 7ff2b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f282c0048d0 con 0x7f28400585e0 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7f283cff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f282c004b40 con 0x7f28400585e0 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7f283cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7f283cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7f283cff9640 10 monclient: dump: 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.989 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7f283e7fc640 4 set_mon_vals no callback set 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7fa3493ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:13:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7fa3493ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:13:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7fa3493ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa3440b8280 con 0x7fa3440b9f80 2026-02-25T15:13:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.987+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f282c004d20 con 0x7f28400585e0 2026-02-25T15:13:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.988+0000 7f283f7fe640 10 monclient: get_auth_request con 0x7f2810077d10 auth_method 0 2026-02-25T15:13:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.988+0000 7f283cff9640 10 client.4521.objecter ms_handle_connect 0x7f2810077d10 2026-02-25T15:13:04.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.990+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f282c0934d0 con 0x7f28400585e0 2026-02-25T15:13:04.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.990+0000 7f283cff9640 10 client.4521.objecter ms_dispatch2 0x7f2840000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:04.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.990+0000 7f283cff9640 3 client.4521.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:04.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.990+0000 7f283cff9640 3 client.4521.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:04.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.990+0000 7f283cff9640 20 client.4521.objecter dump_active .. 0 homeless 2026-02-25T15:13:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.990+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2840159690 con 0x7f28400585e0 2026-02-25T15:13:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.990+0000 7f283cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.990+0000 7f283cff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.991+0000 7efcc0987640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7efcbc0b9f80 0x7efcbc156620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37440/0 (socket says 10.20.193.78:37440) 2026-02-25T15:13:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.991+0000 7efcc0987640 1 -- 10.20.193.78:0/1904337362 learned_addr learned my addr 10.20.193.78:0/1904337362 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.993+0000 7efca9ffb640 10 client.?.objecter ms_handle_connect 0x7efcbc0b9f80 2026-02-25T15:13:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.993+0000 7efca9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.993+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774802129 0 0) 0x7f7bec0ab160 con 0x7f7bec164d00 2026-02-25T15:13:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.993+0000 7f7be17fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.993+0000 7f7be17fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.993+0000 7f7be17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.993+0000 7f7be17fa640 10 monclient(hunting): my global_id is 4551 2026-02-25T15:13:04.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.993+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bec0ab720 con 0x7f7bec164d00 2026-02-25T15:13:04.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.994+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965336459 0 0) 0x7ff2b812e820 con 0x7ff2b8164d00 2026-02-25T15:13:04.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.994+0000 7ff2b4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.994+0000 7ff2b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.994+0000 7ff2b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.994+0000 7ff2b4ff9640 10 monclient(hunting): my global_id is 4557 2026-02-25T15:13:04.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.994+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2b805c030 con 0x7ff2b8164d00 2026-02-25T15:13:04.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.995+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433676202 0 0) 0x7fbb8c155880 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.995+0000 7fbb88ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.995+0000 7fbb88ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.995+0000 7fbb88ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.995+0000 7fbb88ff9640 10 monclient(hunting): my global_id is 4554 2026-02-25T15:13:04.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.995+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb5c003610 con 0x7fbb8c0b9f80 2026-02-25T15:13:04.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.996+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826911610 0 0) 0x7efcbc165ee0 con 0x7efcbc0b9f80 2026-02-25T15:13:04.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.996+0000 7efca9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:04.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.996+0000 7efca9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:04.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.996+0000 7efca9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:04.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.996+0000 7efca9ffb640 10 monclient(hunting): my global_id is 4560 2026-02-25T15:13:04.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.996+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc8c003610 con 0x7efcbc0b9f80 2026-02-25T15:13:04.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.997+0000 7fa3237fe640 1 -- 10.20.193.78:0/2318331755 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 778662779) 0x7fa32c05dea0 con 0x7fa3440b9f80 2026-02-25T15:13:04.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.997+0000 7fa3237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:13:04.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:04.997+0000 7fa3237fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.000 INFO:teuthology.orchestra.run.trial078.stdout:90194313219 2026-02-25T15:13:05.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 10 librados: watch_flush enter 2026-02-25T15:13:05.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 10 librados: watch_flush exit 2026-02-25T15:13:05.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 20 client.4518.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 10 client.4518.objecter successfully canceled tick 2026-02-25T15:13:05.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 >> v1:10.20.193.78:6800/3497602169 conn(0x7fa310077da0 legacy=0x7fa310098250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 10 monclient: shutdown 2026-02-25T15:13:05.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 >> v1:10.20.193.78:6789/0 conn(0x7fa3440b9f80 legacy=0x7fa3441f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 shutdown_connections 2026-02-25T15:13:05.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 >> 10.20.193.78:0/2318331755 conn(0x7fa3440b7990 msgr2=0x7fa3440b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 shutdown_connections 2026-02-25T15:13:05.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 1 -- 10.20.193.78:0/2318331755 wait complete. 2026-02-25T15:13:05.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.000+0000 7fa3493ed640 1 librados: shutdown 2026-02-25T15:13:05.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.008+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1743027400 0 0) 0x7efc8c003610 con 0x7efcbc0b9f80 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcbc165ee0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efcb0003350 con 0x7efcbc0b9f80 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7efca9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7efca9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7efca9ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.011 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.012 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.012 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.012 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.012 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7efca9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:05.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1045212389 0 0) 0x7f7bbc003610 con 0x7f7bec157780 2026-02-25T15:13:05.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 >> v1:10.20.193.167:6789/0 conn(0x7f7bec157b50 legacy=0x7f7bec059170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 >> v1:10.20.193.78:6789/0 conn(0x7f7bec164d00 legacy=0x7f7bec0aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 10 monclient: _finish_hunting 0 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 1 monclient: found mon.b 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec0aba00 con 0x7f7bec157780 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 10 monclient: _finish_auth 0 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 10 monclient: _check_auth_tickets 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7be17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 5 monclient: authenticate success, global_id 4531 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 10 monclient: _renew_subs 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec1fbc20 con 0x7f7bec157780 2026-02-25T15:13:05.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 10 client.4531.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:05.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 10 monclient: _renew_subs 2026-02-25T15:13:05.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7bec1fcb30 con 0x7f7bec157780 2026-02-25T15:13:05.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.009+0000 7f7bf2ad0640 1 librados: init done 2026-02-25T15:13:05.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7f7bf2ad0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7f7bf2ad0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7f7bf2ad0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bec161ea0 con 0x7f7bec157780 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4125889355 0 0) 0x7ff2b805c030 con 0x7ff2b8164d00 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2b812e820 con 0x7ff2b8164d00 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff2ac003330 con 0x7ff2b8164d00 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7ff2b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7ff2b4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7ff2b4ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.016 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.017 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.017 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.017 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.017 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.017 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.010+0000 7ff2b4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:05.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.5 2026-02-25T15:13:05.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2795888661 0 0) 0x7efcbc165ee0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 >> v1:10.20.193.167:6789/0 conn(0x7efcbc0ba350 legacy=0x7efcbc1645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 >> v1:10.20.193.155:6789/0 conn(0x7efcbc0585e0 legacy=0x7efcbc1657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 1 monclient: found mon.a 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcbc166450 con 0x7efcbc0b9f80 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:05.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efca9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 5 monclient: authenticate success, global_id 4560 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 10 monclient: _renew_subs 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efcbc1fb2e0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 10 client.4560.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 10 monclient: _renew_subs 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efcbc1fb8a0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.012+0000 7efcc3413640 1 librados: init done 2026-02-25T15:13:05.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2381194844 0 0) 0x7fbb5c003610 con 0x7fbb8c0b9f80 2026-02-25T15:13:05.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb8c155880 con 0x7fbb8c0b9f80 2026-02-25T15:13:05.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbb7c002e60 con 0x7fbb8c0b9f80 2026-02-25T15:13:05.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7fbb88ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:05.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7fbb88ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:05.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7fbb88ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:05.022 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.022 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.023 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.023 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.023 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.023 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.023 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.023 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.023 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.023 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7efcc3413640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7efcc3413640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7efcc3413640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.013+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcbc0b6c80 con 0x7efcbc0b9f80 2026-02-25T15:13:05.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 175191697 0 0) 0x7ff2b812e820 con 0x7ff2b8164d00 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 >> v1:10.20.193.167:6789/0 conn(0x7ff2b8157780 legacy=0x7ff2b812e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 >> v1:10.20.193.155:6789/0 conn(0x7ff2b8157b50 legacy=0x7ff2b805d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 1 monclient: found mon.a 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b805c310 con 0x7ff2b8164d00 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 10 monclient: _finish_auth 0 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2b4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:05.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 5 monclient: authenticate success, global_id 4557 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 10 monclient: _renew_subs 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b805c5f0 con 0x7ff2b8164d00 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 10 client.4557.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 10 monclient: _renew_subs 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff2b805cbb0 con 0x7ff2b8164d00 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 1 librados: init done 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.015+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b805e250 con 0x7ff2b8164d00 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.025+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3810946736 0 0) 0x7fbb8c1fd090 con 0x7fbb8c0ba350 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 >> v1:10.20.193.155:6789/0 conn(0x7fbb8c0585e0 legacy=0x7fbb8c1fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 >> v1:10.20.193.78:6789/0 conn(0x7fbb8c0b9f80 legacy=0x7fbb8c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 1 monclient: found mon.c 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c1fd650 con 0x7fbb8c0ba350 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 10 monclient: _finish_auth 0 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb88ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:05.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 5 monclient: authenticate success, global_id 4496 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 10 monclient: _renew_subs 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c1fd930 con 0x7fbb8c0ba350 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 10 client.4496.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 10 monclient: _renew_subs 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb8c1f9510 con 0x7fbb8c0ba350 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 1 librados: init done 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7f03caffd640 1 -- 10.20.193.78:0/2141159309 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 737253363) 0x7f03e005e0c0 con 0x7f03e40ba350 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7f03caffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:13:05.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7f03caffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.031 INFO:teuthology.orchestra.run.trial078.stdout:94489280515 2026-02-25T15:13:05.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.026+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c159080 con 0x7fbb8c0ba350 2026-02-25T15:13:05.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 10 librados: watch_flush enter 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 10 librados: watch_flush exit 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 20 client.4466.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 10 client.4466.objecter successfully canceled tick 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 1 -- 10.20.193.78:0/2141159309 >> v1:10.20.193.78:6800/3497602169 conn(0x7f03b4077d30 legacy=0x7f03b40981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 10 monclient: shutdown 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 1 -- 10.20.193.78:0/2141159309 >> v1:10.20.193.167:6789/0 conn(0x7f03e40ba350 legacy=0x7f03e40b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 1 -- 10.20.193.78:0/2141159309 shutdown_connections 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 1 -- 10.20.193.78:0/2141159309 >> 10.20.193.78:0/2141159309 conn(0x7f03e40b7990 msgr2=0x7f03e415b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 1 -- 10.20.193.78:0/2141159309 shutdown_connections 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 1 -- 10.20.193.78:0/2141159309 wait complete. 2026-02-25T15:13:05.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.029+0000 7f03c8ff9640 1 librados: shutdown 2026-02-25T15:13:05.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.032+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f90c4004460 con 0x7f90dc159da0 2026-02-25T15:13:05.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.032+0000 7f90bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.032+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f90c4002a10 con 0x7f90dc159da0 2026-02-25T15:13:05.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.032+0000 7f90bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.032+0000 7f90bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:05.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.032+0000 7f90d97fa640 4 set_mon_vals no callback set 2026-02-25T15:13:05.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.032+0000 7f90bb7fe640 10 monclient: dump: 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.035 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.032+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f90c4002bf0 con 0x7f90dc159da0 2026-02-25T15:13:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.033+0000 7f90daffd640 10 monclient: get_auth_request con 0x7f90a8077e30 auth_method 0 2026-02-25T15:13:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.033+0000 7f90bb7fe640 10 client.4472.objecter ms_handle_connect 0x7f90a8077e30 2026-02-25T15:13:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.034+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f90c4091f50 con 0x7f90dc159da0 2026-02-25T15:13:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.034+0000 7f90bb7fe640 10 client.4472.objecter ms_dispatch2 0x7f90dc000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.034+0000 7f90bb7fe640 3 client.4472.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.034+0000 7f90bb7fe640 3 client.4472.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.034+0000 7f90bb7fe640 20 client.4472.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.036+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f90dc0b4650 con 0x7f90dc159da0 2026-02-25T15:13:05.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.036+0000 7f90bb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.036+0000 7f90bb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.2 2026-02-25T15:13:05.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.044+0000 7f7714482640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:13:05.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.044+0000 7f7714482640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:13:05.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.044+0000 7f7714482640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.044+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f770c166380 con 0x7f770c0585e0 2026-02-25T15:13:05.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.103+0000 7f284689f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:13:05.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.103+0000 7f284689f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:13:05.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.103+0000 7f284689f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.103+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f28400b64c0 con 0x7f28400585e0 2026-02-25T15:13:05.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.106+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f49dc003070 con 0x7f49ec0b1f20 2026-02-25T15:13:05.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.106+0000 7f49d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.106+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f49dc003730 con 0x7f49ec0b1f20 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.106+0000 7f49d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.107+0000 7f49d2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.107+0000 7f49f083f640 4 set_mon_vals no callback set 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.107+0000 7f49d2ffd640 10 monclient: dump: 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.109 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.110 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.110 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.110 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.107+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f49dc01c5e0 con 0x7f49ec0b1f20 2026-02-25T15:13:05.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.108+0000 7f49f1841640 10 monclient: get_auth_request con 0x7f49bc077d00 auth_method 0 2026-02-25T15:13:05.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.108+0000 7f49d2ffd640 10 client.4513.objecter ms_handle_connect 0x7f49bc077d00 2026-02-25T15:13:05.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.109+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f49dc091fc0 con 0x7f49ec0b1f20 2026-02-25T15:13:05.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.109+0000 7f49d2ffd640 10 client.4513.objecter ms_dispatch2 0x7f49ec000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.109+0000 7f49d2ffd640 3 client.4513.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.109+0000 7f49d2ffd640 3 client.4513.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.109+0000 7f49d2ffd640 20 client.4513.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.110+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcb0002fb0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.110+0000 7efca9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.110+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7efcb00039d0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.110+0000 7efca9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.110+0000 7efca9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.110+0000 7efca9ffb640 10 monclient: dump: 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.113 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.110+0000 7efcab7fe640 4 set_mon_vals no callback set 2026-02-25T15:13:05.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.111+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f49dc05c9f0 con 0x7f49ec0b1f20 2026-02-25T15:13:05.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.111+0000 7f49d2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.111+0000 7f49d2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.111+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7efcb0003bb0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.111+0000 7efcc1188640 10 monclient: get_auth_request con 0x7efc8c077c80 auth_method 0 2026-02-25T15:13:05.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.111+0000 7efca9ffb640 10 client.4560.objecter ms_handle_connect 0x7efc8c077c80 2026-02-25T15:13:05.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.114+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7efcb0093390 con 0x7efcbc0b9f80 2026-02-25T15:13:05.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.114+0000 7efca9ffb640 10 client.4560.objecter ms_dispatch2 0x7efcbc000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.114+0000 7efca9ffb640 3 client.4560.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.114+0000 7efca9ffb640 3 client.4560.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.114+0000 7efca9ffb640 20 client.4560.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.114+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7efcb005ddc0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.114+0000 7efca9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.114+0000 7efca9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.115+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa260003110 con 0x7fa2700585e0 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.115+0000 7fa25dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.115+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa2600037d0 con 0x7fa2700585e0 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.115+0000 7fa25dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.115+0000 7fa25dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.115+0000 7fa25dffb640 10 monclient: dump: 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.118 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.119 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.119 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.119 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.115+0000 7fa25f7fe640 4 set_mon_vals no callback set 2026-02-25T15:13:05.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.116+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fa26001c680 con 0x7fa2700585e0 2026-02-25T15:13:05.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.117+0000 7fa274ba6640 10 monclient: get_auth_request con 0x7fa240077d40 auth_method 0 2026-02-25T15:13:05.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.117+0000 7fa25dffb640 10 client.4516.objecter ms_handle_connect 0x7fa240077d40 2026-02-25T15:13:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.121+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3eb8002bf0 con 0x7f3ecc0585e0 2026-02-25T15:13:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.121+0000 7f3ea7fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.121+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3eb8004c40 con 0x7f3ecc0585e0 2026-02-25T15:13:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.121+0000 7f3ea7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.121+0000 7f3ea7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.121+0000 7f3ea7fff640 10 monclient: dump: 2026-02-25T15:13:05.123 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.121+0000 7f3ec9ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:05.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.122+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f3eb801dab0 con 0x7f3ecc0585e0 2026-02-25T15:13:05.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.122+0000 7f3ecaffd640 10 monclient: get_auth_request con 0x7f3e9c077da0 auth_method 0 2026-02-25T15:13:05.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.122+0000 7f3ea7fff640 10 client.4522.objecter ms_handle_connect 0x7f3e9c077da0 2026-02-25T15:13:05.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.124+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fa260092120 con 0x7fa2700585e0 2026-02-25T15:13:05.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.124+0000 7fa25dffb640 10 client.4516.objecter ms_dispatch2 0x7fa270000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.124+0000 7fa25dffb640 3 client.4516.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.124+0000 7fa25dffb640 3 client.4516.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.124+0000 7fa25dffb640 20 client.4516.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.148+0000 7f90e1783640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:13:05.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.148+0000 7f90e1783640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:13:05.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.148+0000 7f90e1783640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.148+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f90dc056980 con 0x7f90dc159da0 2026-02-25T15:13:05.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.209+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2ac0034d0 con 0x7ff2b8164d00 2026-02-25T15:13:05.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.209+0000 7ff2b4ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.209+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ff2ac003c20 con 0x7ff2b8164d00 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.209+0000 7ff2b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.209+0000 7ff2b4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.209+0000 7ff2b4ff9640 10 monclient: dump: 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.212 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.213 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.213 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.213 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.209+0000 7ff2b67fc640 4 set_mon_vals no callback set 2026-02-25T15:13:05.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.210+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7ff2ac01ca90 con 0x7ff2b8164d00 2026-02-25T15:13:05.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.210+0000 7ff2b7fff640 10 monclient: get_auth_request con 0x7ff288077d90 auth_method 0 2026-02-25T15:13:05.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.210+0000 7ff2b4ff9640 10 client.4557.objecter ms_handle_connect 0x7ff288077d90 2026-02-25T15:13:05.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.212+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f3eb80932b0 con 0x7f3ecc0585e0 2026-02-25T15:13:05.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.212+0000 7f3ea7fff640 10 client.4522.objecter ms_dispatch2 0x7f3ecc000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.212+0000 7f3ea7fff640 3 client.4522.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.212+0000 7f3ea7fff640 3 client.4522.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.212+0000 7f3ea7fff640 20 client.4522.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.212+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa270159080 con 0x7fa2700585e0 2026-02-25T15:13:05.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.212+0000 7fa25dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.212+0000 7fa25dffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f3ecc159080 con 0x7f3ecc0585e0 2026-02-25T15:13:05.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f3ea7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f3ea7fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6bae7fc640 1 -- 10.20.193.78:0/3933005757 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 521551722) 0x7f6bb405c530 con 0x7f6bc0157b50 2026-02-25T15:13:05.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6bae7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:13:05.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6bae7fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.217 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f580038c0 con 0x7f6f680ba350 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6f4effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6f58003c10 con 0x7f6f680ba350 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6f4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6f4effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6f4effd640 10 monclient: dump: 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.218 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.214+0000 7f6f64d72640 4 set_mon_vals no callback set 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.215+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6f5801ca80 con 0x7f6f680ba350 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.216+0000 7f6f66575640 10 monclient: get_auth_request con 0x7f6f34077d40 auth_method 0 2026-02-25T15:13:05.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.216+0000 7f6f4effd640 10 client.4499.objecter ms_handle_connect 0x7f6f34077d40 2026-02-25T15:13:05.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f6f58092430 con 0x7f6f680ba350 2026-02-25T15:13:05.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6f4effd640 10 client.4499.objecter ms_dispatch2 0x7f6f68000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6f4effd640 3 client.4499.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6f4effd640 3 client.4499.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6f4effd640 20 client.4499.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 10 librados: watch_flush enter 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 10 librados: watch_flush exit 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 20 client.4495.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 10 client.4495.objecter successfully canceled tick 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6b90077d60 legacy=0x7f6b90098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 10 monclient: shutdown 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 >> v1:10.20.193.155:6789/0 conn(0x7f6bc0157b50 legacy=0x7f6bc00ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 shutdown_connections 2026-02-25T15:13:05.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 >> 10.20.193.78:0/3933005757 conn(0x7f6bc00b2ef0 msgr2=0x7f6bc005b890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 shutdown_connections 2026-02-25T15:13:05.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 1 -- 10.20.193.78:0/3933005757 wait complete. 2026-02-25T15:13:05.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.217+0000 7f6bc7de3640 1 librados: shutdown 2026-02-25T15:13:05.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7ff2ac0923a0 con 0x7ff2b8164d00 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7ff2b4ff9640 10 client.4557.objecter ms_dispatch2 0x7ff2b8000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7ff2b4ff9640 3 client.4557.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7ff2b4ff9640 3 client.4557.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7ff2b4ff9640 20 client.4557.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff2b805e250 con 0x7ff2b8164d00 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7ff2b4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7ff2b4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6f68159080 con 0x7f6f680ba350 2026-02-25T15:13:05.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7f6f4effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.218+0000 7f6f4effd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.219+0000 7f283cff9640 1 -- 10.20.193.78:0/996927252 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 737253363) 0x7f282c05df00 con 0x7f28400585e0 2026-02-25T15:13:05.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.219+0000 7f283cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:13:05.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.219+0000 7f283cff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.225 INFO:teuthology.orchestra.run.trial078.stdout:94489280515 2026-02-25T15:13:05.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 10 librados: watch_flush enter 2026-02-25T15:13:05.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 10 librados: watch_flush exit 2026-02-25T15:13:05.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 20 client.4521.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 10 client.4521.objecter successfully canceled tick 2026-02-25T15:13:05.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 >> v1:10.20.193.78:6800/3497602169 conn(0x7f2810077d10 legacy=0x7f28100981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 10 monclient: shutdown 2026-02-25T15:13:05.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 >> v1:10.20.193.78:6789/0 conn(0x7f28400585e0 legacy=0x7f28401f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 shutdown_connections 2026-02-25T15:13:05.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 >> 10.20.193.78:0/996927252 conn(0x7f28400b7990 msgr2=0x7f2840158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 shutdown_connections 2026-02-25T15:13:05.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 1 -- 10.20.193.78:0/996927252 wait complete. 2026-02-25T15:13:05.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.222+0000 7f284689f640 1 librados: shutdown 2026-02-25T15:13:05.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.224+0000 7f49f42cd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:13:05.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.224+0000 7f49f42cd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:13:05.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.224+0000 7f49f42cd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.224+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f49ec0ba790 con 0x7f49ec0b1f20 2026-02-25T15:13:05.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.225+0000 7efcc3413640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:13:05.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.225+0000 7efcc3413640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:13:05.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.225+0000 7efcc3413640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.225+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7efcbc0b96a0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.227+0000 7efca9ffb640 1 -- 10.20.193.78:0/1904337362 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 737253363) 0x7efcb005d6c0 con 0x7efcbc0b9f80 2026-02-25T15:13:05.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.227+0000 7efca9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:13:05.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.227+0000 7efca9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.230 INFO:teuthology.orchestra.run.trial078.stdout:94489280515 2026-02-25T15:13:05.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.3 2026-02-25T15:13:05.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 10 librados: watch_flush enter 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 10 librados: watch_flush exit 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 20 client.4560.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 10 client.4560.objecter successfully canceled tick 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 >> v1:10.20.193.78:6800/3497602169 conn(0x7efc8c077c80 legacy=0x7efc8c098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 10 monclient: shutdown 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 >> v1:10.20.193.78:6789/0 conn(0x7efcbc0b9f80 legacy=0x7efcbc156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 shutdown_connections 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 >> 10.20.193.78:0/1904337362 conn(0x7efcbc0b7990 msgr2=0x7efcbc15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 shutdown_connections 2026-02-25T15:13:05.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 1 -- 10.20.193.78:0/1904337362 wait complete. 2026-02-25T15:13:05.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.230+0000 7efcc3413640 1 librados: shutdown 2026-02-25T15:13:05.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.11 2026-02-25T15:13:05.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.0 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1920003550 con 0x7f1934161430 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7f190ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f19200038a0 con 0x7f1934161430 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7f190ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7f190ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7f190ffff640 10 monclient: dump: 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.314 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.315 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.315 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.315 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.315 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.315 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.315 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.315 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7f1931ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:05.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9680038c0 con 0x7fe96c0ba350 2026-02-25T15:13:05.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7fe95dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe968003c10 con 0x7fe96c0ba350 2026-02-25T15:13:05.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7fe95dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7fe95dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:05.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7fe95dffb640 10 monclient: dump: 2026-02-25T15:13:05.316 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7fe95f7fe640 4 set_mon_vals no callback set 2026-02-25T15:13:05.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.312+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f192001c710 con 0x7f1934161430 2026-02-25T15:13:05.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.313+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fe96801ca80 con 0x7fe96c0ba350 2026-02-25T15:13:05.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.313+0000 7f1932ffd640 10 monclient: get_auth_request con 0x7f1904077d60 auth_method 0 2026-02-25T15:13:05.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.313+0000 7f190ffff640 10 client.4528.objecter ms_handle_connect 0x7f1904077d60 2026-02-25T15:13:05.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.313+0000 7fe971556640 10 monclient: get_auth_request con 0x7fe93c077d40 auth_method 0 2026-02-25T15:13:05.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.313+0000 7fe95dffb640 10 client.4484.objecter ms_handle_connect 0x7fe93c077d40 2026-02-25T15:13:05.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.314+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f19200920d0 con 0x7f1934161430 2026-02-25T15:13:05.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.314+0000 7f190ffff640 10 client.4528.objecter ms_dispatch2 0x7f1934000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.314+0000 7f190ffff640 3 client.4528.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.314+0000 7f190ffff640 3 client.4528.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.314+0000 7f190ffff640 20 client.4528.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.315+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fe968058720 con 0x7fe96c0ba350 2026-02-25T15:13:05.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.315+0000 7fe95dffb640 10 client.4484.objecter ms_dispatch2 0x7fe96c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.315+0000 7fe95dffb640 3 client.4484.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.315+0000 7fe95dffb640 3 client.4484.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.315+0000 7fe95dffb640 20 client.4484.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.316+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe96c159080 con 0x7fe96c0ba350 2026-02-25T15:13:05.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.316+0000 7fe95dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.316+0000 7fe95dffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.316+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f192005cb00 con 0x7f1934161430 2026-02-25T15:13:05.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.316+0000 7f190ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.316+0000 7f190ffff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.319+0000 7f76f2ffd640 1 -- 10.20.193.78:0/2316668971 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 213165853) 0x7f770c163930 con 0x7f770c0585e0 2026-02-25T15:13:05.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.319+0000 7f76f2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:13:05.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.319+0000 7f76f2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.323 INFO:teuthology.orchestra.run.trial078.stdout:94489280517 2026-02-25T15:13:05.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.320+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bdc003520 con 0x7f7bec157780 2026-02-25T15:13:05.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.320+0000 7f7be17fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.320+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7bdc003870 con 0x7f7bec157780 2026-02-25T15:13:05.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.320+0000 7f7be17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.320+0000 7f7be17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:05.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.320+0000 7f7be17fa640 10 monclient: dump: 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.320+0000 7f7be2ffd640 4 set_mon_vals no callback set 2026-02-25T15:13:05.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.321+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f7bdc01c6e0 con 0x7f7bec157780 2026-02-25T15:13:05.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7be3fff640 10 monclient: get_auth_request con 0x7f7bbc077d70 auth_method 0 2026-02-25T15:13:05.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7be17fa640 10 client.4531.objecter ms_handle_connect 0x7f7bbc077d70 2026-02-25T15:13:05.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 10 librados: watch_flush enter 2026-02-25T15:13:05.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 10 librados: watch_flush exit 2026-02-25T15:13:05.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 20 client.4481.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 10 client.4481.objecter successfully canceled tick 2026-02-25T15:13:05.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 >> v1:10.20.193.78:6800/3497602169 conn(0x7f76dc077d60 legacy=0x7f76dc098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 10 monclient: shutdown 2026-02-25T15:13:05.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 >> v1:10.20.193.167:6789/0 conn(0x7f770c0585e0 legacy=0x7f770c15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 shutdown_connections 2026-02-25T15:13:05.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 >> 10.20.193.78:0/2316668971 conn(0x7f770c0b7990 msgr2=0x7f770c0b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 shutdown_connections 2026-02-25T15:13:05.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 1 -- 10.20.193.78:0/2316668971 wait complete. 2026-02-25T15:13:05.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7f7714482640 1 librados: shutdown 2026-02-25T15:13:05.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb80003950 con 0x7fbb8c0ba350 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7fbb88ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbb80004ee0 con 0x7fbb8c0ba350 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7fbb88ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7fbb88ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7fbb88ff9640 10 monclient: dump: 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:05.329 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:05.330 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:05.330 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:05.330 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:05.330 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:05.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.322+0000 7fbb8a7fc640 4 set_mon_vals no callback set 2026-02-25T15:13:05.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.323+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f7bdc0920b0 con 0x7f7bec157780 2026-02-25T15:13:05.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.323+0000 7f7be17fa640 10 client.4531.objecter ms_dispatch2 0x7f7bec000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.323+0000 7f7be17fa640 3 client.4531.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.323+0000 7f7be17fa640 3 client.4531.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.323+0000 7f7be17fa640 20 client.4531.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.324+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fbb8001dd50 con 0x7fbb8c0ba350 2026-02-25T15:13:05.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.324+0000 7fbb8bfff640 10 monclient: get_auth_request con 0x7fbb5c077d70 auth_method 0 2026-02-25T15:13:05.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.324+0000 7fbb88ff9640 10 client.4496.objecter ms_handle_connect 0x7fbb5c077d70 2026-02-25T15:13:05.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7bdc05cae0 con 0x7f7bec157780 2026-02-25T15:13:05.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7f7be17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7f7be17fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fa277632640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:13:05.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fa277632640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:13:05.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fa277632640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa27015b710 con 0x7fa2700585e0 2026-02-25T15:13:05.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fbb80093600 con 0x7fbb8c0ba350 2026-02-25T15:13:05.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fbb88ff9640 10 client.4496.objecter ms_dispatch2 0x7fbb8c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:05.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fbb88ff9640 3 client.4496.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:05.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fbb88ff9640 3 client.4496.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:05.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.325+0000 7fbb88ff9640 20 client.4496.objecter dump_active .. 0 homeless 2026-02-25T15:13:05.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.327+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fbb8c159080 con 0x7fbb8c0ba350 2026-02-25T15:13:05.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.327+0000 7fbb88ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:05.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.327+0000 7fbb88ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:05.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7f49d2ffd640 1 -- 10.20.193.78:0/447000205 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 737253363) 0x7f49dc05c2f0 con 0x7f49ec0b1f20 2026-02-25T15:13:05.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7f49d2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:13:05.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7f49d2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7fa25dffb640 1 -- 10.20.193.78:0/2664061988 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 521551722) 0x7fa26005cb50 con 0x7fa2700585e0 2026-02-25T15:13:05.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7fa25dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:13:05.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7fa25dffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.335 INFO:teuthology.orchestra.run.trial078.stdout:94489280515 2026-02-25T15:13:05.336 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:05.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7f6f6cfa2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:13:05.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7f6f6cfa2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:13:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7f6f6cfa2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.330+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6f6815b710 con 0x7f6f680ba350 2026-02-25T15:13:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.331+0000 7f90bb7fe640 1 -- 10.20.193.78:0/627999952 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 737253363) 0x7f90c405c980 con 0x7f90dc159da0 2026-02-25T15:13:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.331+0000 7f90bb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:13:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.331+0000 7f90bb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.338 INFO:teuthology.orchestra.run.trial078.stdout:94489280515 2026-02-25T15:13:05.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.332+0000 7f3ed212c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:13:05.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.332+0000 7f3ed212c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:13:05.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.332+0000 7f3ed212c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.332+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f3ecc1f97a0 con 0x7f3ecc0585e0 2026-02-25T15:13:05.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7ff2be934640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:13:05.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7ff2be934640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:13:05.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7ff2be934640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:05.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff2b8164960 con 0x7ff2b8164d00 2026-02-25T15:13:05.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 10 librados: watch_flush enter 2026-02-25T15:13:05.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 10 librados: watch_flush exit 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 20 client.4516.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 10 client.4516.objecter successfully canceled tick 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 >> v1:10.20.193.78:6800/3497602169 conn(0x7fa240077d40 legacy=0x7fa2400981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 10 monclient: shutdown 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 >> v1:10.20.193.155:6789/0 conn(0x7fa2700585e0 legacy=0x7fa2701fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 shutdown_connections 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 >> 10.20.193.78:0/2664061988 conn(0x7fa2700b7990 msgr2=0x7fa2700b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 shutdown_connections 2026-02-25T15:13:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7f49f42cd640 10 librados: watch_flush enter 2026-02-25T15:13:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7f49f42cd640 10 librados: watch_flush exit 2026-02-25T15:13:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 1 -- 10.20.193.78:0/2664061988 wait complete. 2026-02-25T15:13:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7f49f42cd640 20 client.4513.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7f49f42cd640 10 client.4513.objecter successfully canceled tick 2026-02-25T15:13:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7fa277632640 1 librados: shutdown 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 >> v1:10.20.193.78:6800/3497602169 conn(0x7f49bc077d00 legacy=0x7f49bc0981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7f49f42cd640 10 monclient: shutdown 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7f49f42cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.333+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 >> v1:10.20.193.155:6789/0 conn(0x7f49ec0b1f20 legacy=0x7f49ec203470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.334+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 shutdown_connections 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.334+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 >> 10.20.193.78:0/447000205 conn(0x7f49ec0b7780 msgr2=0x7f49ec0b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.334+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 shutdown_connections 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.334+0000 7f49f42cd640 1 -- 10.20.193.78:0/447000205 wait complete. 2026-02-25T15:13:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.334+0000 7f49f42cd640 1 librados: shutdown 2026-02-25T15:13:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.334+0000 7f6f4effd640 1 -- 10.20.193.78:0/1210364839 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 737253363) 0x7f6f5805ce60 con 0x7f6f680ba350 2026-02-25T15:13:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.334+0000 7f6f4effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:13:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.334+0000 7f6f4effd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280517 for osd.9 2026-02-25T15:13:05.346 INFO:teuthology.orchestra.run.trial078.stdout:94489280515 2026-02-25T15:13:05.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 10 librados: watch_flush enter 2026-02-25T15:13:05.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 10 librados: watch_flush exit 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 20 client.4472.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 10 client.4472.objecter successfully canceled tick 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 >> v1:10.20.193.78:6800/3497602169 conn(0x7f90a8077e30 legacy=0x7f90a80982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 10 monclient: shutdown 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 >> v1:10.20.193.167:6789/0 conn(0x7f90dc159da0 legacy=0x7f90dc0b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 shutdown_connections 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 >> 10.20.193.78:0/627999952 conn(0x7f90dc0b78c0 msgr2=0x7f90dc1566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 shutdown_connections 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 1 -- 10.20.193.78:0/627999952 wait complete. 2026-02-25T15:13:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.335+0000 7f90e1783640 1 librados: shutdown 2026-02-25T15:13:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.336+0000 7f3ea7fff640 1 -- 10.20.193.78:0/2765385530 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 778662779) 0x7f3ecc163930 con 0x7f3ecc0585e0 2026-02-25T15:13:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.336+0000 7f3ea7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:13:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.336+0000 7f3ea7fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.349 INFO:teuthology.orchestra.run.trial078.stdout:90194313219 2026-02-25T15:13:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 10 librados: watch_flush enter 2026-02-25T15:13:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 10 librados: watch_flush exit 2026-02-25T15:13:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 20 client.4499.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 10 client.4499.objecter successfully canceled tick 2026-02-25T15:13:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6f34077d40 legacy=0x7f6f340981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 10 monclient: shutdown 2026-02-25T15:13:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 >> v1:10.20.193.167:6789/0 conn(0x7f6f680ba350 legacy=0x7f6f681f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 shutdown_connections 2026-02-25T15:13:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 >> 10.20.193.78:0/1210364839 conn(0x7f6f680b7990 msgr2=0x7f6f680b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 shutdown_connections 2026-02-25T15:13:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 1 -- 10.20.193.78:0/1210364839 wait complete. 2026-02-25T15:13:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.337+0000 7f6f6cfa2640 1 librados: shutdown 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 10 librados: watch_flush enter 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 10 librados: watch_flush exit 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 20 client.4522.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 10 client.4522.objecter successfully canceled tick 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 >> v1:10.20.193.78:6800/3497602169 conn(0x7f3e9c077da0 legacy=0x7f3e9c098250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 10 monclient: shutdown 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 >> v1:10.20.193.155:6789/0 conn(0x7f3ecc0585e0 legacy=0x7f3ecc1fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 shutdown_connections 2026-02-25T15:13:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 >> 10.20.193.78:0/2765385530 conn(0x7f3ecc0b7990 msgr2=0x7f3ecc0b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 shutdown_connections 2026-02-25T15:13:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 1 -- 10.20.193.78:0/2765385530 wait complete. 2026-02-25T15:13:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.339+0000 7f3ed212c640 1 librados: shutdown 2026-02-25T15:13:05.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.10 2026-02-25T15:13:05.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.14 2026-02-25T15:13:05.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.12 2026-02-25T15:13:05.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.4 2026-02-25T15:13:05.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.13 2026-02-25T15:13:05.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.364+0000 7ff2b4ff9640 1 -- 10.20.193.78:0/3672180789 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 521551722) 0x7ff2ac05cdd0 con 0x7ff2b8164d00 2026-02-25T15:13:05.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.364+0000 7ff2b4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:13:05.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.364+0000 7ff2b4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.366 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:05.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 10 librados: watch_flush enter 2026-02-25T15:13:05.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 10 librados: watch_flush exit 2026-02-25T15:13:05.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 20 client.4557.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 10 client.4557.objecter successfully canceled tick 2026-02-25T15:13:05.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 >> v1:10.20.193.78:6800/3497602169 conn(0x7ff288077d90 legacy=0x7ff288098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 10 monclient: shutdown 2026-02-25T15:13:05.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 >> v1:10.20.193.78:6789/0 conn(0x7ff2b8164d00 legacy=0x7ff2b80ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 shutdown_connections 2026-02-25T15:13:05.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 >> 10.20.193.78:0/3672180789 conn(0x7ff2b80b2ef0 msgr2=0x7ff2b80ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 shutdown_connections 2026-02-25T15:13:05.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 1 -- 10.20.193.78:0/3672180789 wait complete. 2026-02-25T15:13:05.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.367+0000 7ff2be934640 1 librados: shutdown 2026-02-25T15:13:05.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.1 2026-02-25T15:13:05.379 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:05.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.430+0000 7fe9737e1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:13:05.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.430+0000 7fe9737e1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:13:05.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.430+0000 7fe9737e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.430+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe96c15b710 con 0x7fe96c0ba350 2026-02-25T15:13:05.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.432+0000 7f193a09c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:13:05.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.432+0000 7f193a09c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:13:05.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.432+0000 7f193a09c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.432+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f193405bc80 con 0x7f1934161430 2026-02-25T15:13:05.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.433+0000 7fe95dffb640 1 -- 10.20.193.78:0/2405635917 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 521551722) 0x7fe96805ce90 con 0x7fe96c0ba350 2026-02-25T15:13:05.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.433+0000 7fe95dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:13:05.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.433+0000 7fe95dffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.435 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.434+0000 7f190ffff640 1 -- 10.20.193.78:0/3752183341 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 521551722) 0x7f192005c400 con 0x7f1934161430 2026-02-25T15:13:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.434+0000 7f190ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:13:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.434+0000 7f190ffff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.436 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:05.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 10 librados: watch_flush enter 2026-02-25T15:13:05.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 10 librados: watch_flush exit 2026-02-25T15:13:05.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 20 client.4484.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 10 client.4484.objecter successfully canceled tick 2026-02-25T15:13:05.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 >> v1:10.20.193.78:6800/3497602169 conn(0x7fe93c077d40 legacy=0x7fe93c0981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 10 monclient: shutdown 2026-02-25T15:13:05.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 >> v1:10.20.193.167:6789/0 conn(0x7fe96c0ba350 legacy=0x7fe96c1f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 shutdown_connections 2026-02-25T15:13:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 >> 10.20.193.78:0/2405635917 conn(0x7fe96c0b7990 msgr2=0x7fe96c0b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 shutdown_connections 2026-02-25T15:13:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 1 -- 10.20.193.78:0/2405635917 wait complete. 2026-02-25T15:13:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.435+0000 7fe9737e1640 1 librados: shutdown 2026-02-25T15:13:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 10 librados: watch_flush enter 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 10 librados: watch_flush exit 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 20 client.4528.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 10 client.4528.objecter successfully canceled tick 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 >> v1:10.20.193.78:6800/3497602169 conn(0x7f1904077d60 legacy=0x7f1904098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 10 monclient: shutdown 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 >> v1:10.20.193.155:6789/0 conn(0x7f1934161430 legacy=0x7f19340a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 shutdown_connections 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 >> 10.20.193.78:0/3752183341 conn(0x7f19340b2ef0 msgr2=0x7f19340b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 shutdown_connections 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.436+0000 7f193a09c640 1 -- 10.20.193.78:0/3752183341 wait complete. 2026-02-25T15:13:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.437+0000 7f193a09c640 1 librados: shutdown 2026-02-25T15:13:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.443+0000 7fbb927fa640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:13:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.443+0000 7fbb927fa640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:13:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.443+0000 7fbb927fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.443+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7fbb8c15b710 con 0x7fbb8c0ba350 2026-02-25T15:13:05.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.7 2026-02-25T15:13:05.447 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:05.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.6 2026-02-25T15:13:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.445+0000 7f7bf2ad0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:13:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.445+0000 7f7bf2ad0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:13:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.445+0000 7f7bf2ad0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.445+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f7bec1646e0 con 0x7f7bec157780 2026-02-25T15:13:05.449 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.446+0000 7fbb88ff9640 1 -- 10.20.193.78:0/1753865406 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 521551722) 0x7fbb8005e030 con 0x7fbb8c0ba350 2026-02-25T15:13:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.446+0000 7fbb88ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:13:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.446+0000 7fbb88ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.450 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7f7be17fa640 1 -- 10.20.193.78:0/244447092 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 521551722) 0x7f7bdc05c3e0 con 0x7f7bec157780 2026-02-25T15:13:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7f7be17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:13:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7f7be17fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:05.451 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:05.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 10 librados: watch_flush enter 2026-02-25T15:13:05.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 10 librados: watch_flush exit 2026-02-25T15:13:05.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 20 client.4496.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 10 client.4496.objecter successfully canceled tick 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 >> v1:10.20.193.78:6800/3497602169 conn(0x7fbb5c077d70 legacy=0x7fbb5c098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 10 monclient: shutdown 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 >> v1:10.20.193.167:6789/0 conn(0x7fbb8c0ba350 legacy=0x7fbb8c1f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 shutdown_connections 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 >> 10.20.193.78:0/1753865406 conn(0x7fbb8c0b7990 msgr2=0x7fbb8c0b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 shutdown_connections 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 1 -- 10.20.193.78:0/1753865406 wait complete. 2026-02-25T15:13:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.448+0000 7fbb927fa640 1 librados: shutdown 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 10 librados: watch_flush enter 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 10 librados: watch_flush exit 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 20 client.4531.objecter shutdown clearing up homeless session... 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 10 client.4531.objecter successfully canceled tick 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7bbc077d70 legacy=0x7f7bbc098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 10 monclient: shutdown 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 >> v1:10.20.193.155:6789/0 conn(0x7f7bec157780 legacy=0x7f7bec1fc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 shutdown_connections 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 >> 10.20.193.78:0/244447092 conn(0x7f7bec0b2ef0 msgr2=0x7f7bec0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 shutdown_connections 2026-02-25T15:13:05.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 1 -- 10.20.193.78:0/244447092 wait complete. 2026-02-25T15:13:05.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:05.451+0000 7f7bf2ad0640 1 librados: shutdown 2026-02-25T15:13:05.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.15 2026-02-25T15:13:05.461 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:05.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.8 2026-02-25T15:13:05.462 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.019 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-25T15:13:06.041 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T15:13:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.084+0000 7feb9eb7f640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.084+0000 7feb9eb7f640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.084+0000 7feb9eb7f640 10 monclient: monmap: 2026-02-25T15:13:06.086 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.086 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.086 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.085611+0000 2026-02-25T15:13:06.087 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.085611+0000 2026-02-25T15:13:06.087 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.087 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.087 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.087 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.087 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.087 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.085+0000 7feb9eb7f640 1 Processor -- start 2026-02-25T15:13:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.085+0000 7feb9eb7f640 1 -- start start 2026-02-25T15:13:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.085+0000 7feb9eb7f640 10 monclient: init 2026-02-25T15:13:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.085+0000 7feb9eb7f640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.085+0000 7feb9eb7f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.085+0000 7feb9eb7f640 10 monclient(hunting): picked mon.noname-c con 0x7feb980b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9eb7f640 10 monclient(hunting): picked mon.noname-b con 0x7feb980ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9eb7f640 10 monclient(hunting): picked mon.noname-a con 0x7feb980585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9eb7f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb98163930 con 0x7feb980585e0 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9eb7f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb98163bb0 con 0x7feb980ba350 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9eb7f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb98163e90 con 0x7feb980b9f80 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9eb7f640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9eb7f640 10 monclient(hunting): authenticate will time out at 3355.675057s 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9c8f4640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7feb980b9f80 0x7feb98163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51098/0 (socket says 10.20.193.78:51098) 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb9c8f4640 1 -- 10.20.193.78:0/907619550 learned_addr learned my addr 10.20.193.78:0/907619550 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.086+0000 7feb8ffff640 1 --1- 10.20.193.78:0/907619550 >> v1:10.20.193.155:6789/0 conn(0x7feb980ba350 0x7feb98057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58246/0 (socket says 10.20.193.78:58246) 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.087+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293566351 0 0) 0x7feb98163bb0 con 0x7feb980ba350 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.087+0000 7feb8f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.087+0000 7feb8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.087+0000 7feb8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.087+0000 7feb8f7fe640 10 monclient(hunting): my global_id is 4546 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.087+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb84003610 con 0x7feb980ba350 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166760688 0 0) 0x7feb98163e90 con 0x7feb980b9f80 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 10 monclient(hunting): my global_id is 4508 2026-02-25T15:13:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb98163bb0 con 0x7feb980b9f80 2026-02-25T15:13:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212502517 0 0) 0x7feb94002c90 con 0x7feb980585e0 2026-02-25T15:13:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 10 monclient(hunting): my global_id is 4563 2026-02-25T15:13:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.088+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb98163e90 con 0x7feb980585e0 2026-02-25T15:13:06.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1743793664 0 0) 0x7feb84003610 con 0x7feb980ba350 2026-02-25T15:13:06.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 >> v1:10.20.193.167:6789/0 conn(0x7feb980b9f80 legacy=0x7feb98163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 >> v1:10.20.193.78:6789/0 conn(0x7feb980585e0 legacy=0x7feb98166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 1 monclient: found mon.noname-b 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb980573f0 con 0x7feb980ba350 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7feb80002df0 con 0x7feb980ba350 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb9eb7f640 5 monclient: authenticate success, global_id 4546 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb8f7fe640 10 monclient: dump: 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.093 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.089+0000 7feb9eb7f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb80002fc0 con 0x7feb980ba350 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb8f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb8f7fe640 1 -- 10.20.193.78:0/907619550 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7feb80003400 con 0x7feb980ba350 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb8f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb8f7fe640 10 monclient: dump: 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.094 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 4 set_mon_vals no callback set 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 10 monclient: shutdown 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 1 -- 10.20.193.78:0/907619550 >> v1:10.20.193.155:6789/0 conn(0x7feb980ba350 legacy=0x7feb98057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 1 -- 10.20.193.78:0/907619550 shutdown_connections 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 1 -- 10.20.193.78:0/907619550 >> 10.20.193.78:0/907619550 conn(0x7feb980b7990 msgr2=0x7feb980b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 1 -- 10.20.193.78:0/907619550 shutdown_connections 2026-02-25T15:13:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.090+0000 7feb9eb7f640 1 -- 10.20.193.78:0/907619550 wait complete. 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 10 monclient: monmap: 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.098 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 1 librados: starting msgr at 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 1 librados: starting objecter 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 1 Processor -- start 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 1 -- start start 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 1 librados: setting wanted keys 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 1 librados: calling monclient init 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 10 monclient: init 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.091+0000 7feb9eb7f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9eb7f640 10 monclient(hunting): picked mon.noname-a con 0x7feb980585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9eb7f640 10 monclient(hunting): picked mon.noname-b con 0x7feb980b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9eb7f640 10 monclient(hunting): picked mon.noname-c con 0x7feb980ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9eb7f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb981fca90 con 0x7feb980585e0 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9eb7f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb981fcd70 con 0x7feb980b9f80 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9eb7f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb981fd050 con 0x7feb980ba350 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9eb7f640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9eb7f640 10 monclient(hunting): authenticate will time out at 3355.681050s 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9c8f4640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7feb980585e0 0x7feb981fde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37462/0 (socket says 10.20.193.78:37462) 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb9c8f4640 1 -- 10.20.193.78:0/3667500870 learned_addr learned my addr 10.20.193.78:0/3667500870 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb8d7fa640 10 client.?.objecter ms_handle_connect 0x7feb980b9f80 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb8d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb8d7fa640 10 client.?.objecter ms_handle_connect 0x7feb980585e0 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb8d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb8d7fa640 10 client.?.objecter ms_handle_connect 0x7feb980ba350 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.092+0000 7feb8d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719385310 0 0) 0x7feb981fcd70 con 0x7feb980b9f80 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): my global_id is 4549 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb68003610 con 0x7feb980b9f80 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 138322238 0 0) 0x7feb981fca90 con 0x7feb980585e0 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): my global_id is 4566 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb981fcd70 con 0x7feb980585e0 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947466867 0 0) 0x7feb981fd050 con 0x7feb980ba350 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 10 monclient(hunting): my global_id is 4511 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.093+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb981fca90 con 0x7feb980ba350 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.095+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2903977712 0 0) 0x7feb68003610 con 0x7feb980b9f80 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.095+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb981fd050 con 0x7feb980b9f80 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.095+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7feb80003310 con 0x7feb980b9f80 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.095+0000 7feb8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.095+0000 7feb8d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.095+0000 7feb8d7fa640 10 monclient(hunting): dump: 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.095+0000 7feb8d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4284459644 0 0) 0x7feb981fcd70 con 0x7feb980585e0 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb68003610 con 0x7feb980585e0 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7feb88003170 con 0x7feb980585e0 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 10 monclient(hunting): dump: 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2085644511 0 0) 0x7feb981fca90 con 0x7feb980ba350 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb981fcd70 con 0x7feb980ba350 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7feb940035e0 con 0x7feb980ba350 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.096+0000 7feb8d7fa640 10 monclient(hunting): dump: 2026-02-25T15:13:06.103 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.104 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2059163039 0 0) 0x7feb981fd050 con 0x7feb980b9f80 2026-02-25T15:13:06.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 >> v1:10.20.193.167:6789/0 conn(0x7feb980ba350 legacy=0x7feb980b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 >> v1:10.20.193.78:6789/0 conn(0x7feb980585e0 legacy=0x7feb981fde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 1 monclient: found mon.b 2026-02-25T15:13:06.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb981fd330 con 0x7feb980b9f80 2026-02-25T15:13:06.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb8d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 5 monclient: authenticate success, global_id 4549 2026-02-25T15:13:06.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 10 monclient: _renew_subs 2026-02-25T15:13:06.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb981fd610 con 0x7feb980b9f80 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 10 client.4549.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 10 monclient: _renew_subs 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feb981f91b0 con 0x7feb980b9f80 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.097+0000 7feb9eb7f640 1 librados: init done 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.098+0000 7feb9eb7f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.098+0000 7feb9eb7f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.098+0000 7feb9eb7f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.098+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb980b64c0 con 0x7feb980b9f80 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.103+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb80002fc0 con 0x7feb980b9f80 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.103+0000 7feb8d7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.103+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7feb800028e0 con 0x7feb980b9f80 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.103+0000 7feb8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.103+0000 7feb8d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.103+0000 7feb8d7fa640 10 monclient: dump: 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.110 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.103+0000 7feb8effd640 4 set_mon_vals no callback set 2026-02-25T15:13:06.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.106+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7feb8001d850 con 0x7feb980b9f80 2026-02-25T15:13:06.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.106+0000 7feb9c8f4640 10 monclient: get_auth_request con 0x7feb68077e20 auth_method 0 2026-02-25T15:13:06.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.107+0000 7feb8d7fa640 10 client.4549.objecter ms_handle_connect 0x7feb68077e20 2026-02-25T15:13:06.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.107+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7feb80002960 con 0x7feb980b9f80 2026-02-25T15:13:06.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.107+0000 7feb8d7fa640 10 client.4549.objecter ms_dispatch2 0x7feb98000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.107+0000 7feb8d7fa640 3 client.4549.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.107+0000 7feb8d7fa640 3 client.4549.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.107+0000 7feb8d7fa640 20 client.4549.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.125+0000 7fd081d73640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.125+0000 7fd081d73640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.125+0000 7fd081d73640 10 monclient: monmap: 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.126796+0000 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.126796+0000 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.128 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 1 Processor -- start 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 1 -- start start 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 10 monclient: init 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 10 monclient(hunting): picked mon.noname-c con 0x7fd07c157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 10 monclient(hunting): picked mon.noname-b con 0x7fd07c157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 10 monclient(hunting): picked mon.noname-a con 0x7fd07c164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c05de70 con 0x7fd07c164d00 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c055b20 con 0x7fd07c157b50 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c055e00 con 0x7fd07c157780 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.126+0000 7fd081d73640 10 monclient(hunting): authenticate will time out at 3355.715957s 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.127+0000 7fd07b7fe640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fd07c157780 0x7fd07c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51120/0 (socket says 10.20.193.78:51120) 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.127+0000 7fd07b7fe640 1 -- 10.20.193.78:0/3420656636 learned_addr learned my addr 10.20.193.78:0/3420656636 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.127+0000 7fd07bfff640 1 --1- 10.20.193.78:0/3420656636 >> v1:10.20.193.78:6789/0 conn(0x7fd07c164d00 0x7fd07c1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37464/0 (socket says 10.20.193.78:37464) 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41913442 0 0) 0x7fd07c05de70 con 0x7fd07c164d00 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 10 monclient(hunting): my global_id is 4569 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd060003610 con 0x7fd07c164d00 2026-02-25T15:13:06.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491961512 0 0) 0x7fd07c055e00 con 0x7fd07c157780 2026-02-25T15:13:06.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 10 monclient(hunting): my global_id is 4514 2026-02-25T15:13:06.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.128+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd07c05de70 con 0x7fd07c157780 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1689284289 0 0) 0x7fd07c05de70 con 0x7fd07c157780 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 >> v1:10.20.193.155:6789/0 conn(0x7fd07c157b50 legacy=0x7fd07c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 >> v1:10.20.193.78:6789/0 conn(0x7fd07c164d00 legacy=0x7fd07c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 1 monclient: found mon.noname-c 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c0560e0 con 0x7fd07c157780 2026-02-25T15:13:06.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd068002df0 con 0x7fd07c157780 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd07a7fc640 10 monclient: dump: 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.138 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd081d73640 5 monclient: authenticate success, global_id 4514 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.130+0000 7fd081d73640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd068003000 con 0x7fd07c157780 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd07a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd07a7fc640 1 -- 10.20.193.78:0/3420656636 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd068003440 con 0x7fd07c157780 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd07a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd07a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd07a7fc640 10 monclient: dump: 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.139 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 4 set_mon_vals no callback set 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 10 monclient: shutdown 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 1 -- 10.20.193.78:0/3420656636 >> v1:10.20.193.167:6789/0 conn(0x7fd07c157780 legacy=0x7fd07c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 1 -- 10.20.193.78:0/3420656636 shutdown_connections 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 1 -- 10.20.193.78:0/3420656636 >> 10.20.193.78:0/3420656636 conn(0x7fd07c0b2ef0 msgr2=0x7fd07c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 1 -- 10.20.193.78:0/3420656636 shutdown_connections 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 1 -- 10.20.193.78:0/3420656636 wait complete. 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.131+0000 7fd081d73640 10 monclient: monmap: 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.141 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.132+0000 7fd081d73640 1 librados: starting msgr at 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.132+0000 7fd081d73640 1 librados: starting objecter 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.132+0000 7fd081d73640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.132+0000 7fd081d73640 1 Processor -- start 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.132+0000 7fd081d73640 1 -- start start 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.132+0000 7fd081d73640 1 librados: setting wanted keys 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.132+0000 7fd081d73640 1 librados: calling monclient init 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.132+0000 7fd081d73640 10 monclient: init 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 10 monclient(hunting): picked mon.noname-a con 0x7fd07c157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 10 monclient(hunting): picked mon.noname-b con 0x7fd07c157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 10 monclient(hunting): picked mon.noname-c con 0x7fd07c164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c0a72e0 con 0x7fd07c157780 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c0a75c0 con 0x7fd07c157b50 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c0a78a0 con 0x7fd07c164d00 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd081d73640 10 monclient(hunting): authenticate will time out at 3355.722199s 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd07b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd07c157780 0x7fd07c1f95f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37478/0 (socket says 10.20.193.78:37478) 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd07b7fe640 1 -- 10.20.193.78:0/4222500821 learned_addr learned my addr 10.20.193.78:0/4222500821 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd057fff640 10 client.?.objecter ms_handle_connect 0x7fd07c157780 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd057fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd057fff640 10 client.?.objecter ms_handle_connect 0x7fd07c164d00 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.133+0000 7fd057fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31519093 0 0) 0x7fd07c0a72e0 con 0x7fd07c157780 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 10 monclient(hunting): my global_id is 4572 2026-02-25T15:13:06.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd04c003610 con 0x7fd07c157780 2026-02-25T15:13:06.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1447737696 0 0) 0x7fd07c0a78a0 con 0x7fd07c164d00 2026-02-25T15:13:06.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 10 monclient(hunting): my global_id is 4517 2026-02-25T15:13:06.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.134+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd07c0a72e0 con 0x7fd07c164d00 2026-02-25T15:13:06.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2289677747 0 0) 0x7fd04c003610 con 0x7fd07c157780 2026-02-25T15:13:06.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd07c0a78a0 con 0x7fd07c157780 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd068003350 con 0x7fd07c157780 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 10 monclient(hunting): dump: 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.147 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1488111821 0 0) 0x7fd07c0a72e0 con 0x7fd07c164d00 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd04c003610 con 0x7fd07c164d00 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd070003370 con 0x7fd07c164d00 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.136+0000 7fd057fff640 10 monclient(hunting): dump: 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.148 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3391148181 0 0) 0x7fd07c0a78a0 con 0x7fd07c157780 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 >> v1:10.20.193.167:6789/0 conn(0x7fd07c164d00 legacy=0x7fd07c1fa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 >> v1:10.20.193.155:6789/0 conn(0x7fd07c157b50 legacy=0x7fd07c156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 1 monclient: found mon.a 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c0a7b80 con 0x7fd07c157780 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd057fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 5 monclient: authenticate success, global_id 4572 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 10 monclient: _renew_subs 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd07c0a7e60 con 0x7fd07c157780 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 10 client.4572.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 10 monclient: _renew_subs 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd07c0a8420 con 0x7fd07c157780 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.138+0000 7fd081d73640 1 librados: init done 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.139+0000 7fd081d73640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.139+0000 7fd081d73640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.139+0000 7fd081d73640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.139+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07c15b3f0 con 0x7fd07c157780 2026-02-25T15:13:06.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.146+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd068003000 con 0x7fd07c157780 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.146+0000 7fd057fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.146+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd068004e80 con 0x7fd07c157780 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.146+0000 7fd057fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.146+0000 7fd057fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.146+0000 7fd057fff640 10 monclient: dump: 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.152 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.146+0000 7fd079ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.146+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fd06801dcf0 con 0x7fd07c157780 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.147+0000 7fd07affd640 10 monclient: get_auth_request con 0x7fd04c077d60 auth_method 0 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.147+0000 7fd057fff640 10 client.4572.objecter ms_handle_connect 0x7fd04c077d60 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.147+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fd068093310 con 0x7fd07c157780 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.147+0000 7fd057fff640 10 client.4572.objecter ms_dispatch2 0x7fd07c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.147+0000 7fd057fff640 3 client.4572.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.147+0000 7fd057fff640 3 client.4572.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.147+0000 7fd057fff640 20 client.4572.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.193+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7feb8005da30 con 0x7feb980b9f80 2026-02-25T15:13:06.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.193+0000 7feb8d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.193+0000 7feb8d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.232 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T15:13:06.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.230+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd06805dd40 con 0x7fd07c157780 2026-02-25T15:13:06.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.230+0000 7fd057fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.230+0000 7fd057fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.235 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-25T15:13:06.241 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T15:13:06.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.297+0000 7f7d1dc6f640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.297+0000 7f7d1dc6f640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.297+0000 7f7d1dc6f640 10 monclient: monmap: 2026-02-25T15:13:06.299 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.299 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.299 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.298005+0000 2026-02-25T15:13:06.299 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.298005+0000 2026-02-25T15:13:06.299 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.299 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.300 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.300 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.300 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.300 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.297+0000 7f7d1dc6f640 1 Processor -- start 2026-02-25T15:13:06.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.297+0000 7f7d1dc6f640 1 -- start start 2026-02-25T15:13:06.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.297+0000 7f7d1dc6f640 10 monclient: init 2026-02-25T15:13:06.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:06.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 10 monclient(hunting): picked mon.noname-b con 0x7f7d1815d3b0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 10 monclient(hunting): picked mon.noname-a con 0x7f7d180b4c30 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 10 monclient(hunting): picked mon.noname-c con 0x7f7d181a7ac0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d18164640 con 0x7f7d180b4c30 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d180b1530 con 0x7f7d1815d3b0 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d180b1810 con 0x7f7d181a7ac0 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d1dc6f640 10 monclient(hunting): authenticate will time out at 3355.887188s 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d17fff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f7d181a7ac0 0x7f7d181c7ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51126/0 (socket says 10.20.193.78:51126) 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.298+0000 7f7d17fff640 1 -- 10.20.193.78:0/2195193781 learned_addr learned my addr 10.20.193.78:0/2195193781 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.299+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747293430 0 0) 0x7f7d180b1810 con 0x7f7d181a7ac0 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.299+0000 7f7d167fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.299+0000 7f7d167fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.299+0000 7f7d167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.299+0000 7f7d167fc640 10 monclient(hunting): my global_id is 4520 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.299+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cfc003610 con 0x7f7d181a7ac0 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3044146325 0 0) 0x7f7d08002910 con 0x7f7d180b4c30 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 10 monclient(hunting): my global_id is 4575 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d180b1810 con 0x7f7d180b4c30 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987429188 0 0) 0x7f7d180b1530 con 0x7f7d1815d3b0 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 10 monclient(hunting): my global_id is 4552 2026-02-25T15:13:06.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.300+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d08002910 con 0x7f7d1815d3b0 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 731401151 0 0) 0x7f7cfc003610 con 0x7f7d181a7ac0 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 >> v1:10.20.193.155:6789/0 conn(0x7f7d1815d3b0 legacy=0x7f7d18163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 >> v1:10.20.193.78:6789/0 conn(0x7f7d180b4c30 legacy=0x7f7d180af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 1 monclient: found mon.noname-c 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d180aebd0 con 0x7f7d181a7ac0 2026-02-25T15:13:06.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d1dc6f640 5 monclient: authenticate success, global_id 4520 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d1dc6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7d0c003170 con 0x7f7d181a7ac0 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d167fc640 10 monclient: dump: 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.307 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.301+0000 7f7d1dc6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d0c003340 con 0x7f7d181a7ac0 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d167fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d167fc640 1 -- 10.20.193.78:0/2195193781 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7d0c003780 con 0x7f7d181a7ac0 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d167fc640 10 monclient: dump: 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 4 set_mon_vals no callback set 2026-02-25T15:13:06.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7feb9eb7f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:13:06.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7feb9eb7f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:13:06.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7feb9eb7f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7feb98159390 con 0x7feb980b9f80 2026-02-25T15:13:06.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 10 monclient: shutdown 2026-02-25T15:13:06.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/2195193781 >> v1:10.20.193.167:6789/0 conn(0x7f7d181a7ac0 legacy=0x7f7d181c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/2195193781 shutdown_connections 2026-02-25T15:13:06.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/2195193781 >> 10.20.193.78:0/2195193781 conn(0x7f7d180b4120 msgr2=0x7f7d180b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/2195193781 shutdown_connections 2026-02-25T15:13:06.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.302+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/2195193781 wait complete. 2026-02-25T15:13:06.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient: monmap: 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 librados: starting msgr at 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 librados: starting objecter 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 Processor -- start 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 -- start start 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 librados: setting wanted keys 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 librados: calling monclient init 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient: init 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient(hunting): picked mon.noname-c con 0x7f7d180b4c30 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient(hunting): picked mon.noname-a con 0x7f7d1815d3b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient(hunting): picked mon.noname-b con 0x7f7d181a7ac0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d181a78d0 con 0x7f7d1815d3b0 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1815f710 con 0x7f7d181a7ac0 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1815f9f0 con 0x7f7d180b4c30 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.303+0000 7f7d1dc6f640 10 monclient(hunting): authenticate will time out at 3355.892847s 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.304+0000 7f7d16ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7d1815d3b0 0x7f7d18162c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37484/0 (socket says 10.20.193.78:37484) 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.304+0000 7f7d16ffd640 1 -- 10.20.193.78:0/1373114523 learned_addr learned my addr 10.20.193.78:0/1373114523 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.304+0000 7f7cf3fff640 10 client.?.objecter ms_handle_connect 0x7f7d1815d3b0 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.304+0000 7f7cf3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.304+0000 7f7cf3fff640 10 client.?.objecter ms_handle_connect 0x7f7d180b4c30 2026-02-25T15:13:06.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.304+0000 7f7cf3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262749897 0 0) 0x7f7d181a78d0 con 0x7f7d1815d3b0 2026-02-25T15:13:06.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 10 monclient(hunting): my global_id is 4578 2026-02-25T15:13:06.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce8003610 con 0x7f7d1815d3b0 2026-02-25T15:13:06.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7feb8d7fa640 1 -- 10.20.193.78:0/3667500870 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1257367751) 0x7feb8005d330 con 0x7feb980b9f80 2026-02-25T15:13:06.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7feb8d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:13:06.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7feb8d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.318 INFO:teuthology.orchestra.run.trial078.stdout:90194313220 2026-02-25T15:13:06.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270356482 0 0) 0x7f7d1815f9f0 con 0x7f7d180b4c30 2026-02-25T15:13:06.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 10 monclient(hunting): my global_id is 4523 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.305+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d181a78d0 con 0x7f7d180b4c30 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.306+0000 7f7cf3fff640 10 client.?.objecter ms_handle_connect 0x7f7d181a7ac0 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.306+0000 7f7cf3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.307+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940970221 0 0) 0x7f7d1815f710 con 0x7f7d181a7ac0 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.307+0000 7f7cf3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.307+0000 7f7cf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.307+0000 7f7cf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.307+0000 7f7cf3fff640 10 monclient(hunting): my global_id is 4555 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.307+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d1815f9f0 con 0x7f7d181a7ac0 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1140185604 0 0) 0x7f7d181a78d0 con 0x7f7d180b4c30 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d1815f710 con 0x7f7d180b4c30 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7d040031e0 con 0x7f7d180b4c30 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7f7cf3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7f7cf3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7f7cf3fff640 10 monclient(hunting): dump: 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.321 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.322 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.322 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.322 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.322 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7f7cf3fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 10 librados: watch_flush enter 2026-02-25T15:13:06.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 10 librados: watch_flush exit 2026-02-25T15:13:06.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 20 client.4549.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 10 client.4549.objecter successfully canceled tick 2026-02-25T15:13:06.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 >> v1:10.20.193.78:6800/3497602169 conn(0x7feb68077e20 legacy=0x7feb680982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 10 monclient: shutdown 2026-02-25T15:13:06.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 >> v1:10.20.193.155:6789/0 conn(0x7feb980b9f80 legacy=0x7feb98155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 shutdown_connections 2026-02-25T15:13:06.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 >> 10.20.193.78:0/3667500870 conn(0x7feb980b7990 msgr2=0x7feb9815b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 shutdown_connections 2026-02-25T15:13:06.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 1 -- 10.20.193.78:0/3667500870 wait complete. 2026-02-25T15:13:06.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.308+0000 7feb9eb7f640 1 librados: shutdown 2026-02-25T15:13:06.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.309+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2128546191 0 0) 0x7f7d1815f9f0 con 0x7f7d181a7ac0 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.309+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d181a78d0 con 0x7f7d181a7ac0 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.309+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7d0c0034f0 con 0x7f7d181a7ac0 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.309+0000 7f7cf3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.309+0000 7f7cf3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.309+0000 7f7cf3fff640 10 monclient(hunting): dump: 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.327 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1029952513 0 0) 0x7f7d1815f710 con 0x7f7d180b4c30 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 >> v1:10.20.193.155:6789/0 conn(0x7f7d181a7ac0 legacy=0x7f7d18127240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 >> v1:10.20.193.78:6789/0 conn(0x7f7d1815d3b0 legacy=0x7f7d18162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 1 monclient: found mon.c 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1815fcd0 con 0x7f7d180b4c30 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7cf3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 5 monclient: authenticate success, global_id 4523 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 10 monclient: _renew_subs 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1815ffb0 con 0x7f7d180b4c30 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 10 client.4523.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 10 monclient: _renew_subs 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d18160570 con 0x7f7d180b4c30 2026-02-25T15:13:06.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 1 librados: init done 2026-02-25T15:13:06.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.310+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d180531e0 con 0x7f7d180b4c30 2026-02-25T15:13:06.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.5 2026-02-25T15:13:06.331 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.319+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d04003700 con 0x7f7d180b4c30 2026-02-25T15:13:06.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.319+0000 7f7cf3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.319+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7d04003a50 con 0x7f7d180b4c30 2026-02-25T15:13:06.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.319+0000 7f7cf3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.319+0000 7f7cf3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.319+0000 7f7cf3fff640 10 monclient: dump: 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.319+0000 7f7d15ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:06.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.320+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f7d0401c8c0 con 0x7f7d180b4c30 2026-02-25T15:13:06.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.321+0000 7f7d16ffd640 10 monclient: get_auth_request con 0x7f7ce8077c20 auth_method 0 2026-02-25T15:13:06.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.321+0000 7f7cf3fff640 10 client.4523.objecter ms_handle_connect 0x7f7ce8077c20 2026-02-25T15:13:06.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.322+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f7d040584a0 con 0x7f7d180b4c30 2026-02-25T15:13:06.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.322+0000 7f7cf3fff640 10 client.4523.objecter ms_dispatch2 0x7f7d18000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.322+0000 7f7cf3fff640 3 client.4523.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.322+0000 7f7cf3fff640 3 client.4523.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.322+0000 7f7cf3fff640 20 client.4523.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.340+0000 7fd081d73640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:13:06.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.340+0000 7fd081d73640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:13:06.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.340+0000 7fd081d73640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.340+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd07c15ea20 con 0x7fd07c157780 2026-02-25T15:13:06.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.340+0000 7f9fc6b2e640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.340+0000 7f9fc6b2e640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.340+0000 7f9fc6b2e640 10 monclient: monmap: 2026-02-25T15:13:06.343 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.341804+0000 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.341804+0000 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.341+0000 7f9fc6b2e640 1 Processor -- start 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.341+0000 7f9fc6b2e640 1 -- start start 2026-02-25T15:13:06.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.341+0000 7f9fc6b2e640 10 monclient: init 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.341+0000 7f65e1555640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.341+0000 7f65e1555640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.341+0000 7f65e1555640 10 monclient: monmap: 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.342389+0000 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.342389+0000 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.345 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.346 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.346 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 1 Processor -- start 2026-02-25T15:13:06.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 1 -- start start 2026-02-25T15:13:06.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 10 monclient: init 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 10 monclient(hunting): picked mon.noname-b con 0x7f9fc015e6e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 10 monclient(hunting): picked mon.noname-c con 0x7f9fc0055980 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 10 monclient(hunting): picked mon.noname-a con 0x7f9fc0059470 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc0165370 con 0x7f9fc0059470 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc0055ee0 con 0x7f9fc015e6e0 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc0165090 con 0x7f9fc0055980 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc6b2e640 10 monclient(hunting): authenticate will time out at 3355.931248s 2026-02-25T15:13:06.348 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 10 monclient(hunting): picked mon.noname-b con 0x7f65dc0b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 10 monclient(hunting): picked mon.noname-a con 0x7f65dc0ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 10 monclient(hunting): picked mon.noname-c con 0x7f65dc0585e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc163930 con 0x7f65dc0ba350 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc163bb0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc163e90 con 0x7f65dc0585e0 2026-02-25T15:13:06.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc48a3640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f9fc015e6e0 0x7f9fc00b6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58296/0 (socket says 10.20.193.78:58296) 2026-02-25T15:13:06.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f65e1555640 10 monclient(hunting): authenticate will time out at 3355.931638s 2026-02-25T15:13:06.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.342+0000 7f9fc48a3640 1 -- 10.20.193.78:0/1088659681 learned_addr learned my addr 10.20.193.78:0/1088659681 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.343+0000 7fd057fff640 1 -- 10.20.193.78:0/4222500821 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 521551722) 0x7fd06805d640 con 0x7fd07c157780 2026-02-25T15:13:06.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.343+0000 7fd057fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:13:06.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.343+0000 7fd057fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.351 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:06.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.343+0000 7f65daffd640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f65dc0b9f80 0x7f65dc163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58308/0 (socket says 10.20.193.78:58308) 2026-02-25T15:13:06.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.343+0000 7f65daffd640 1 -- 10.20.193.78:0/3998226788 learned_addr learned my addr 10.20.193.78:0/3998226788 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.344+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1331936639 0 0) 0x7f9fc0055ee0 con 0x7f9fc015e6e0 2026-02-25T15:13:06.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.344+0000 7f9fb77fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.344+0000 7f9fb77fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.344+0000 7f9fb77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.344+0000 7f9fb77fe640 10 monclient(hunting): my global_id is 4558 2026-02-25T15:13:06.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.344+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fac003610 con 0x7f9fc015e6e0 2026-02-25T15:13:06.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.345+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024409744 0 0) 0x7f65dc163bb0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.345+0000 7f65d9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.345+0000 7f65d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.345+0000 7f65d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.345+0000 7f65d9ffb640 10 monclient(hunting): my global_id is 4561 2026-02-25T15:13:06.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.345+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65c8003610 con 0x7f65dc0b9f80 2026-02-25T15:13:06.354 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 10 librados: watch_flush enter 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 10 librados: watch_flush exit 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 20 client.4572.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 10 client.4572.objecter successfully canceled tick 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 >> v1:10.20.193.78:6800/3497602169 conn(0x7fd04c077d60 legacy=0x7fd04c098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 10 monclient: shutdown 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 >> v1:10.20.193.78:6789/0 conn(0x7fd07c157780 legacy=0x7fd07c1f95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 shutdown_connections 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 >> 10.20.193.78:0/4222500821 conn(0x7fd07c0b2ef0 msgr2=0x7fd07c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 shutdown_connections 2026-02-25T15:13:06.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 1 -- 10.20.193.78:0/4222500821 wait complete. 2026-02-25T15:13:06.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7fd081d73640 1 librados: shutdown 2026-02-25T15:13:06.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379705514 0 0) 0x7f65c4002910 con 0x7f65dc0ba350 2026-02-25T15:13:06.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f65d9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f65d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f65d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f65d9ffb640 10 monclient(hunting): my global_id is 4581 2026-02-25T15:13:06.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65dc163bb0 con 0x7f65dc0ba350 2026-02-25T15:13:06.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086720034 0 0) 0x7f9fc0165370 con 0x7f9fc0059470 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f9fb77fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f9fb77fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f9fb77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f9fb77fe640 10 monclient(hunting): my global_id is 4584 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.346+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fc0055ee0 con 0x7f9fc0059470 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2633737097 0 0) 0x7f9fac003610 con 0x7f9fc015e6e0 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 >> v1:10.20.193.167:6789/0 conn(0x7f9fc0055980 legacy=0x7f9fc0058d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 >> v1:10.20.193.78:6789/0 conn(0x7f9fc0059470 legacy=0x7f9fc01c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 1 monclient: found mon.noname-b 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc00b66e0 con 0x7f9fc015e6e0 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9fb0002df0 con 0x7f9fc015e6e0 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fb77fe640 10 monclient: dump: 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.359 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fc6b2e640 5 monclient: authenticate success, global_id 4558 2026-02-25T15:13:06.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.347+0000 7f9fc6b2e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 217340367 0 0) 0x7f65c8003610 con 0x7f65dc0b9f80 2026-02-25T15:13:06.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 >> v1:10.20.193.167:6789/0 conn(0x7f65dc0585e0 legacy=0x7f65dc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 >> v1:10.20.193.78:6789/0 conn(0x7f65dc0ba350 legacy=0x7f65dc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 1 monclient: found mon.noname-b 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc0573f0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f65d0002df0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65d9ffb640 10 monclient: dump: 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.361 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65e1555640 5 monclient: authenticate success, global_id 4561 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.348+0000 7f65e1555640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fb0003070 con 0x7f9fc015e6e0 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fb77fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fb77fe640 1 -- 10.20.193.78:0/1088659681 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9fb00034b0 con 0x7f9fc015e6e0 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fb77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 4 set_mon_vals no callback set 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fb77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fb77fe640 10 monclient: dump: 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.363 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.364 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.364 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.364 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.364 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-25T15:13:06.365 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-25T15:13:06.365 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-25T15:13:06.365 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65d0003000 con 0x7f65dc0b9f80 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65d9ffb640 1 -- 10.20.193.78:0/3998226788 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f65d0003440 con 0x7f65dc0b9f80 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 4 set_mon_vals no callback set 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65d9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65d9ffb640 10 monclient: dump: 2026-02-25T15:13:06.366 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 10 monclient: shutdown 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 1 -- 10.20.193.78:0/3998226788 >> v1:10.20.193.155:6789/0 conn(0x7f65dc0b9f80 legacy=0x7f65dc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 1 -- 10.20.193.78:0/3998226788 shutdown_connections 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 1 -- 10.20.193.78:0/3998226788 >> 10.20.193.78:0/3998226788 conn(0x7f65dc0b7990 msgr2=0x7f65dc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 1 -- 10.20.193.78:0/3998226788 shutdown_connections 2026-02-25T15:13:06.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 1 -- 10.20.193.78:0/3998226788 wait complete. 2026-02-25T15:13:06.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 10 monclient: shutdown 2026-02-25T15:13:06.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1088659681 >> v1:10.20.193.155:6789/0 conn(0x7f9fc015e6e0 legacy=0x7f9fc00b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1088659681 shutdown_connections 2026-02-25T15:13:06.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1088659681 >> 10.20.193.78:0/1088659681 conn(0x7f9fc00b4120 msgr2=0x7f9fc00b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1088659681 shutdown_connections 2026-02-25T15:13:06.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1088659681 wait complete. 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 10 monclient: monmap: 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.369 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 1 librados: starting msgr at 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.350+0000 7f65e1555640 1 librados: starting objecter 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 1 Processor -- start 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 1 -- start start 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 1 librados: setting wanted keys 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 1 librados: calling monclient init 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 10 monclient: init 2026-02-25T15:13:06.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 10 monclient: monmap: 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 1 librados: starting msgr at 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 1 librados: starting objecter 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 1 Processor -- start 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 10 monclient(hunting): picked mon.noname-b con 0x7f65dc0585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 10 monclient(hunting): picked mon.noname-a con 0x7f65dc0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 10 monclient(hunting): picked mon.noname-c con 0x7f65dc0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc1622f0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc1625b0 con 0x7f65dc0585e0 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc162890 con 0x7f65dc0ba350 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65e1555640 10 monclient(hunting): authenticate will time out at 3355.940579s 2026-02-25T15:13:06.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 1 -- start start 2026-02-25T15:13:06.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 1 librados: setting wanted keys 2026-02-25T15:13:06.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 1 librados: calling monclient init 2026-02-25T15:13:06.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f9fc6b2e640 10 monclient: init 2026-02-25T15:13:06.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65da7fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f65dc0b9f80 0x7f65dc1656b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37504/0 (socket says 10.20.193.78:37504) 2026-02-25T15:13:06.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.351+0000 7f65da7fc640 1 -- 10.20.193.78:0/274776714 learned_addr learned my addr 10.20.193.78:0/274776714 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f65bb7fe640 10 client.?.objecter ms_handle_connect 0x7f65dc0b9f80 2026-02-25T15:13:06.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f65bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 10 monclient(hunting): picked mon.noname-b con 0x7f9fc0055980 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 10 monclient(hunting): picked mon.noname-a con 0x7f9fc0059470 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 10 monclient(hunting): picked mon.noname-c con 0x7f9fc015e6e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc015a1a0 con 0x7f9fc0059470 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc013f8a0 con 0x7f9fc0055980 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc01fcc80 con 0x7f9fc015e6e0 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc6b2e640 10 monclient(hunting): authenticate will time out at 3355.941155s 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f65bb7fe640 10 client.?.objecter ms_handle_connect 0x7f65dc0585e0 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f65bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc48a3640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f9fc0055980 0x7f9fc01fc470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58320/0 (socket says 10.20.193.78:58320) 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.352+0000 7f9fc48a3640 1 -- 10.20.193.78:0/1050366821 learned_addr learned my addr 10.20.193.78:0/1050366821 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369749144 0 0) 0x7f65dc1622f0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f65bb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f65bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f65bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f65bb7fe640 10 monclient(hunting): my global_id is 4587 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a8003610 con 0x7f65dc0b9f80 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f9fb57fa640 10 client.?.objecter ms_handle_connect 0x7f9fc0055980 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f9fb57fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f9fb57fa640 10 client.?.objecter ms_handle_connect 0x7f9fc0059470 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.353+0000 7f9fb57fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2737090764 0 0) 0x7f65dc1625b0 con 0x7f65dc0585e0 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f65bb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f65bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f65bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f65bb7fe640 10 monclient(hunting): my global_id is 4564 2026-02-25T15:13:06.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65dc1622f0 con 0x7f65dc0585e0 2026-02-25T15:13:06.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 110045104 0 0) 0x7f9fc013f8a0 con 0x7f9fc0055980 2026-02-25T15:13:06.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f9fb57fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f9fb57fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f9fb57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f9fb57fa640 10 monclient(hunting): my global_id is 4567 2026-02-25T15:13:06.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.354+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f90003610 con 0x7f9fc0055980 2026-02-25T15:13:06.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.2 2026-02-25T15:13:06.378 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.356+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4040173372 0 0) 0x7f65a8003610 con 0x7f65dc0b9f80 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.356+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65dc1625b0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.356+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f65c40031e0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.356+0000 7f65bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.356+0000 7f65bb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.356+0000 7f65bb7fe640 10 monclient(hunting): dump: 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.378 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.356+0000 7f65bb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.357+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565211677 0 0) 0x7f9fc015a1a0 con 0x7f9fc0059470 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.357+0000 7f9fb57fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.357+0000 7f9fb57fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.357+0000 7f9fb57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.357+0000 7f9fb57fa640 10 monclient(hunting): my global_id is 4590 2026-02-25T15:13:06.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.357+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fc013f8a0 con 0x7f9fc0059470 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2117216681 0 0) 0x7f65dc1625b0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 >> v1:10.20.193.167:6789/0 conn(0x7f65dc0ba350 legacy=0x7f65dc1fb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 >> v1:10.20.193.155:6789/0 conn(0x7f65dc0585e0 legacy=0x7f65dc1fc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 1 monclient: found mon.a 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc162b70 con 0x7f65dc0b9f80 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 5 monclient: authenticate success, global_id 4587 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 10 monclient: _renew_subs 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f65dc162e50 con 0x7f65dc0b9f80 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 10 client.4587.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 10 monclient: _renew_subs 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f65dc163650 con 0x7f65dc0b9f80 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.358+0000 7f65e1555640 1 librados: init done 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 36962014 0 0) 0x7f9f90003610 con 0x7f9fc0055980 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fc015a1a0 con 0x7f9fc0055980 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9fb0002d00 con 0x7f9fc0055980 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f9fb57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f9fb57fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f9fb57fa640 10 monclient(hunting): dump: 2026-02-25T15:13:06.381 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f9fb57fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f65e1555640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f65e1555640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f65e1555640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.359+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65dc0b64c0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.361+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 459662159 0 0) 0x7f9fc013f8a0 con 0x7f9fc0059470 2026-02-25T15:13:06.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.361+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f90003610 con 0x7f9fc0059470 2026-02-25T15:13:06.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.361+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9fa8003ef0 con 0x7f9fc0059470 2026-02-25T15:13:06.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.361+0000 7f9fb57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.361+0000 7f9fb57fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.361+0000 7f9fb57fa640 10 monclient(hunting): dump: 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1755546009 0 0) 0x7f9fc015a1a0 con 0x7f9fc0055980 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 >> v1:10.20.193.167:6789/0 conn(0x7f9fc015e6e0 legacy=0x7f9fc00ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 >> v1:10.20.193.78:6789/0 conn(0x7f9fc0059470 legacy=0x7f9fc013f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 1 monclient: found mon.b 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc01fcf60 con 0x7f9fc0055980 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fb57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 5 monclient: authenticate success, global_id 4567 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 10 monclient: _renew_subs 2026-02-25T15:13:06.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc01f8f90 con 0x7f9fc0055980 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 10 client.4567.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 10 monclient: _renew_subs 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9fc01fd240 con 0x7f9fc0055980 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 1 librados: init done 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.362+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc0052db0 con 0x7f9fc0055980 2026-02-25T15:13:06.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.407+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7d0405cc10 con 0x7f7d180b4c30 2026-02-25T15:13:06.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.407+0000 7f7cf3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.407+0000 7f7cf3fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.424+0000 7f2cfb5b1640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.424+0000 7f2cfb5b1640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.424+0000 7f2cfb5b1640 10 monclient: monmap: 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.425738+0000 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.425738+0000 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.427 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 1 Processor -- start 2026-02-25T15:13:06.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 1 -- start start 2026-02-25T15:13:06.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 10 monclient: init 2026-02-25T15:13:06.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:06.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 10 monclient(hunting): picked mon.noname-c con 0x7f2cf415d070 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 10 monclient(hunting): picked mon.noname-a con 0x7f2cf415d440 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 10 monclient(hunting): picked mon.noname-b con 0x7f2cf4166f60 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf4164e60 con 0x7f2cf415d440 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf40b1790 con 0x7f2cf4166f60 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf40b1a70 con 0x7f2cf415d070 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.425+0000 7f2cfb5b1640 10 monclient(hunting): authenticate will time out at 3356.014967s 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.426+0000 7f2cf9326640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f2cf415d070 0x7f2cf4164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51158/0 (socket says 10.20.193.78:51158) 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.426+0000 7f2cf9326640 1 -- 10.20.193.78:0/374298822 learned_addr learned my addr 10.20.193.78:0/374298822 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.427+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244011837 0 0) 0x7f2cf40b1a70 con 0x7f2cf415d070 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.427+0000 7f2ce3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.427+0000 7f2ce3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.427+0000 7f2ce3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.427+0000 7f2ce3fff640 10 monclient(hunting): my global_id is 4526 2026-02-25T15:13:06.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.427+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cdc003610 con 0x7f2cf415d070 2026-02-25T15:13:06.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1532027722 0 0) 0x7f2cdc003610 con 0x7f2cf415d070 2026-02-25T15:13:06.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 >> v1:10.20.193.155:6789/0 conn(0x7f2cf4166f60 legacy=0x7f2cf40b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 >> v1:10.20.193.78:6789/0 conn(0x7f2cf415d440 legacy=0x7f2cf4166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 1 monclient: found mon.noname-c 2026-02-25T15:13:06.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf40b1d50 con 0x7f2cf415d070 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2ce4002df0 con 0x7f2cf415d070 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2ce3fff640 10 monclient: dump: 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2cfb5b1640 5 monclient: authenticate success, global_id 4526 2026-02-25T15:13:06.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.429+0000 7f2cfb5b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ce4003000 con 0x7f2cf415d070 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2ce3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2ce3fff640 1 -- 10.20.193.78:0/374298822 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2ce4003440 con 0x7f2cf415d070 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2ce3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2ce3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2ce3fff640 10 monclient: dump: 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.434 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 4 set_mon_vals no callback set 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 10 monclient: shutdown 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/374298822 >> v1:10.20.193.167:6789/0 conn(0x7f2cf415d070 legacy=0x7f2cf4164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/374298822 shutdown_connections 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/374298822 >> 10.20.193.78:0/374298822 conn(0x7f2cf40b2ef0 msgr2=0x7f2cf40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/374298822 shutdown_connections 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.430+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/374298822 wait complete. 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 10 monclient: monmap: 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.435 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 1 librados: starting msgr at 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 1 librados: starting objecter 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 1 Processor -- start 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 1 -- start start 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 1 librados: setting wanted keys 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 1 librados: calling monclient init 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.431+0000 7f2cfb5b1640 10 monclient: init 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 10 monclient(hunting): picked mon.noname-b con 0x7f2cf415d070 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 10 monclient(hunting): picked mon.noname-a con 0x7f2cf415d440 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 10 monclient(hunting): picked mon.noname-c con 0x7f2cf4166f60 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf40ab8d0 con 0x7f2cf415d440 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf40abbb0 con 0x7f2cf415d070 2026-02-25T15:13:06.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf40abe90 con 0x7f2cf4166f60 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cfb5b1640 10 monclient(hunting): authenticate will time out at 3356.021246s 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cf9b27640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f2cf4166f60 0x7f2cf41fb250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51162/0 (socket says 10.20.193.78:51162) 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.432+0000 7f2cf9b27640 1 -- 10.20.193.78:0/3185407051 learned_addr learned my addr 10.20.193.78:0/3185407051 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.433+0000 7f2ce1ffb640 10 client.?.objecter ms_handle_connect 0x7f2cf4166f60 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.433+0000 7f2ce1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.434+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664175919 0 0) 0x7f2cf40abe90 con 0x7f2cf4166f60 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.434+0000 7f2ce1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.434+0000 7f2ce1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.434+0000 7f2ce1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.434+0000 7f2ce1ffb640 10 monclient(hunting): my global_id is 4529 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.434+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cc4003610 con 0x7f2cf4166f60 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.436+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3592142712 0 0) 0x7f2cc4003610 con 0x7f2cf4166f60 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.436+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cf40abe90 con 0x7f2cf4166f60 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.436+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2cf00032d0 con 0x7f2cf4166f60 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.436+0000 7f2ce1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.436+0000 7f2ce1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.436+0000 7f2ce1ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.438 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.439 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.439 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.439 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.439 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.439 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.439 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.436+0000 7f2ce1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 619368038 0 0) 0x7f2cf40abe90 con 0x7f2cf4166f60 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 >> v1:10.20.193.155:6789/0 conn(0x7f2cf415d070 legacy=0x7f2cf40acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 >> v1:10.20.193.78:6789/0 conn(0x7f2cf415d440 legacy=0x7f2cf4058bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 1 monclient: found mon.c 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf40ac170 con 0x7f2cf4166f60 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2ce1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 5 monclient: authenticate success, global_id 4529 2026-02-25T15:13:06.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 10 monclient: _renew_subs 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf40ac450 con 0x7f2cf4166f60 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 10 client.4529.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 10 monclient: _renew_subs 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2cf41fc260 con 0x7f2cf4166f60 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 1 librados: init done 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.438+0000 7f2cfb5b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.439+0000 7f2cfb5b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.439+0000 7f2cfb5b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.439+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf4055d20 con 0x7f2cf4166f60 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.444+0000 7f4174513640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.444+0000 7f4174513640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.444+0000 7f4174513640 10 monclient: monmap: 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.445448+0000 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.445448+0000 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.446 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 1 Processor -- start 2026-02-25T15:13:06.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 1 -- start start 2026-02-25T15:13:06.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 10 monclient: init 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 10 monclient(hunting): picked mon.noname-c con 0x7f416c157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 10 monclient(hunting): picked mon.noname-b con 0x7f416c157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 10 monclient(hunting): picked mon.noname-a con 0x7f416c164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c05de70 con 0x7f416c164d00 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c055b20 con 0x7f416c157b50 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c055e00 con 0x7f416c157780 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.445+0000 7f4174513640 10 monclient(hunting): authenticate will time out at 3356.034643s 2026-02-25T15:13:06.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.446+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cf0003950 con 0x7f2cf4166f60 2026-02-25T15:13:06.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.446+0000 7f2ce1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.446+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2cf0004f10 con 0x7f2cf4166f60 2026-02-25T15:13:06.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.446+0000 7f2ce1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.446+0000 7f2ce1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:06.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.446+0000 7f2ce1ffb640 10 monclient: dump: 2026-02-25T15:13:06.449 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.449 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.446+0000 7f2ce37fe640 4 set_mon_vals no callback set 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.447+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f2cf001dd80 con 0x7f2cf4166f60 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.447+0000 7f2cf9326640 10 monclient: get_auth_request con 0x7f2cc4077bf0 auth_method 0 2026-02-25T15:13:06.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.447+0000 7f2ce1ffb640 10 client.4529.objecter ms_handle_connect 0x7f2cc4077bf0 2026-02-25T15:13:06.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.448+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f2cf0093740 con 0x7f2cf4166f60 2026-02-25T15:13:06.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.448+0000 7f2ce1ffb640 10 client.4529.objecter ms_dispatch2 0x7f2cf4000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.448+0000 7f2ce1ffb640 3 client.4529.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.448+0000 7f2ce1ffb640 3 client.4529.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.448+0000 7f2ce1ffb640 20 client.4529.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.448+0000 7f4172288640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f416c157780 0x7f416c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51166/0 (socket says 10.20.193.78:51166) 2026-02-25T15:13:06.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.448+0000 7f4172288640 1 -- 10.20.193.78:0/454848547 learned_addr learned my addr 10.20.193.78:0/454848547 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.453+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fb00028e0 con 0x7f9fc0055980 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.453+0000 7f9fb57fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.453+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9fb0004ce0 con 0x7f9fc0055980 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.453+0000 7f9fb57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.453+0000 7f9fb57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.453+0000 7f9fb6ffd640 4 set_mon_vals no callback set 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.453+0000 7f9fb57fa640 10 monclient: dump: 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.455 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.456 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.456 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.456 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.456 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.456 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.454+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f9fb001db50 con 0x7f9fc0055980 2026-02-25T15:13:06.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.454+0000 7f9fb7fff640 10 monclient: get_auth_request con 0x7f9f90077c20 auth_method 0 2026-02-25T15:13:06.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.454+0000 7f9fb57fa640 10 client.4567.objecter ms_handle_connect 0x7f9f90077c20 2026-02-25T15:13:06.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.455+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f9fb0093300 con 0x7f9fc0055980 2026-02-25T15:13:06.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.455+0000 7f9fb57fa640 10 client.4567.objecter ms_dispatch2 0x7f9fc0000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.455+0000 7f9fb57fa640 3 client.4567.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.455+0000 7f9fb57fa640 3 client.4567.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.455+0000 7f9fb57fa640 20 client.4567.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.457+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9fc0052db0 con 0x7f9fc0055980 2026-02-25T15:13:06.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.457+0000 7f9fb57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.457+0000 7f9fb57fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.459+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952419224 0 0) 0x7f416c055b20 con 0x7f416c157b50 2026-02-25T15:13:06.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.459+0000 7f4171286640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.459+0000 7f4171286640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.459+0000 7f4171286640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.459+0000 7f4171286640 10 monclient(hunting): my global_id is 4570 2026-02-25T15:13:06.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.459+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4154003610 con 0x7f416c157b50 2026-02-25T15:13:06.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3731899303 0 0) 0x7f4154003610 con 0x7f416c157b50 2026-02-25T15:13:06.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 >> v1:10.20.193.167:6789/0 conn(0x7f416c157780 legacy=0x7f416c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 >> v1:10.20.193.78:6789/0 conn(0x7f416c164d00 legacy=0x7f416c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 1 monclient: found mon.noname-b 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c0560e0 con 0x7f416c157b50 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4160002df0 con 0x7f416c157b50 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4171286640 10 monclient: dump: 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.464 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.465 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.465 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.465 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.465 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.465 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4174513640 5 monclient: authenticate success, global_id 4570 2026-02-25T15:13:06.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.461+0000 7f4174513640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65c4003490 con 0x7f65dc0b9f80 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f65bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f65c4003b90 con 0x7f65dc0b9f80 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f65bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f65bb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f65bb7fe640 10 monclient: dump: 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.466 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f65d97fa640 4 set_mon_vals no callback set 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4160003000 con 0x7f416c157b50 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4171286640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4171286640 1 -- 10.20.193.78:0/454848547 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4160003440 con 0x7f416c157b50 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 4 set_mon_vals no callback set 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4171286640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4171286640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4171286640 10 monclient: dump: 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.468 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f65c4003d70 con 0x7f65dc0b9f80 2026-02-25T15:13:06.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 10 monclient: shutdown 2026-02-25T15:13:06.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 1 -- 10.20.193.78:0/454848547 >> v1:10.20.193.155:6789/0 conn(0x7f416c157b50 legacy=0x7f416c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 1 -- 10.20.193.78:0/454848547 shutdown_connections 2026-02-25T15:13:06.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 1 -- 10.20.193.78:0/454848547 >> 10.20.193.78:0/454848547 conn(0x7f416c0b2ef0 msgr2=0x7f416c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 1 -- 10.20.193.78:0/454848547 shutdown_connections 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.462+0000 7f4174513640 1 -- 10.20.193.78:0/454848547 wait complete. 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f65daffd640 10 monclient: get_auth_request con 0x7f65a8077cd0 auth_method 0 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient: monmap: 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.470 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.471 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.471 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.471 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.471 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.471 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f65bb7fe640 10 client.4587.objecter ms_handle_connect 0x7f65a8077cd0 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 librados: starting msgr at 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 librados: starting objecter 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 Processor -- start 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 -- start start 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 librados: setting wanted keys 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 librados: calling monclient init 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient: init 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient(hunting): picked mon.noname-a con 0x7f416c157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient(hunting): picked mon.noname-c con 0x7f416c157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient(hunting): picked mon.noname-b con 0x7f416c164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c145d10 con 0x7f416c157780 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c145ff0 con 0x7f416c164d00 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c1462d0 con 0x7f416c157b50 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.463+0000 7f4174513640 10 monclient(hunting): authenticate will time out at 3356.052978s 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.464+0000 7f4172a89640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f416c164d00 0x7f416c0ad8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58356/0 (socket says 10.20.193.78:58356) 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.464+0000 7f4172a89640 1 -- 10.20.193.78:0/101069081 learned_addr learned my addr 10.20.193.78:0/101069081 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.464+0000 7f4152ffd640 10 client.?.objecter ms_handle_connect 0x7f416c164d00 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.464+0000 7f4152ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.465+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102649066 0 0) 0x7f416c145ff0 con 0x7f416c164d00 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.465+0000 7f4152ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.465+0000 7f4152ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.465+0000 7f4152ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.465+0000 7f4152ffd640 10 monclient(hunting): my global_id is 4573 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.465+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f413c003610 con 0x7f416c164d00 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.467+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1738803713 0 0) 0x7f413c003610 con 0x7f416c164d00 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.467+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f416c145ff0 con 0x7f416c164d00 2026-02-25T15:13:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.467+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4168003230 con 0x7f416c164d00 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.467+0000 7f4152ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.467+0000 7f4152ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.467+0000 7f4152ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.467+0000 7f4152ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.468+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f65c40933e0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.468+0000 7f65bb7fe640 10 client.4587.objecter ms_dispatch2 0x7f65dc000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.468+0000 7f65bb7fe640 3 client.4587.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.468+0000 7f65bb7fe640 3 client.4587.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.468+0000 7f65bb7fe640 20 client.4587.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.468+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f65dc163930 con 0x7f65dc0b9f80 2026-02-25T15:13:06.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.468+0000 7f65bb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.468+0000 7f65bb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1775808415 0 0) 0x7f416c145ff0 con 0x7f416c164d00 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 >> v1:10.20.193.167:6789/0 conn(0x7f416c157b50 legacy=0x7f416c137b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 >> v1:10.20.193.78:6789/0 conn(0x7f416c157780 legacy=0x7f416c139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 1 monclient: found mon.b 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c1465b0 con 0x7f416c164d00 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4152ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 5 monclient: authenticate success, global_id 4573 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 10 monclient: _renew_subs 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f416c156e50 con 0x7f416c164d00 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 10 client.4573.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 10 monclient: _renew_subs 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f416c138440 con 0x7f416c164d00 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.469+0000 7f4174513640 1 librados: init done 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.470+0000 7f4174513640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.470+0000 7f4174513640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.470+0000 7f4174513640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.470+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c0b4f80 con 0x7f416c164d00 2026-02-25T15:13:06.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.476+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41680038b0 con 0x7f416c164d00 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.476+0000 7f4152ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.476+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4168004e70 con 0x7f416c164d00 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f4152ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f4170a85640 4 set_mon_vals no callback set 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f4152ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f4152ffd640 10 monclient: dump: 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.479 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f96e9a74640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f96e9a74640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f96e9a74640 10 monclient: monmap: 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.478036+0000 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.478036+0000 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7fa31ed33640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7fa31ed33640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7fa31ed33640 10 monclient: monmap: 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.478351+0000 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.478351+0000 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7fe719ffa640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7fe719ffa640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7fe719ffa640 10 monclient: monmap: 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.478366+0000 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.478366+0000 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f96e9a74640 1 Processor -- start 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f822b255640 10 monclient: get_monmap_and_config 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f822b255640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f822b255640 10 monclient: monmap: 2026-02-25T15:13:06.482 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:06.478472+0000 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:06.478472+0000 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f96e9a74640 1 -- start start 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f96e9a74640 10 monclient: init 2026-02-25T15:13:06.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.477+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f416801dce0 con 0x7f416c164d00 2026-02-25T15:13:06.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 1 Processor -- start 2026-02-25T15:13:06.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 1 Processor -- start 2026-02-25T15:13:06.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 1 -- start start 2026-02-25T15:13:06.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 10 monclient: init 2026-02-25T15:13:06.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 1 Processor -- start 2026-02-25T15:13:06.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 1 -- start start 2026-02-25T15:13:06.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 10 monclient: init 2026-02-25T15:13:06.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 1 -- start start 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 10 monclient: init 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 10 monclient(hunting): picked mon.noname-b con 0x7f96e41566e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 10 monclient(hunting): picked mon.noname-a con 0x7f96e4160c00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 10 monclient(hunting): picked mon.noname-c con 0x7f96e4156ab0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e4058480 con 0x7f96e4160c00 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e4058760 con 0x7f96e41566e0 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e40b0f90 con 0x7f96e4156ab0 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e9a74640 10 monclient(hunting): authenticate will time out at 3356.067270s 2026-02-25T15:13:06.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f4172288640 10 monclient: get_auth_request con 0x7f413c077c80 auth_method 0 2026-02-25T15:13:06.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f4152ffd640 10 client.4573.objecter ms_handle_connect 0x7f413c077c80 2026-02-25T15:13:06.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:06.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e27fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f96e4160c00 0x7f96e4057920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37546/0 (socket says 10.20.193.78:37546) 2026-02-25T15:13:06.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f96e27fc640 1 -- 10.20.193.78:0/15000905 learned_addr learned my addr 10.20.193.78:0/15000905 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 10 monclient(hunting): picked mon.noname-a con 0x7fe714157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 10 monclient(hunting): picked mon.noname-b con 0x7fe714157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 10 monclient(hunting): picked mon.noname-c con 0x7fe714164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71405de70 con 0x7fe714157780 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe714055b20 con 0x7fe714157b50 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe714055e00 con 0x7fe714164d00 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fe719ffa640 10 monclient(hunting): authenticate will time out at 3356.067640s 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:06.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:06.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 10 monclient(hunting): picked mon.noname-b con 0x7fa3180b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 10 monclient(hunting): picked mon.noname-c con 0x7fa3180ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 10 monclient(hunting): picked mon.noname-b con 0x7f82240b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 10 monclient(hunting): picked mon.noname-c con 0x7f82240ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 10 monclient(hunting): picked mon.noname-a con 0x7f82240585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 10 monclient(hunting): picked mon.noname-a con 0x7fa3180585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa318163930 con 0x7fa3180585e0 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa318163bb0 con 0x7fa3180b9f80 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa318163e90 con 0x7fa3180ba350 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8224163930 con 0x7f82240585e0 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8224163bb0 con 0x7f82240b9f80 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8224163e90 con 0x7f82240ba350 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f822b255640 10 monclient(hunting): authenticate will time out at 3356.067779s 2026-02-25T15:13:06.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7fa31ed33640 10 monclient(hunting): authenticate will time out at 3356.067769s 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f41680936b0 con 0x7f416c164d00 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f4152ffd640 10 client.4573.objecter ms_dispatch2 0x7f416c000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f4152ffd640 3 client.4573.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.478+0000 7f4152ffd640 3 client.4573.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.479+0000 7f4152ffd640 20 client.4573.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.480+0000 7fe7137fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe714157780 0x7fe714056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37558/0 (socket says 10.20.193.78:37558) 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.480+0000 7fe7137fe640 1 -- 10.20.193.78:0/2860731649 learned_addr learned my addr 10.20.193.78:0/2860731649 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.480+0000 7fa31d2a9640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa3180585e0 0x7fa318166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37566/0 (socket says 10.20.193.78:37566) 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.480+0000 7fa31d2a9640 1 -- 10.20.193.78:0/2408673193 learned_addr learned my addr 10.20.193.78:0/2408673193 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.480+0000 7f82297cb640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f82240585e0 0x7f8224166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37580/0 (socket says 10.20.193.78:37580) 2026-02-25T15:13:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.480+0000 7f82297cb640 1 -- 10.20.193.78:0/1383838278 learned_addr learned my addr 10.20.193.78:0/1383838278 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328185509 0 0) 0x7fa314002c90 con 0x7fa3180585e0 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fa30f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fa30f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fa30f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fa30f7fe640 10 monclient(hunting): my global_id is 4596 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa304003610 con 0x7fa3180585e0 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636213300 0 0) 0x7fe71405de70 con 0x7fe714157780 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fe7127fc640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fe7127fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fe7127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fe7127fc640 10 monclient(hunting): my global_id is 4599 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6f8003610 con 0x7fe714157780 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694374519 0 0) 0x7f96e4058480 con 0x7f96e4160c00 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7f96e1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7f96e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7f96e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7f96e1ffb640 10 monclient(hunting): my global_id is 4593 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.483+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96d0003610 con 0x7f96e4160c00 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.484+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3638770160 0 0) 0x7f8220002c90 con 0x7f82240585e0 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.484+0000 7f821b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.484+0000 7f821b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.484+0000 7f821b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.484+0000 7f821b7fe640 10 monclient(hunting): my global_id is 4602 2026-02-25T15:13:06.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.484+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8204003610 con 0x7f82240585e0 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 472205720 0 0) 0x7fa304003610 con 0x7fa3180585e0 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 >> v1:10.20.193.167:6789/0 conn(0x7fa3180ba350 legacy=0x7fa318057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 >> v1:10.20.193.155:6789/0 conn(0x7fa3180b9f80 legacy=0x7fa318163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 1 monclient: found mon.noname-a 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3180573f0 con 0x7fa3180585e0 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa314003340 con 0x7fa3180585e0 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa30f7fe640 10 monclient: dump: 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.493 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa31ed33640 5 monclient: authenticate success, global_id 4596 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fa31ed33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2389074327 0 0) 0x7f96d0003610 con 0x7f96e4160c00 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 >> v1:10.20.193.167:6789/0 conn(0x7f96e4156ab0 legacy=0x7f96e4055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 >> v1:10.20.193.155:6789/0 conn(0x7f96e41566e0 legacy=0x7f96e40b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 1 monclient: found mon.noname-a 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e40b1270 con 0x7f96e4160c00 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f96cc002df0 con 0x7f96e4160c00 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e1ffb640 10 monclient: dump: 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e9a74640 5 monclient: authenticate success, global_id 4593 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f96e9a74640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 211960334 0 0) 0x7fe6f8003610 con 0x7fe714157780 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 >> v1:10.20.193.167:6789/0 conn(0x7fe714164d00 legacy=0x7fe7141c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 >> v1:10.20.193.155:6789/0 conn(0x7fe714157b50 legacy=0x7fe7141645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 1 monclient: found mon.noname-a 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7140560e0 con 0x7fe714157780 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe700002df0 con 0x7fe714157780 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe719ffa640 5 monclient: authenticate success, global_id 4599 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe719ffa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe7127fc640 10 monclient: dump: 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7fe719ffa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3670579828 0 0) 0x7f8204003610 con 0x7f82240585e0 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 >> v1:10.20.193.167:6789/0 conn(0x7f82240ba350 legacy=0x7f8224057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 >> v1:10.20.193.155:6789/0 conn(0x7f82240b9f80 legacy=0x7f8224163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f821b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.491+0000 7f821b7fe640 1 monclient: found mon.noname-a 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82240573f0 con 0x7f82240585e0 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8220003340 con 0x7f82240585e0 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f822b255640 5 monclient: authenticate success, global_id 4602 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f822b255640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f821b7fe640 10 monclient: dump: 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.497 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.498 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.498 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.498 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.498 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.498 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.498 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.498 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.492+0000 7f822b255640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa314003550 con 0x7fa3180585e0 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa30f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa30f7fe640 1 -- 10.20.193.78:0/2408673193 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa314004d10 con 0x7fa3180585e0 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa30f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa30f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa30f7fe640 10 monclient: dump: 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 4 set_mon_vals no callback set 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 10 monclient: shutdown 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 1 -- 10.20.193.78:0/2408673193 >> v1:10.20.193.78:6789/0 conn(0x7fa3180585e0 legacy=0x7fa318166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 1 -- 10.20.193.78:0/2408673193 shutdown_connections 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 1 -- 10.20.193.78:0/2408673193 >> 10.20.193.78:0/2408673193 conn(0x7fa3180b7990 msgr2=0x7fa3180b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 1 -- 10.20.193.78:0/2408673193 shutdown_connections 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.493+0000 7fa31ed33640 1 -- 10.20.193.78:0/2408673193 wait complete. 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 10 monclient: monmap: 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 1 librados: starting msgr at 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 1 librados: starting objecter 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 1 Processor -- start 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 1 -- start start 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 1 librados: setting wanted keys 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 1 librados: calling monclient init 2026-02-25T15:13:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 10 monclient: init 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe700003000 con 0x7fe714157780 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe7127fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe719ffa640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe719ffa640 4 set_mon_vals no callback set 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96cc003000 con 0x7f96e4160c00 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7f96e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7f96e1ffb640 1 -- 10.20.193.78:0/15000905 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f96cc003440 con 0x7f96e4160c00 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7f96e9a74640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7f96e9a74640 4 set_mon_vals no callback set 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7f96e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7f96e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7f96e1ffb640 10 monclient: dump: 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.501 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe719ffa640 10 monclient: shutdown 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe719ffa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe719ffa640 1 -- 10.20.193.78:0/2860731649 >> v1:10.20.193.78:6789/0 conn(0x7fe714157780 legacy=0x7fe714056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe7127fc640 1 -- 10.20.193.78:0/2860731649 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe700003440 con 0x7fe714157780 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 10 monclient(hunting): picked mon.noname-b con 0x7fa3180585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fa31ed33640 10 monclient(hunting): picked mon.noname-c con 0x7fa3180b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.494+0000 7fe7127fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fa31ed33640 10 monclient(hunting): picked mon.noname-a con 0x7fa3180ba350 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fa31ed33640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa318155880 con 0x7fa3180ba350 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fa31ed33640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3181fd090 con 0x7fa3180585e0 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fa31ed33640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3181fd370 con 0x7fa3180b9f80 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fa31ed33640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fa31ed33640 10 monclient(hunting): authenticate will time out at 3356.084052s 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fe719ffa640 1 -- 10.20.193.78:0/2860731649 shutdown_connections 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fe719ffa640 1 -- 10.20.193.78:0/2860731649 >> 10.20.193.78:0/2860731649 conn(0x7fe7140b2ef0 msgr2=0x7fe7140b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fe719ffa640 1 -- 10.20.193.78:0/2860731649 shutdown_connections 2026-02-25T15:13:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fe719ffa640 1 -- 10.20.193.78:0/2860731649 wait complete. 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f96e9a74640 10 monclient: shutdown 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f96e9a74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f96e9a74640 1 -- 10.20.193.78:0/15000905 >> v1:10.20.193.78:6789/0 conn(0x7f96e4160c00 legacy=0x7f96e4057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8220003550 con 0x7f82240585e0 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f821b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f821b7fe640 1 -- 10.20.193.78:0/1383838278 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8220004d10 con 0x7f82240585e0 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f821b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f821b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f821b7fe640 10 monclient: dump: 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.504 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 4 set_mon_vals no callback set 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 10 monclient: shutdown 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 1 -- 10.20.193.78:0/1383838278 >> v1:10.20.193.78:6789/0 conn(0x7f82240585e0 legacy=0x7f8224166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 1 -- 10.20.193.78:0/1383838278 shutdown_connections 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 1 -- 10.20.193.78:0/1383838278 >> 10.20.193.78:0/1383838278 conn(0x7f82240b7990 msgr2=0x7f82240b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 1 -- 10.20.193.78:0/1383838278 shutdown_connections 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7f822b255640 1 -- 10.20.193.78:0/1383838278 wait complete. 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fe719ffa640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.495+0000 7fe719ffa640 10 monclient: monmap: 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.505 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 librados: starting msgr at 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 librados: starting objecter 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 -- 10.20.193.78:0/15000905 shutdown_connections 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 -- 10.20.193.78:0/15000905 >> 10.20.193.78:0/15000905 conn(0x7f96e40b2ef0 msgr2=0x7f96e40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient: monmap: 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.506 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 -- 10.20.193.78:0/15000905 shutdown_connections 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 -- 10.20.193.78:0/15000905 wait complete. 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 Processor -- start 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 -- start start 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 librados: setting wanted keys 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 librados: calling monclient init 2026-02-25T15:13:06.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 10 monclient: init 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 librados: starting msgr at 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 librados: starting objecter 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 Processor -- start 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 -- start start 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 librados: setting wanted keys 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 librados: calling monclient init 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient: init 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 10 monclient(hunting): picked mon.noname-b con 0x7fe714157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 10 monclient(hunting): picked mon.noname-c con 0x7fe714157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 10 monclient(hunting): picked mon.noname-a con 0x7fe714164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe714149a10 con 0x7fe714164d00 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71413b700 con 0x7fe714157780 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71405b950 con 0x7fe714157b50 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 10 monclient: build_initial_monmap 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7fe719ffa640 10 monclient(hunting): authenticate will time out at 3356.085603s 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 10 monclient: monmap: 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:06.509 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient(hunting): picked mon.noname-a con 0x7f82240585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient(hunting): picked mon.noname-b con 0x7f82240b9f80 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient(hunting): picked mon.noname-c con 0x7f82240ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8224155880 con 0x7f82240585e0 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82241fd090 con 0x7f82240b9f80 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 librados: starting msgr at 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 librados: starting objecter 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82241fd370 con 0x7f82240ba350 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f822b255640 10 monclient(hunting): authenticate will time out at 3356.085824s 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 Processor -- start 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 -- start start 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 librados: setting wanted keys 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 1 librados: calling monclient init 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.496+0000 7f96e9a74640 10 monclient: init 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 10 monclient(hunting): picked mon.noname-b con 0x7f96e41566e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 10 monclient(hunting): picked mon.noname-a con 0x7f96e4156ab0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 10 monclient(hunting): picked mon.noname-c con 0x7f96e4160c00 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e40a6cd0 con 0x7f96e4156ab0 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e40ac2d0 con 0x7f96e41566e0 2026-02-25T15:13:06.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e40ac5b0 con 0x7f96e4160c00 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f96e9a74640 10 monclient(hunting): authenticate will time out at 3356.086346s 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7fe713fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe714164d00 0x7fe714138610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37600/0 (socket says 10.20.193.78:37600) 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7fe713fff640 1 -- 10.20.193.78:0/2339377936 learned_addr learned my addr 10.20.193.78:0/2339377936 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f8228fca640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f82240585e0 0x7f82241fb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37602/0 (socket says 10.20.193.78:37602) 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.497+0000 7f8228fca640 1 -- 10.20.193.78:0/145172172 learned_addr learned my addr 10.20.193.78:0/145172172 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.498+0000 7fa31d2a9640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa3180ba350 0x7fa3181f8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37584/0 (socket says 10.20.193.78:37584) 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.498+0000 7fa31d2a9640 1 -- 10.20.193.78:0/1557408019 learned_addr learned my addr 10.20.193.78:0/1557408019 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.498+0000 7fe6effff640 10 client.?.objecter ms_handle_connect 0x7fe714164d00 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.498+0000 7fe6effff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7fa30d7fa640 10 client.?.objecter ms_handle_connect 0x7fa3180ba350 2026-02-25T15:13:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7fa30d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7f82197fa640 10 client.?.objecter ms_handle_connect 0x7f82240585e0 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7f82197fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644754487 0 0) 0x7fe708002b90 con 0x7fe714164d00 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7fe6effff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7fe6effff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7fe6effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7fe6effff640 10 monclient(hunting): my global_id is 4605 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.499+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6e4003610 con 0x7fe714164d00 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.500+0000 7f96e27fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f96e4156ab0 0x7f96e40ab680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37612/0 (socket says 10.20.193.78:37612) 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.500+0000 7f96e27fc640 1 -- 10.20.193.78:0/2457862563 learned_addr learned my addr 10.20.193.78:0/2457862563 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.502+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192950860 0 0) 0x7fa318155880 con 0x7fa3180ba350 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.502+0000 7fa30d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.502+0000 7fa30d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.502+0000 7fa30d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.502+0000 7fa30d7fa640 10 monclient(hunting): my global_id is 4608 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.502+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e8003610 con 0x7fa3180ba350 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.502+0000 7f96bbfff640 10 client.?.objecter ms_handle_connect 0x7f96e4156ab0 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.502+0000 7f96bbfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.507+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3825050257 0 0) 0x7fe6e4003610 con 0x7fe714164d00 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe708002b90 con 0x7fe714164d00 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe708003400 con 0x7fe714164d00 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7fe6effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7fe6effff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7fe6effff640 10 monclient(hunting): dump: 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.514 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7fe6effff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444690582 0 0) 0x7f8224155880 con 0x7f82240585e0 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7f82197fa640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7f82197fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7f82197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7f82197fa640 10 monclient(hunting): my global_id is 4611 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.508+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81f8003610 con 0x7f82240585e0 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4286096602 0 0) 0x7fa2e8003610 con 0x7fa3180ba350 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa318155880 con 0x7fa3180ba350 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa314002c70 con 0x7fa3180ba350 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7fa30d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7fa30d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7fa30d7fa640 10 monclient(hunting): dump: 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.515 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7fa30d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299741038 0 0) 0x7f96e40a6cd0 con 0x7f96e4156ab0 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7f96bbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7f96bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7f96bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7f96bbfff640 10 monclient(hunting): my global_id is 4614 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.509+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96b4003610 con 0x7f96e4156ab0 2026-02-25T15:13:06.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2435527904 0 0) 0x7fe708002b90 con 0x7fe714164d00 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 >> v1:10.20.193.167:6789/0 conn(0x7fe714157b50 legacy=0x7fe7141476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 >> v1:10.20.193.155:6789/0 conn(0x7fe714157780 legacy=0x7fe71413aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 1 monclient: found mon.a 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71405bc30 con 0x7fe714164d00 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe6effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 5 monclient: authenticate success, global_id 4605 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 10 monclient: _renew_subs 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe71405bf10 con 0x7fe714164d00 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 10 client.4605.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 10 monclient: _renew_subs 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe71405c4d0 con 0x7fe714164d00 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.511+0000 7fe719ffa640 1 librados: init done 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.512+0000 7fe719ffa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.512+0000 7fe719ffa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.512+0000 7fe719ffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.512+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe714055b20 con 0x7fe714164d00 2026-02-25T15:13:06.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.523+0000 7f7d1dc6f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:13:06.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.523+0000 7f7d1dc6f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:13:06.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.523+0000 7f7d1dc6f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.523+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7d180b2fe0 con 0x7f7d180b4c30 2026-02-25T15:13:06.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.537+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2cf4055d20 con 0x7f2cf4166f60 2026-02-25T15:13:06.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.537+0000 7f2ce1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.537+0000 7f2ce1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.542+0000 7f82197fa640 10 client.?.objecter ms_handle_connect 0x7f82240ba350 2026-02-25T15:13:06.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.542+0000 7f82197fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.542+0000 7fa30d7fa640 10 client.?.objecter ms_handle_connect 0x7fa3180b9f80 2026-02-25T15:13:06.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.542+0000 7fa30d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.545+0000 7f96bbfff640 10 client.?.objecter ms_handle_connect 0x7f96e4160c00 2026-02-25T15:13:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.545+0000 7f96bbfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.545+0000 7f7cf3fff640 1 -- 10.20.193.78:0/1373114523 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 213165853) 0x7f7d0405c510 con 0x7f7d180b4c30 2026-02-25T15:13:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.545+0000 7f7cf3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:13:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.545+0000 7f7cf3fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.547 INFO:teuthology.orchestra.run.trial078.stdout:94489280517 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 10 librados: watch_flush enter 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 10 librados: watch_flush exit 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 20 client.4523.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 10 client.4523.objecter successfully canceled tick 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7ce8077c20 legacy=0x7f7ce80980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 10 monclient: shutdown 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 >> v1:10.20.193.167:6789/0 conn(0x7f7d180b4c30 legacy=0x7f7d181a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 shutdown_connections 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 >> 10.20.193.78:0/1373114523 conn(0x7f7d180b4120 msgr2=0x7f7d180b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 shutdown_connections 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 1 -- 10.20.193.78:0/1373114523 wait complete. 2026-02-25T15:13:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.548+0000 7f7d1dc6f640 1 librados: shutdown 2026-02-25T15:13:06.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.3 2026-02-25T15:13:06.559 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.568+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f416805e0e0 con 0x7f416c164d00 2026-02-25T15:13:06.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.568+0000 7f4152ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.568+0000 7f4152ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.570+0000 7f82197fa640 10 client.?.objecter ms_handle_connect 0x7f82240b9f80 2026-02-25T15:13:06.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.570+0000 7f82197fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.571+0000 7fa30d7fa640 10 client.?.objecter ms_handle_connect 0x7fa3180585e0 2026-02-25T15:13:06.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.571+0000 7fa30d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.571+0000 7f9fc6b2e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:13:06.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.571+0000 7f9fc6b2e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:13:06.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.571+0000 7f9fc6b2e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.571+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f9fc00531e0 con 0x7f9fc0055980 2026-02-25T15:13:06.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.573+0000 7f96bbfff640 10 client.?.objecter ms_handle_connect 0x7f96e41566e0 2026-02-25T15:13:06.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.573+0000 7f96bbfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:06.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.574+0000 7f9fb57fa640 1 -- 10.20.193.78:0/1050366821 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 521551722) 0x7f9fb005dd30 con 0x7f9fc0055980 2026-02-25T15:13:06.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.574+0000 7f9fb57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:13:06.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.574+0000 7f9fb57fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.576 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 10 librados: watch_flush enter 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 10 librados: watch_flush exit 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 20 client.4567.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 10 client.4567.objecter successfully canceled tick 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 >> v1:10.20.193.78:6800/3497602169 conn(0x7f9f90077c20 legacy=0x7f9f900980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 10 monclient: shutdown 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 >> v1:10.20.193.155:6789/0 conn(0x7f9fc0055980 legacy=0x7f9fc01fc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 shutdown_connections 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 >> 10.20.193.78:0/1050366821 conn(0x7f9fc00b4120 msgr2=0x7f9fc0058d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 shutdown_connections 2026-02-25T15:13:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 1 -- 10.20.193.78:0/1050366821 wait complete. 2026-02-25T15:13:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.577+0000 7f9fc6b2e640 1 librados: shutdown 2026-02-25T15:13:06.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.11 2026-02-25T15:13:06.588 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.586+0000 7f65e1555640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:13:06.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.586+0000 7f65e1555640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:13:06.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.586+0000 7f65e1555640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.586+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f65dc1573e0 con 0x7f65dc0b9f80 2026-02-25T15:13:06.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2238242541 0 0) 0x7fa318155880 con 0x7fa3180ba350 2026-02-25T15:13:06.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 >> v1:10.20.193.167:6789/0 conn(0x7fa3180b9f80 legacy=0x7fa318155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 >> v1:10.20.193.155:6789/0 conn(0x7fa3180585e0 legacy=0x7fa3181fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 1 monclient: found mon.a 2026-02-25T15:13:06.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3181fd650 con 0x7fa3180ba350 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa30d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 5 monclient: authenticate success, global_id 4608 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 10 monclient: _renew_subs 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3181fd930 con 0x7fa3180ba350 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 10 client.4608.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 10 monclient: _renew_subs 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3181f9510 con 0x7fa3180ba350 2026-02-25T15:13:06.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 1 librados: init done 2026-02-25T15:13:06.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.607+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa318159080 con 0x7fa3180ba350 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.611+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7080037d0 con 0x7fe714164d00 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.611+0000 7fe6effff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.611+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe708004f80 con 0x7fe714164d00 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.611+0000 7fe6effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.611+0000 7fe6effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.611+0000 7fe6effff640 10 monclient: dump: 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.614 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.615 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.615 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.615 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.615 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.615 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.615 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.611+0000 7fe711ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:06.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.612+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fe70801ddf0 con 0x7fe714164d00 2026-02-25T15:13:06.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.613+0000 7fe7137fe640 10 monclient: get_auth_request con 0x7fe6e4077c80 auth_method 0 2026-02-25T15:13:06.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.613+0000 7fe6effff640 10 client.4605.objecter ms_handle_connect 0x7fe6e4077c80 2026-02-25T15:13:06.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.615+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fe7080937c0 con 0x7fe714164d00 2026-02-25T15:13:06.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.615+0000 7fe6effff640 10 client.4605.objecter ms_dispatch2 0x7fe714000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.615+0000 7fe6effff640 3 client.4605.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.615+0000 7fe6effff640 3 client.4605.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.615+0000 7fe6effff640 20 client.4605.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.615+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe714055b20 con 0x7fe714164d00 2026-02-25T15:13:06.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.615+0000 7fe6effff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.615+0000 7fe6effff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.616+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1994604935 0 0) 0x7f81f8003610 con 0x7f82240585e0 2026-02-25T15:13:06.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.616+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8224155880 con 0x7f82240585e0 2026-02-25T15:13:06.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.616+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8214002fd0 con 0x7f82240585e0 2026-02-25T15:13:06.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.616+0000 7f82197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.616+0000 7f82197fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.616+0000 7f82197fa640 10 monclient(hunting): dump: 2026-02-25T15:13:06.619 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.619 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.616+0000 7f82197fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.628+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2609989002 0 0) 0x7f96b4003610 con 0x7f96e4156ab0 2026-02-25T15:13:06.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.628+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96e40a6cd0 con 0x7f96e4156ab0 2026-02-25T15:13:06.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.628+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f96cc003390 con 0x7f96e4156ab0 2026-02-25T15:13:06.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.628+0000 7f96bbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.628+0000 7f96bbfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.628+0000 7f96bbfff640 10 monclient(hunting): dump: 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.631 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.628+0000 7f96bbfff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.645+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa314003500 con 0x7fa3180ba350 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.645+0000 7fa30d7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.645+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa314004fc0 con 0x7fa3180ba350 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.645+0000 7fa30d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.645+0000 7fa30d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.645+0000 7fa30effd640 4 set_mon_vals no callback set 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.645+0000 7fa30d7fa640 10 monclient: dump: 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.648 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.649 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.649 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.649 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.649 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.649 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.649 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.646+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fa31401de30 con 0x7fa3180ba350 2026-02-25T15:13:06.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.647+0000 7fa31caa8640 10 monclient: get_auth_request con 0x7fa2e8077c50 auth_method 0 2026-02-25T15:13:06.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.647+0000 7fa30d7fa640 10 client.4608.objecter ms_handle_connect 0x7fa2e8077c50 2026-02-25T15:13:06.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.648+0000 7f2cfb5b1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:13:06.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.648+0000 7f2cfb5b1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:13:06.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.648+0000 7f2cfb5b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:06.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.648+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f2cf415c2c0 con 0x7f2cf4166f60 2026-02-25T15:13:06.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f2ce1ffb640 1 -- 10.20.193.78:0/3185407051 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 3956125152) 0x7f2cf415c2c0 con 0x7f2cf4166f60 2026-02-25T15:13:06.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f2ce1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:13:06.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f2ce1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.653 INFO:teuthology.orchestra.run.trial078.stdout:94489280518 2026-02-25T15:13:06.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1320195093 0 0) 0x7f8224155880 con 0x7f82240585e0 2026-02-25T15:13:06.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 >> v1:10.20.193.167:6789/0 conn(0x7f82240ba350 legacy=0x7f82241f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 >> v1:10.20.193.155:6789/0 conn(0x7f82240b9f80 legacy=0x7f8224155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 1 monclient: found mon.a 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82241fd650 con 0x7f82240585e0 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f82197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 5 monclient: authenticate success, global_id 4611 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 10 monclient: _renew_subs 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82241fd930 con 0x7f82240585e0 2026-02-25T15:13:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 10 client.4611.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 10 monclient: _renew_subs 2026-02-25T15:13:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f82241f9510 con 0x7f82240585e0 2026-02-25T15:13:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f822b255640 1 librados: init done 2026-02-25T15:13:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f65bb7fe640 1 -- 10.20.193.78:0/274776714 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 521551722) 0x7f65c405de10 con 0x7f65dc0b9f80 2026-02-25T15:13:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f65bb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:13:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.651+0000 7f65bb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.657 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:06.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.652+0000 7f822b255640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.652+0000 7f822b255640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.652+0000 7f822b255640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.652+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8224159080 con 0x7f82240585e0 2026-02-25T15:13:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 10 librados: watch_flush enter 2026-02-25T15:13:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 10 librados: watch_flush exit 2026-02-25T15:13:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 20 client.4529.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 10 client.4529.objecter successfully canceled tick 2026-02-25T15:13:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 >> v1:10.20.193.78:6800/3497602169 conn(0x7f2cc4077bf0 legacy=0x7f2cc40980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 10 monclient: shutdown 2026-02-25T15:13:06.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 >> v1:10.20.193.167:6789/0 conn(0x7f2cf4166f60 legacy=0x7f2cf41fb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 shutdown_connections 2026-02-25T15:13:06.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 >> 10.20.193.78:0/3185407051 conn(0x7f2cf40b2ef0 msgr2=0x7f2cf40b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 shutdown_connections 2026-02-25T15:13:06.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.653+0000 7f2cfb5b1640 1 -- 10.20.193.78:0/3185407051 wait complete. 2026-02-25T15:13:06.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f2cfb5b1640 1 librados: shutdown 2026-02-25T15:13:06.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 10 librados: watch_flush enter 2026-02-25T15:13:06.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 10 librados: watch_flush exit 2026-02-25T15:13:06.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 20 client.4587.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 10 client.4587.objecter successfully canceled tick 2026-02-25T15:13:06.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 >> v1:10.20.193.78:6800/3497602169 conn(0x7f65a8077cd0 legacy=0x7f65a8098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 10 monclient: shutdown 2026-02-25T15:13:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 >> v1:10.20.193.78:6789/0 conn(0x7f65dc0b9f80 legacy=0x7f65dc1656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 shutdown_connections 2026-02-25T15:13:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 >> 10.20.193.78:0/274776714 conn(0x7f65dc0b7990 msgr2=0x7f65dc0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 shutdown_connections 2026-02-25T15:13:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 1 -- 10.20.193.78:0/274776714 wait complete. 2026-02-25T15:13:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.654+0000 7f65e1555640 1 librados: shutdown 2026-02-25T15:13:06.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.9 2026-02-25T15:13:06.666 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.0 2026-02-25T15:13:06.666 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.686+0000 7f4174513640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:13:06.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.686+0000 7f4174513640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:13:06.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.686+0000 7f4174513640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.686+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f416c0b4ca0 con 0x7f416c164d00 2026-02-25T15:13:06.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.688+0000 7f4152ffd640 1 -- 10.20.193.78:0/101069081 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 213165853) 0x7f416805d9e0 con 0x7f416c164d00 2026-02-25T15:13:06.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.688+0000 7f4152ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:13:06.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.688+0000 7f4152ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.690 INFO:teuthology.orchestra.run.trial078.stdout:94489280517 2026-02-25T15:13:06.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 10 librados: watch_flush enter 2026-02-25T15:13:06.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 10 librados: watch_flush exit 2026-02-25T15:13:06.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 20 client.4573.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 10 client.4573.objecter successfully canceled tick 2026-02-25T15:13:06.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 >> v1:10.20.193.78:6800/3497602169 conn(0x7f413c077c80 legacy=0x7f413c098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 10 monclient: shutdown 2026-02-25T15:13:06.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 >> v1:10.20.193.155:6789/0 conn(0x7f416c164d00 legacy=0x7f416c0ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 shutdown_connections 2026-02-25T15:13:06.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 >> 10.20.193.78:0/101069081 conn(0x7f416c0b2ef0 msgr2=0x7f416c0b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 shutdown_connections 2026-02-25T15:13:06.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 1 -- 10.20.193.78:0/101069081 wait complete. 2026-02-25T15:13:06.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.690+0000 7f4174513640 1 librados: shutdown 2026-02-25T15:13:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.695+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957974869 0 0) 0x7f96e40ac2d0 con 0x7f96e41566e0 2026-02-25T15:13:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.695+0000 7f96bbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.695+0000 7f96bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.695+0000 7f96bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.695+0000 7f96bbfff640 10 monclient(hunting): my global_id is 4576 2026-02-25T15:13:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.695+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96b4003610 con 0x7f96e41566e0 2026-02-25T15:13:06.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.697+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241056863 0 0) 0x7f96e40ac5b0 con 0x7f96e4160c00 2026-02-25T15:13:06.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.697+0000 7f96bbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:06.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.697+0000 7f96bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:06.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.697+0000 7f96bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:06.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.697+0000 7f96bbfff640 10 monclient(hunting): my global_id is 4532 2026-02-25T15:13:06.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.697+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96e40ac2d0 con 0x7f96e4160c00 2026-02-25T15:13:06.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.698+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3318549030 0 0) 0x7f96b4003610 con 0x7f96e41566e0 2026-02-25T15:13:06.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.698+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96e40ac5b0 con 0x7f96e41566e0 2026-02-25T15:13:06.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.698+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f96d8002f40 con 0x7f96e41566e0 2026-02-25T15:13:06.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.698+0000 7f96bbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.698+0000 7f96bbfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.698+0000 7f96bbfff640 10 monclient(hunting): dump: 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.701 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.699+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 908616397 0 0) 0x7f96e40ac2d0 con 0x7f96e4160c00 2026-02-25T15:13:06.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.699+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96b4003610 con 0x7f96e4160c00 2026-02-25T15:13:06.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.699+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f96d4003200 con 0x7f96e4160c00 2026-02-25T15:13:06.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.699+0000 7f96bbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:06.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.699+0000 7f96bbfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.699+0000 7f96bbfff640 10 monclient(hunting): dump: 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.703 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.10 2026-02-25T15:13:06.705 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2371650387 0 0) 0x7f96e40ac5b0 con 0x7f96e41566e0 2026-02-25T15:13:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 >> v1:10.20.193.167:6789/0 conn(0x7f96e4160c00 legacy=0x7f96e412b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 >> v1:10.20.193.78:6789/0 conn(0x7f96e4156ab0 legacy=0x7f96e40ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 1 monclient: found mon.b 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e40ac890 con 0x7f96e41566e0 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 10 monclient: _finish_auth 0 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 5 monclient: authenticate success, global_id 4576 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 10 monclient: _renew_subs 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f96e40acb70 con 0x7f96e41566e0 2026-02-25T15:13:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 10 client.4576.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 10 monclient: _renew_subs 2026-02-25T15:13:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f96e40ad130 con 0x7f96e41566e0 2026-02-25T15:13:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 1 librados: init done 2026-02-25T15:13:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.700+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e40531e0 con 0x7f96e41566e0 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.707+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96d8003510 con 0x7f96e41566e0 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.707+0000 7f96bbfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.707+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f96d8003860 con 0x7f96e41566e0 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.707+0000 7f96bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.707+0000 7f96bbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.707+0000 7f96bbfff640 10 monclient: dump: 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.710 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.711 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.711 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.711 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.711 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.711 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.711 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.707+0000 7f96e17fa640 4 set_mon_vals no callback set 2026-02-25T15:13:06.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.708+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f96d801c6d0 con 0x7f96e41566e0 2026-02-25T15:13:06.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.709+0000 7f96e27fc640 10 monclient: get_auth_request con 0x7f96b4077f30 auth_method 0 2026-02-25T15:13:06.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.709+0000 7f96bbfff640 10 client.4576.objecter ms_handle_connect 0x7f96b4077f30 2026-02-25T15:13:06.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.709+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f96d8091e80 con 0x7f96e41566e0 2026-02-25T15:13:06.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.709+0000 7f96bbfff640 10 client.4576.objecter ms_dispatch2 0x7f96e4000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.709+0000 7f96bbfff640 3 client.4576.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.709+0000 7f96bbfff640 3 client.4576.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.709+0000 7f96bbfff640 20 client.4576.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.729+0000 7fe719ffa640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:13:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.729+0000 7fe719ffa640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:13:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.729+0000 7fe719ffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.729+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7fe71404b700 con 0x7fe714164d00 2026-02-25T15:13:06.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.794+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f96e40531e0 con 0x7f96e41566e0 2026-02-25T15:13:06.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.794+0000 7f96bbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.794+0000 7f96bbfff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.871+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82140049f0 con 0x7f82240585e0 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.871+0000 7f82197fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.871+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8214004ba0 con 0x7f82240585e0 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.871+0000 7f82197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.871+0000 7f82197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.871+0000 7f82197fa640 10 monclient: dump: 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.874 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:06.875 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:06.875 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:06.875 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:06.875 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:06.875 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:06.875 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:06.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.871+0000 7f821affd640 4 set_mon_vals no callback set 2026-02-25T15:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.872+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f821401da10 con 0x7f82240585e0 2026-02-25T15:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.873+0000 7f821bfff640 10 monclient: get_auth_request con 0x7f81f8077d50 auth_method 0 2026-02-25T15:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.873+0000 7f82197fa640 10 client.4611.objecter ms_handle_connect 0x7f81f8077d50 2026-02-25T15:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.873+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7fa314093750 con 0x7fa3180ba350 2026-02-25T15:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.873+0000 7fa30d7fa640 10 client.4608.objecter ms_dispatch2 0x7fa318000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.873+0000 7fa30d7fa640 3 client.4608.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.873+0000 7fa30d7fa640 3 client.4608.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.874+0000 7fa30d7fa640 20 client.4608.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.874+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa318159080 con 0x7fa3180ba350 2026-02-25T15:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.874+0000 7fa30d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.874+0000 7fa30d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.879+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 579705576 0 0) 0x7f82140933d0 con 0x7f82240585e0 2026-02-25T15:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.879+0000 7f82197fa640 10 client.4611.objecter ms_dispatch2 0x7f8224000b90 osd_map(28..28 src has 1..28) 2026-02-25T15:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.879+0000 7f82197fa640 3 client.4611.objecter handle_osd_map got epochs [28,28] > 0 2026-02-25T15:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.879+0000 7f82197fa640 3 client.4611.objecter handle_osd_map decoding full epoch 28 2026-02-25T15:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.879+0000 7f82197fa640 20 client.4611.objecter dump_active .. 0 homeless 2026-02-25T15:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.879+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8224159080 con 0x7f82240585e0 2026-02-25T15:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.879+0000 7f82197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.879+0000 7f82197fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:06.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.893+0000 7fe6effff640 1 -- 10.20.193.78:0/2339377936 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 1257367751) 0x7fe71404b700 con 0x7fe714164d00 2026-02-25T15:13:06.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.893+0000 7fe6effff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:13:06.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.893+0000 7fe6effff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.895 INFO:teuthology.orchestra.run.trial078.stdout:90194313220 2026-02-25T15:13:06.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 10 librados: watch_flush enter 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 10 librados: watch_flush exit 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 20 client.4605.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 10 client.4605.objecter successfully canceled tick 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 >> v1:10.20.193.78:6800/3497602169 conn(0x7fe6e4077c80 legacy=0x7fe6e4098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 10 monclient: shutdown 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 >> v1:10.20.193.78:6789/0 conn(0x7fe714164d00 legacy=0x7fe714138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 shutdown_connections 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 >> 10.20.193.78:0/2339377936 conn(0x7fe7140b2ef0 msgr2=0x7fe7140580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 shutdown_connections 2026-02-25T15:13:06.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 1 -- 10.20.193.78:0/2339377936 wait complete. 2026-02-25T15:13:06.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.896+0000 7fe719ffa640 1 librados: shutdown 2026-02-25T15:13:06.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.905+0000 7f96e9a74640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:13:06.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.905+0000 7f96e9a74640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:13:06.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.905+0000 7f96e9a74640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:13:06.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.905+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f96e415d8f0 con 0x7f96e41566e0 2026-02-25T15:13:06.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.13 2026-02-25T15:13:06.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.907+0000 7f96bbfff640 1 -- 10.20.193.78:0/2457862563 <== mon.1 v1:10.20.193.155:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 521551722) 0x7f96d805c8b0 con 0x7f96e41566e0 2026-02-25T15:13:06.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.907+0000 7f96bbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:13:06.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.907+0000 7f96bbfff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.910 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:06.910 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 10 librados: watch_flush enter 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 10 librados: watch_flush exit 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 20 client.4576.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 10 client.4576.objecter successfully canceled tick 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 >> v1:10.20.193.78:6800/3497602169 conn(0x7f96b4077f30 legacy=0x7f96b40983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 10 monclient: shutdown 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 >> v1:10.20.193.155:6789/0 conn(0x7f96e41566e0 legacy=0x7f96e40a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 shutdown_connections 2026-02-25T15:13:06.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 >> 10.20.193.78:0/2457862563 conn(0x7f96e40b2ef0 msgr2=0x7f96e40ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 shutdown_connections 2026-02-25T15:13:06.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 1 -- 10.20.193.78:0/2457862563 wait complete. 2026-02-25T15:13:06.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.909+0000 7f96e9a74640 1 librados: shutdown 2026-02-25T15:13:06.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.14 2026-02-25T15:13:06.920 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:06.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.989+0000 7fa31ed33640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:13:06.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.989+0000 7fa31ed33640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:13:06.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.989+0000 7fa31ed33640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:06.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.989+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7fa3181f97a0 con 0x7fa3180ba350 2026-02-25T15:13:06.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.992+0000 7fa30d7fa640 1 -- 10.20.193.78:0/1557408019 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 521551722) 0x7fa318163930 con 0x7fa3180ba350 2026-02-25T15:13:06.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.992+0000 7fa30d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:13:06.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.992+0000 7fa30d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:06.994 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 10 librados: watch_flush enter 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 10 librados: watch_flush exit 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 20 client.4608.objecter shutdown clearing up homeless session... 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 10 client.4608.objecter successfully canceled tick 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 >> v1:10.20.193.78:6800/3497602169 conn(0x7fa2e8077c50 legacy=0x7fa2e8098100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 10 monclient: shutdown 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 >> v1:10.20.193.78:6789/0 conn(0x7fa3180ba350 legacy=0x7fa3181f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:06.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 shutdown_connections 2026-02-25T15:13:06.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 >> 10.20.193.78:0/1557408019 conn(0x7fa3180b7990 msgr2=0x7fa3180b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:06.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 shutdown_connections 2026-02-25T15:13:06.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 1 -- 10.20.193.78:0/1557408019 wait complete. 2026-02-25T15:13:06.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.994+0000 7fa31ed33640 1 librados: shutdown 2026-02-25T15:13:07.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.998+0000 7f822b255640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:13:07.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.998+0000 7f822b255640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:13:07.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.998+0000 7f822b255640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:06.998+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f822415b710 con 0x7f82240585e0 2026-02-25T15:13:07.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.000+0000 7f82197fa640 1 -- 10.20.193.78:0/145172172 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 521551722) 0x7f821405de00 con 0x7f82240585e0 2026-02-25T15:13:07.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.000+0000 7f82197fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:13:07.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.000+0000 7f82197fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:07.003 INFO:teuthology.orchestra.run.trial078.stdout:94489280516 2026-02-25T15:13:07.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 10 librados: watch_flush enter 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 10 librados: watch_flush exit 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 20 client.4611.objecter shutdown clearing up homeless session... 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 10 client.4611.objecter successfully canceled tick 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 >> v1:10.20.193.78:6800/3497602169 conn(0x7f81f8077d50 legacy=0x7f81f8098200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 10 monclient: shutdown 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 >> v1:10.20.193.78:6789/0 conn(0x7f82240585e0 legacy=0x7f82241fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 shutdown_connections 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 >> 10.20.193.78:0/145172172 conn(0x7f82240b7990 msgr2=0x7f82240b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 shutdown_connections 2026-02-25T15:13:07.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 1 -- 10.20.193.78:0/145172172 wait complete. 2026-02-25T15:13:07.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.003+0000 7f822b255640 1 librados: shutdown 2026-02-25T15:13:07.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.12 2026-02-25T15:13:07.008 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:07.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.4 2026-02-25T15:13:07.014 DEBUG:teuthology.parallel:result is None 2026-02-25T15:13:07.014 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T15:13:07.014 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:13:07.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.121+0000 7f428f85b640 10 monclient: get_monmap_and_config 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.121+0000 7f428f85b640 10 monclient: build_initial_monmap 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.121+0000 7f428f85b640 10 monclient: monmap: 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:07.122704+0000 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:07.122704+0000 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:07.124 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:07.125 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:07.125 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 1 Processor -- start 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 1 -- start start 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 10 monclient: init 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 10 monclient(hunting): picked mon.noname-c con 0x7f4288058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 10 monclient(hunting): picked mon.noname-a con 0x7f42880b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 10 monclient(hunting): picked mon.noname-b con 0x7f42881626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42881655c0 con 0x7f42880b0410 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42880b12b0 con 0x7f42881626a0 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42880b1590 con 0x7f4288058da0 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:07.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.122+0000 7f428f85b640 10 monclient(hunting): authenticate will time out at 3356.711895s 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.123+0000 7f428cdcf640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f42880b0410 0x7f4288164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37628/0 (socket says 10.20.193.78:37628) 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.123+0000 7f428cdcf640 1 -- 10.20.193.78:0/3475779298 learned_addr learned my addr 10.20.193.78:0/3475779298 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720388366 0 0) 0x7f42881655c0 con 0x7f42880b0410 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): my global_id is 4617 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4270003610 con 0x7f42880b0410 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597685542 0 0) 0x7f42880b1590 con 0x7f4288058da0 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): my global_id is 4535 2026-02-25T15:13:07.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42881655c0 con 0x7f4288058da0 2026-02-25T15:13:07.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817031541 0 0) 0x7f42880b12b0 con 0x7f42881626a0 2026-02-25T15:13:07.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 10 monclient(hunting): my global_id is 4579 2026-02-25T15:13:07.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.124+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42880b1590 con 0x7f42881626a0 2026-02-25T15:13:07.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 919080340 0 0) 0x7f42881655c0 con 0x7f4288058da0 2026-02-25T15:13:07.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 >> v1:10.20.193.155:6789/0 conn(0x7f42881626a0 legacy=0x7f42881c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 >> v1:10.20.193.78:6789/0 conn(0x7f42880b0410 legacy=0x7f4288164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:07.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 1 monclient: found mon.noname-c 2026-02-25T15:13:07.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:07.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:13:07.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880b1870 con 0x7f4288058da0 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 10 monclient: _finish_auth 0 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4278002df0 con 0x7f4288058da0 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f428f85b640 5 monclient: authenticate success, global_id 4535 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f4277fff640 10 monclient: dump: 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.138 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.126+0000 7f428f85b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4278002f90 con 0x7f4288058da0 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f4277fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f4277fff640 1 -- 10.20.193.78:0/3475779298 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f42780033d0 con 0x7f4288058da0 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:07.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 4 set_mon_vals no callback set 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f4277fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f4277fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f4277fff640 10 monclient: dump: 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.140 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 10 monclient: shutdown 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 1 -- 10.20.193.78:0/3475779298 >> v1:10.20.193.167:6789/0 conn(0x7f4288058da0 legacy=0x7f42881647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 1 -- 10.20.193.78:0/3475779298 shutdown_connections 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 1 -- 10.20.193.78:0/3475779298 >> 10.20.193.78:0/3475779298 conn(0x7f42880b65f0 msgr2=0x7f42880b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 1 -- 10.20.193.78:0/3475779298 shutdown_connections 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.127+0000 7f428f85b640 1 -- 10.20.193.78:0/3475779298 wait complete. 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient: build_initial_monmap 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient: monmap: 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:07.141 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 librados: starting msgr at 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 librados: starting objecter 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 Processor -- start 2026-02-25T15:13:07.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 -- start start 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 librados: setting wanted keys 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 librados: calling monclient init 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient: init 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient(hunting): picked mon.noname-c con 0x7f4288058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient(hunting): picked mon.noname-b con 0x7f42880b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient(hunting): picked mon.noname-a con 0x7f42881626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42881377d0 con 0x7f42881626a0 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42881fe900 con 0x7f42880b0410 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42881febe0 con 0x7f4288058da0 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:07.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.128+0000 7f428f85b640 10 monclient(hunting): authenticate will time out at 3356.717830s 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.129+0000 7f428ddd1640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f42881626a0 0x7f42881632e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37642/0 (socket says 10.20.193.78:37642) 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.129+0000 7f428ddd1640 1 -- 10.20.193.78:0/2169037037 learned_addr learned my addr 10.20.193.78:0/2169037037 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.129+0000 7f4275ffb640 10 client.?.objecter ms_handle_connect 0x7f42881626a0 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.129+0000 7f4275ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.129+0000 7f4275ffb640 10 client.?.objecter ms_handle_connect 0x7f42880b0410 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.129+0000 7f4275ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.129+0000 7f4275ffb640 10 client.?.objecter ms_handle_connect 0x7f4288058da0 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.129+0000 7f4275ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932144174 0 0) 0x7f42881377d0 con 0x7f42881626a0 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): my global_id is 4620 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4258003610 con 0x7f42881626a0 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819595301 0 0) 0x7f42881febe0 con 0x7f4288058da0 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): my global_id is 4538 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42881377d0 con 0x7f4288058da0 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4190395446 0 0) 0x7f42881fe900 con 0x7f42880b0410 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 10 monclient(hunting): my global_id is 4582 2026-02-25T15:13:07.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.130+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42881febe0 con 0x7f42880b0410 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1753853763 0 0) 0x7f4258003610 con 0x7f42881626a0 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42881fe900 con 0x7f42881626a0 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f42840033c0 con 0x7f42881626a0 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.146 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 64862309 0 0) 0x7f42881febe0 con 0x7f42880b0410 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4258003610 con 0x7f42880b0410 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f427c003020 con 0x7f42880b0410 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:07.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:07.148 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.148 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.148 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.148 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.148 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.148 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.148 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.148 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 371521625 0 0) 0x7f42881377d0 con 0x7f4288058da0 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42881febe0 con 0x7f4288058da0 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f42780032e0 con 0x7f4288058da0 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.132+0000 7f4275ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.149 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1447765296 0 0) 0x7f42881fe900 con 0x7f42881626a0 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 >> v1:10.20.193.167:6789/0 conn(0x7f4288058da0 legacy=0x7f42881fb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 >> v1:10.20.193.155:6789/0 conn(0x7f42880b0410 legacy=0x7f42881370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 1 monclient: found mon.a 2026-02-25T15:13:07.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42881feec0 con 0x7f42881626a0 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f4275ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 5 monclient: authenticate success, global_id 4620 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 10 monclient: _renew_subs 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42881fadc0 con 0x7f42881626a0 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 10 client.4620.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 10 monclient: _renew_subs 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4288136810 con 0x7f42881626a0 2026-02-25T15:13:07.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.133+0000 7f428f85b640 1 librados: init done 2026-02-25T15:13:07.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.134+0000 7f428f85b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.134+0000 7f428f85b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.134+0000 7f428f85b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.134+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428805dfd0 con 0x7f42881626a0 2026-02-25T15:13:07.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.224+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4284003560 con 0x7f42881626a0 2026-02-25T15:13:07.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.224+0000 7f4275ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:07.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.224+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4284003c60 con 0x7f42881626a0 2026-02-25T15:13:07.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.224+0000 7f4275ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.224+0000 7f4275ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.224+0000 7f42777fe640 4 set_mon_vals no callback set 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.224+0000 7f4275ffb640 10 monclient: dump: 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.228 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.225+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f4284003e40 con 0x7f42881626a0 2026-02-25T15:13:07.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.225+0000 7f428d5d0640 10 monclient: get_auth_request con 0x7f4258077ed0 auth_method 0 2026-02-25T15:13:07.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.226+0000 7f4275ffb640 10 client.4620.objecter ms_handle_connect 0x7f4258077ed0 2026-02-25T15:13:07.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.228+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8141+0+0 (unknown 2793444480 0 0) 0x7f4284093500 con 0x7f42881626a0 2026-02-25T15:13:07.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.228+0000 7f4275ffb640 10 client.4620.objecter ms_dispatch2 0x7f4288000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:13:07.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.228+0000 7f4275ffb640 3 client.4620.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:13:07.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.228+0000 7f4275ffb640 3 client.4620.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:13:07.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.228+0000 7f4275ffb640 20 client.4620.objecter dump_active .. 0 homeless 2026-02-25T15:13:07.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.228+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4284003c60 con 0x7f42881626a0 2026-02-25T15:13:07.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.228+0000 7f4275ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.228+0000 7f4275ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:07.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.332+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42880008d0 con 0x7f4258077ed0 2026-02-25T15:13:07.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.333+0000 7f4275ffb640 1 -- 10.20.193.78:0/2169037037 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42896 (unknown 2965378022 0 1121408617) 0x7f42880008d0 con 0x7f4258077ed0 2026-02-25T15:13:07.336 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:13:07.337 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-25T15:13:07.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 10 librados: watch_flush enter 2026-02-25T15:13:07.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 10 librados: watch_flush exit 2026-02-25T15:13:07.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 20 client.4620.objecter shutdown clearing up homeless session... 2026-02-25T15:13:07.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 10 client.4620.objecter successfully canceled tick 2026-02-25T15:13:07.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 >> v1:10.20.193.78:6800/3497602169 conn(0x7f4258077ed0 legacy=0x7f4258098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 10 monclient: shutdown 2026-02-25T15:13:07.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:07.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 >> v1:10.20.193.78:6789/0 conn(0x7f42881626a0 legacy=0x7f42881632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 shutdown_connections 2026-02-25T15:13:07.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 >> 10.20.193.78:0/2169037037 conn(0x7f42880b65f0 msgr2=0x7f428813fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:07.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 shutdown_connections 2026-02-25T15:13:07.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 1 -- 10.20.193.78:0/2169037037 wait complete. 2026-02-25T15:13:07.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.334+0000 7f428f85b640 1 librados: shutdown 2026-02-25T15:13:07.345 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-25T15:13:06.975553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":436496,"kb_used_data":5136,"kb_used_omap":118,"kb_used_meta":430985,"kb_avail":1509512944,"statfs":{"total":1546188226560,"available":1545741254656,"internally_reserved":0,"allocated":5259264,"data_stored":2759478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":121552,"internal_metadata":441328944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.242359"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:02.841686+0000","last_change":"2026-02-25T15:13:02.846272+0000","last_active":"2026-02-25T15:13:02.841686+0000","last_peered":"2026-02-25T15:13:02.841686+0000","last_clean":"2026-02-25T15:13:02.841686+0000","last_became_active":"2026-02-25T15:13:01.240693+0000","last_became_peered":"2026-02-25T15:13:01.240693+0000","last_unstale":"2026-02-25T15:13:02.841686+0000","last_undegraded":"2026-02-25T15:13:02.841686+0000","last_fullsized":"2026-02-25T15:13:02.841686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:32:46.429234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068336521999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,15],"acting":[12,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:03.332365+0000","last_change":"2026-02-25T15:13:03.354671+0000","last_active":"2026-02-25T15:13:03.332365+0000","last_peered":"2026-02-25T15:13:03.332365+0000","last_clean":"2026-02-25T15:13:03.332365+0000","last_became_active":"2026-02-25T15:13:01.107596+0000","last_became_peered":"2026-02-25T15:13:01.107596+0000","last_unstale":"2026-02-25T15:13:03.332365+0000","last_undegraded":"2026-02-25T15:13:03.332365+0000","last_fullsized":"2026-02-25T15:13:03.332365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:21.484744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043275358999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:04.190574+0000","last_change":"2026-02-25T15:13:04.197397+0000","last_active":"2026-02-25T15:13:04.190574+0000","last_peered":"2026-02-25T15:13:04.190574+0000","last_clean":"2026-02-25T15:13:04.190574+0000","last_became_active":"2026-02-25T15:13:00.886357+0000","last_became_peered":"2026-02-25T15:13:00.886357+0000","last_unstale":"2026-02-25T15:13:04.190574+0000","last_undegraded":"2026-02-25T15:13:04.190574+0000","last_fullsized":"2026-02-25T15:13:04.190574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:21:14.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047817094999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:04.168588+0000","last_change":"2026-02-25T15:13:04.192793+0000","last_active":"2026-02-25T15:13:04.168588+0000","last_peered":"2026-02-25T15:13:04.168588+0000","last_clean":"2026-02-25T15:13:04.168588+0000","last_became_active":"2026-02-25T15:13:01.030043+0000","last_became_peered":"2026-02-25T15:13:01.030043+0000","last_unstale":"2026-02-25T15:13:04.168588+0000","last_undegraded":"2026-02-25T15:13:04.168588+0000","last_fullsized":"2026-02-25T15:13:04.168588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:56:20.078816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047341022000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14],"acting":[11,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"28'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:02.847201+0000","last_change":"2026-02-25T15:13:02.847201+0000","last_active":"2026-02-25T15:13:02.847201+0000","last_peered":"2026-02-25T15:13:02.847201+0000","last_clean":"2026-02-25T15:13:02.847201+0000","last_became_active":"2026-02-25T15:13:01.242716+0000","last_became_peered":"2026-02-25T15:13:01.242716+0000","last_unstale":"2026-02-25T15:13:02.847201+0000","last_undegraded":"2026-02-25T15:13:02.847201+0000","last_fullsized":"2026-02-25T15:13:02.847201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:42.867009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073362477999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,8],"acting":[12,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:03.321451+0000","last_change":"2026-02-25T15:13:03.340291+0000","last_active":"2026-02-25T15:13:03.321451+0000","last_peered":"2026-02-25T15:13:03.321451+0000","last_clean":"2026-02-25T15:13:03.321451+0000","last_became_active":"2026-02-25T15:13:01.167595+0000","last_became_peered":"2026-02-25T15:13:01.167595+0000","last_unstale":"2026-02-25T15:13:03.321451+0000","last_undegraded":"2026-02-25T15:13:03.321451+0000","last_fullsized":"2026-02-25T15:13:03.321451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:48:42.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030257392000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:03.324179+0000","last_change":"2026-02-25T15:13:03.344370+0000","last_active":"2026-02-25T15:13:03.324179+0000","last_peered":"2026-02-25T15:13:03.324179+0000","last_clean":"2026-02-25T15:13:03.324179+0000","last_became_active":"2026-02-25T15:13:01.165967+0000","last_became_peered":"2026-02-25T15:13:01.165967+0000","last_unstale":"2026-02-25T15:13:03.324179+0000","last_undegraded":"2026-02-25T15:13:03.324179+0000","last_fullsized":"2026-02-25T15:13:03.324179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:41:44.607565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030945777000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"26'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:02.832134+0000","last_change":"2026-02-25T15:13:02.837950+0000","last_active":"2026-02-25T15:13:02.832134+0000","last_peered":"2026-02-25T15:13:02.832134+0000","last_clean":"2026-02-25T15:13:02.832134+0000","last_became_active":"2026-02-25T15:13:01.049643+0000","last_became_peered":"2026-02-25T15:13:01.049643+0000","last_unstale":"2026-02-25T15:13:02.832134+0000","last_undegraded":"2026-02-25T15:13:02.832134+0000","last_fullsized":"2026-02-25T15:13:02.832134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:51:09.091771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059457101999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"24'32","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:03.303336+0000","last_change":"2026-02-25T15:12:53.255197+0000","last_active":"2026-02-25T15:13:03.303336+0000","last_peered":"2026-02-25T15:13:03.303336+0000","last_clean":"2026-02-25T15:13:03.303336+0000","last_became_active":"2026-02-25T15:12:53.235995+0000","last_became_peered":"2026-02-25T15:12:53.235995+0000","last_unstale":"2026-02-25T15:13:03.303336+0000","last_undegraded":"2026-02-25T15:13:03.303336+0000","last_fullsized":"2026-02-25T15:13:03.303336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_clean_scrub_stamp":"2026-02-25T15:12:51.067937+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:13:12.776604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,6,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,2,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":115074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,4,5,6,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[1,2,3,4,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":716,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":733184,"data_stored":574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,2,4,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,3,5,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4873,"internal_metadata":27585783},"hb_peers":[0,2,4,5,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":716,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":733184,"data_stored":574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[0,1,2,4,5,7,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7470,"internal_metadata":27583186},"hb_peers":[0,1,3,4,5,6,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":115074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,4,6,7,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8130,"internal_metadata":27582526},"hb_peers":[1,3,4,5,6,7,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7480,"internal_metadata":27583176},"hb_peers":[0,2,3,5,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7476,"internal_metadata":27583180},"hb_peers":[0,1,3,5,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:13:07.347 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:13:07.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.413+0000 7fbde3667640 10 monclient: get_monmap_and_config 2026-02-25T15:13:07.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.413+0000 7fbde3667640 10 monclient: build_initial_monmap 2026-02-25T15:13:07.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.413+0000 7fbde3667640 10 monclient: monmap: 2026-02-25T15:13:07.415 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:07.415 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.415 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:07.414140+0000 2026-02-25T15:13:07.415 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:07.414140+0000 2026-02-25T15:13:07.416 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:07.416 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.416 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:07.416 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:07.416 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:07.416 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.413+0000 7fbde3667640 1 Processor -- start 2026-02-25T15:13:07.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.413+0000 7fbde3667640 1 -- start start 2026-02-25T15:13:07.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.413+0000 7fbde3667640 10 monclient: init 2026-02-25T15:13:07.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 10 monclient(hunting): picked mon.noname-a con 0x7fbddc058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 10 monclient(hunting): picked mon.noname-b con 0x7fbddc0b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 10 monclient(hunting): picked mon.noname-c con 0x7fbddc1626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc1655c0 con 0x7fbddc058da0 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc0b12b0 con 0x7fbddc0b0410 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc0b1590 con 0x7fbddc1626a0 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde3667640 10 monclient(hunting): authenticate will time out at 3357.003368s 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde0bdb640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fbddc0b0410 0x7fbddc164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58470/0 (socket says 10.20.193.78:58470) 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde0bdb640 1 -- 10.20.193.78:0/1423057825 learned_addr learned my addr 10.20.193.78:0/1423057825 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:07.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.414+0000 7fbde13dc640 1 --1- 10.20.193.78:0/1423057825 >> v1:10.20.193.78:6789/0 conn(0x7fbddc058da0 0x7fbddc1647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37654/0 (socket says 10.20.193.78:37654) 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040130778 0 0) 0x7fbddc0b1590 con 0x7fbddc1626a0 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): my global_id is 4541 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc4003610 con 0x7fbddc1626a0 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051117779 0 0) 0x7fbddc0b12b0 con 0x7fbddc0b0410 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): my global_id is 4585 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbddc0b1590 con 0x7fbddc0b0410 2026-02-25T15:13:07.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438352005 0 0) 0x7fbddc1655c0 con 0x7fbddc058da0 2026-02-25T15:13:07.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 10 monclient(hunting): my global_id is 4623 2026-02-25T15:13:07.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.416+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbddc0b12b0 con 0x7fbddc058da0 2026-02-25T15:13:07.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 834679767 0 0) 0x7fbddc0b1590 con 0x7fbddc0b0410 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 >> v1:10.20.193.167:6789/0 conn(0x7fbddc1626a0 legacy=0x7fbddc1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 >> v1:10.20.193.78:6789/0 conn(0x7fbddc058da0 legacy=0x7fbddc1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 10 monclient: _finish_hunting 0 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 1 monclient: found mon.noname-b 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc0b1870 con 0x7fbddc0b0410 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 10 monclient: _finish_auth 0 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 10 monclient: _check_auth_tickets 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:07.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbdd0002df0 con 0x7fbddc0b0410 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbdcbfff640 10 monclient: dump: 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.430 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbde3667640 5 monclient: authenticate success, global_id 4585 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.417+0000 7fbde3667640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.418+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbdd0002fc0 con 0x7fbddc0b0410 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.418+0000 7fbdcbfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.418+0000 7fbdcbfff640 1 -- 10.20.193.78:0/1423057825 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbdd0003400 con 0x7fbddc0b0410 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.418+0000 7fbdcbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.418+0000 7fbdcbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.418+0000 7fbdcbfff640 10 monclient: dump: 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.431 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.418+0000 7fbde3667640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.418+0000 7fbde3667640 4 set_mon_vals no callback set 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 10 monclient: shutdown 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 -- 10.20.193.78:0/1423057825 >> v1:10.20.193.155:6789/0 conn(0x7fbddc0b0410 legacy=0x7fbddc164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 -- 10.20.193.78:0/1423057825 shutdown_connections 2026-02-25T15:13:07.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 -- 10.20.193.78:0/1423057825 >> 10.20.193.78:0/1423057825 conn(0x7fbddc0b65f0 msgr2=0x7fbddc0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 -- 10.20.193.78:0/1423057825 shutdown_connections 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 -- 10.20.193.78:0/1423057825 wait complete. 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 10 monclient: build_initial_monmap 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 10 monclient: monmap: 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:07.433 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 librados: starting msgr at 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 librados: starting objecter 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 Processor -- start 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 -- start start 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 librados: setting wanted keys 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 1 librados: calling monclient init 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.419+0000 7fbde3667640 10 monclient: init 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:07.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 10 monclient(hunting): picked mon.noname-b con 0x7fbddc058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 10 monclient(hunting): picked mon.noname-c con 0x7fbddc0b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 10 monclient(hunting): picked mon.noname-a con 0x7fbddc1626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc14de60 con 0x7fbddc1626a0 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc057c20 con 0x7fbddc058da0 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc056e80 con 0x7fbddc0b0410 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde3667640 10 monclient(hunting): authenticate will time out at 3357.009192s 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde1bdd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbddc1626a0 0x7fbddc056770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37660/0 (socket says 10.20.193.78:37660) 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbde1bdd640 1 -- 10.20.193.78:0/3351879058 learned_addr learned my addr 10.20.193.78:0/3351879058 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbdc9ffb640 10 client.?.objecter ms_handle_connect 0x7fbddc1626a0 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbdc9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbdc9ffb640 10 client.?.objecter ms_handle_connect 0x7fbddc058da0 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbdc9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbdc9ffb640 10 client.?.objecter ms_handle_connect 0x7fbddc0b0410 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.420+0000 7fbdc9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389489577 0 0) 0x7fbddc14de60 con 0x7fbddc1626a0 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): my global_id is 4626 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdac003610 con 0x7fbddc1626a0 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290961502 0 0) 0x7fbddc057c20 con 0x7fbddc058da0 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): my global_id is 4588 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbddc14de60 con 0x7fbddc058da0 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736860557 0 0) 0x7fbddc056e80 con 0x7fbddc0b0410 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 10 monclient(hunting): my global_id is 4544 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.421+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbddc057c20 con 0x7fbddc0b0410 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.423+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3879881030 0 0) 0x7fbdac003610 con 0x7fbddc1626a0 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.423+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbddc056e80 con 0x7fbddc1626a0 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.423+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbdd8003390 con 0x7fbddc1626a0 2026-02-25T15:13:07.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.423+0000 7fbdc9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.423+0000 7fbdc9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.423+0000 7fbdc9ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.423+0000 7fbdc9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1767516108 0 0) 0x7fbddc14de60 con 0x7fbddc058da0 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbdac003610 con 0x7fbddc058da0 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbdcc003060 con 0x7fbddc058da0 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.439 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1223416053 0 0) 0x7fbddc057c20 con 0x7fbddc0b0410 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbddc14de60 con 0x7fbddc0b0410 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbdd0003310 con 0x7fbddc0b0410 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.424+0000 7fbdc9ffb640 10 monclient(hunting): dump: 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.440 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3958562679 0 0) 0x7fbddc056e80 con 0x7fbddc1626a0 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 >> v1:10.20.193.167:6789/0 conn(0x7fbddc0b0410 legacy=0x7fbddc05d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 >> v1:10.20.193.155:6789/0 conn(0x7fbddc058da0 legacy=0x7fbddc150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:07.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 1 monclient: found mon.a 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc14db80 con 0x7fbddc1626a0 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbdc9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 5 monclient: authenticate success, global_id 4626 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 10 monclient: _renew_subs 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc05c3a0 con 0x7fbddc1626a0 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 10 client.4626.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 10 monclient: _renew_subs 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbddc05c960 con 0x7fbddc1626a0 2026-02-25T15:13:07.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.425+0000 7fbde3667640 1 librados: init done 2026-02-25T15:13:07.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.426+0000 7fbde3667640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.426+0000 7fbde3667640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.426+0000 7fbde3667640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.426+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbddc059f30 con 0x7fbddc1626a0 2026-02-25T15:13:07.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.517+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbdd8003a80 con 0x7fbddc1626a0 2026-02-25T15:13:07.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.517+0000 7fbdc9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:07.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.517+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbdd8003e90 con 0x7fbddc1626a0 2026-02-25T15:13:07.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.517+0000 7fbdc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.517+0000 7fbdc9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:07.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.517+0000 7fbdc9ffb640 10 monclient: dump: 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.517+0000 7fbdcb7fe640 4 set_mon_vals no callback set 2026-02-25T15:13:07.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.517+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fbdd8004070 con 0x7fbddc1626a0 2026-02-25T15:13:07.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.518+0000 7fbde13dc640 10 monclient: get_auth_request con 0x7fbdac077e90 auth_method 0 2026-02-25T15:13:07.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.518+0000 7fbdc9ffb640 10 client.4626.objecter ms_handle_connect 0x7fbdac077e90 2026-02-25T15:13:07.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.520+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8141+0+0 (unknown 2793444480 0 0) 0x7fbdd8093440 con 0x7fbddc1626a0 2026-02-25T15:13:07.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.520+0000 7fbdc9ffb640 10 client.4626.objecter ms_dispatch2 0x7fbddc000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:13:07.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.520+0000 7fbdc9ffb640 3 client.4626.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:13:07.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.520+0000 7fbdc9ffb640 3 client.4626.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:13:07.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.520+0000 7fbdc9ffb640 20 client.4626.objecter dump_active .. 0 homeless 2026-02-25T15:13:07.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.520+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fbdd8003e90 con 0x7fbddc1626a0 2026-02-25T15:13:07.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.520+0000 7fbdc9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.520+0000 7fbdc9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:07.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.626+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbddc052450 con 0x7fbdac077e90 2026-02-25T15:13:07.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.627+0000 7fbdc9ffb640 1 -- 10.20.193.78:0/3351879058 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42896 (unknown 2965378022 0 1121408617) 0x7fbddc052450 con 0x7fbdac077e90 2026-02-25T15:13:07.630 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:13:07.631 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-25T15:13:07.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 10 librados: watch_flush enter 2026-02-25T15:13:07.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 10 librados: watch_flush exit 2026-02-25T15:13:07.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 20 client.4626.objecter shutdown clearing up homeless session... 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 10 client.4626.objecter successfully canceled tick 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 >> v1:10.20.193.78:6800/3497602169 conn(0x7fbdac077e90 legacy=0x7fbdac098340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 10 monclient: shutdown 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 >> v1:10.20.193.78:6789/0 conn(0x7fbddc1626a0 legacy=0x7fbddc056770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 shutdown_connections 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 >> 10.20.193.78:0/3351879058 conn(0x7fbddc0b65f0 msgr2=0x7fbddc0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 shutdown_connections 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 1 -- 10.20.193.78:0/3351879058 wait complete. 2026-02-25T15:13:07.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.628+0000 7fbde3667640 1 librados: shutdown 2026-02-25T15:13:07.638 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-25T15:13:06.975553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":436496,"kb_used_data":5136,"kb_used_omap":118,"kb_used_meta":430985,"kb_avail":1509512944,"statfs":{"total":1546188226560,"available":1545741254656,"internally_reserved":0,"allocated":5259264,"data_stored":2759478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":121552,"internal_metadata":441328944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.242359"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:02.841686+0000","last_change":"2026-02-25T15:13:02.846272+0000","last_active":"2026-02-25T15:13:02.841686+0000","last_peered":"2026-02-25T15:13:02.841686+0000","last_clean":"2026-02-25T15:13:02.841686+0000","last_became_active":"2026-02-25T15:13:01.240693+0000","last_became_peered":"2026-02-25T15:13:01.240693+0000","last_unstale":"2026-02-25T15:13:02.841686+0000","last_undegraded":"2026-02-25T15:13:02.841686+0000","last_fullsized":"2026-02-25T15:13:02.841686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:32:46.429234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068336521999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,15],"acting":[12,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:03.332365+0000","last_change":"2026-02-25T15:13:03.354671+0000","last_active":"2026-02-25T15:13:03.332365+0000","last_peered":"2026-02-25T15:13:03.332365+0000","last_clean":"2026-02-25T15:13:03.332365+0000","last_became_active":"2026-02-25T15:13:01.107596+0000","last_became_peered":"2026-02-25T15:13:01.107596+0000","last_unstale":"2026-02-25T15:13:03.332365+0000","last_undegraded":"2026-02-25T15:13:03.332365+0000","last_fullsized":"2026-02-25T15:13:03.332365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:21.484744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043275358999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:04.190574+0000","last_change":"2026-02-25T15:13:04.197397+0000","last_active":"2026-02-25T15:13:04.190574+0000","last_peered":"2026-02-25T15:13:04.190574+0000","last_clean":"2026-02-25T15:13:04.190574+0000","last_became_active":"2026-02-25T15:13:00.886357+0000","last_became_peered":"2026-02-25T15:13:00.886357+0000","last_unstale":"2026-02-25T15:13:04.190574+0000","last_undegraded":"2026-02-25T15:13:04.190574+0000","last_fullsized":"2026-02-25T15:13:04.190574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:21:14.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047817094999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:04.168588+0000","last_change":"2026-02-25T15:13:04.192793+0000","last_active":"2026-02-25T15:13:04.168588+0000","last_peered":"2026-02-25T15:13:04.168588+0000","last_clean":"2026-02-25T15:13:04.168588+0000","last_became_active":"2026-02-25T15:13:01.030043+0000","last_became_peered":"2026-02-25T15:13:01.030043+0000","last_unstale":"2026-02-25T15:13:04.168588+0000","last_undegraded":"2026-02-25T15:13:04.168588+0000","last_fullsized":"2026-02-25T15:13:04.168588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:56:20.078816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047341022000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14],"acting":[11,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"28'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:02.847201+0000","last_change":"2026-02-25T15:13:02.847201+0000","last_active":"2026-02-25T15:13:02.847201+0000","last_peered":"2026-02-25T15:13:02.847201+0000","last_clean":"2026-02-25T15:13:02.847201+0000","last_became_active":"2026-02-25T15:13:01.242716+0000","last_became_peered":"2026-02-25T15:13:01.242716+0000","last_unstale":"2026-02-25T15:13:02.847201+0000","last_undegraded":"2026-02-25T15:13:02.847201+0000","last_fullsized":"2026-02-25T15:13:02.847201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:42.867009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073362477999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,8],"acting":[12,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:03.321451+0000","last_change":"2026-02-25T15:13:03.340291+0000","last_active":"2026-02-25T15:13:03.321451+0000","last_peered":"2026-02-25T15:13:03.321451+0000","last_clean":"2026-02-25T15:13:03.321451+0000","last_became_active":"2026-02-25T15:13:01.167595+0000","last_became_peered":"2026-02-25T15:13:01.167595+0000","last_unstale":"2026-02-25T15:13:03.321451+0000","last_undegraded":"2026-02-25T15:13:03.321451+0000","last_fullsized":"2026-02-25T15:13:03.321451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:48:42.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030257392000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:03.324179+0000","last_change":"2026-02-25T15:13:03.344370+0000","last_active":"2026-02-25T15:13:03.324179+0000","last_peered":"2026-02-25T15:13:03.324179+0000","last_clean":"2026-02-25T15:13:03.324179+0000","last_became_active":"2026-02-25T15:13:01.165967+0000","last_became_peered":"2026-02-25T15:13:01.165967+0000","last_unstale":"2026-02-25T15:13:03.324179+0000","last_undegraded":"2026-02-25T15:13:03.324179+0000","last_fullsized":"2026-02-25T15:13:03.324179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:41:44.607565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030945777000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"26'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:02.832134+0000","last_change":"2026-02-25T15:13:02.837950+0000","last_active":"2026-02-25T15:13:02.832134+0000","last_peered":"2026-02-25T15:13:02.832134+0000","last_clean":"2026-02-25T15:13:02.832134+0000","last_became_active":"2026-02-25T15:13:01.049643+0000","last_became_peered":"2026-02-25T15:13:01.049643+0000","last_unstale":"2026-02-25T15:13:02.832134+0000","last_undegraded":"2026-02-25T15:13:02.832134+0000","last_fullsized":"2026-02-25T15:13:02.832134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:51:09.091771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059457101999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"24'32","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T15:13:03.303336+0000","last_change":"2026-02-25T15:12:53.255197+0000","last_active":"2026-02-25T15:13:03.303336+0000","last_peered":"2026-02-25T15:13:03.303336+0000","last_clean":"2026-02-25T15:13:03.303336+0000","last_became_active":"2026-02-25T15:12:53.235995+0000","last_became_peered":"2026-02-25T15:12:53.235995+0000","last_unstale":"2026-02-25T15:13:03.303336+0000","last_undegraded":"2026-02-25T15:13:03.303336+0000","last_fullsized":"2026-02-25T15:13:03.303336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_clean_scrub_stamp":"2026-02-25T15:12:51.067937+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:13:12.776604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,6,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,2,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":115074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,4,5,6,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[1,2,3,4,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":716,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":733184,"data_stored":574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,2,4,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,3,5,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4873,"internal_metadata":27585783},"hb_peers":[0,2,4,5,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":716,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":733184,"data_stored":574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[0,1,2,4,5,7,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7470,"internal_metadata":27583186},"hb_peers":[0,1,3,4,5,6,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":115074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,4,6,7,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8130,"internal_metadata":27582526},"hb_peers":[1,3,4,5,6,7,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7480,"internal_metadata":27583176},"hb_peers":[0,2,3,5,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":115055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7476,"internal_metadata":27583180},"hb_peers":[0,1,3,5,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:13:07.640 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T15:13:07.640 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-25T15:13:07.640 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-25T15:13:07.641 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-25T15:13:07.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.707+0000 7fac90ce8640 10 monclient: get_monmap_and_config 2026-02-25T15:13:07.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.707+0000 7fac90ce8640 10 monclient: build_initial_monmap 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.707+0000 7fac90ce8640 10 monclient: monmap: 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:13:07.708269+0000 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:13:07.708269+0000 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:07.710 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:07.711 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.707+0000 7fac90ce8640 1 Processor -- start 2026-02-25T15:13:07.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.707+0000 7fac90ce8640 1 -- start start 2026-02-25T15:13:07.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.707+0000 7fac90ce8640 10 monclient: init 2026-02-25T15:13:07.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:07.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:13:07.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 10 monclient(hunting): picked mon.noname-c con 0x7fac8c058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:07.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 10 monclient(hunting): picked mon.noname-b con 0x7fac8c0b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:07.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 10 monclient(hunting): picked mon.noname-a con 0x7fac8c1626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:07.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c1655c0 con 0x7fac8c1626a0 2026-02-25T15:13:07.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c0b12b0 con 0x7fac8c0b0410 2026-02-25T15:13:07.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c0b1590 con 0x7fac8c058da0 2026-02-25T15:13:07.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:07.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac90ce8640 10 monclient(hunting): authenticate will time out at 3357.297358s 2026-02-25T15:13:07.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac8a575640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fac8c058da0 0x7fac8c1647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:51274/0 (socket says 10.20.193.78:51274) 2026-02-25T15:13:07.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.708+0000 7fac8a575640 1 -- 10.20.193.78:0/2254591657 learned_addr learned my addr 10.20.193.78:0/2254591657 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:07.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690519856 0 0) 0x7fac8c0b12b0 con 0x7fac8c0b0410 2026-02-25T15:13:07.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 10 monclient(hunting): my global_id is 4591 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac78003610 con 0x7fac8c0b0410 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949107577 0 0) 0x7fac8c0b1590 con 0x7fac8c058da0 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 10 monclient(hunting): my global_id is 4547 2026-02-25T15:13:07.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.743+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac8c0b12b0 con 0x7fac8c058da0 2026-02-25T15:13:07.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.744+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134774767 0 0) 0x7fac8c1655c0 con 0x7fac8c1626a0 2026-02-25T15:13:07.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.744+0000 7fac89573640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.744+0000 7fac89573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.744+0000 7fac89573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.744+0000 7fac89573640 10 monclient(hunting): my global_id is 4629 2026-02-25T15:13:07.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.744+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac8c0b1590 con 0x7fac8c1626a0 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1189023373 0 0) 0x7fac78003610 con 0x7fac8c0b0410 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 >> v1:10.20.193.167:6789/0 conn(0x7fac8c058da0 legacy=0x7fac8c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 >> v1:10.20.193.78:6789/0 conn(0x7fac8c1626a0 legacy=0x7fac8c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 10 monclient: _finish_hunting 0 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 1 monclient: found mon.noname-b 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c0b1870 con 0x7fac8c0b0410 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 10 monclient: _finish_auth 0 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 10 monclient: _check_auth_tickets 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:07.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fac74002df0 con 0x7fac8c0b0410 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac89573640 10 monclient: dump: 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.752 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac90ce8640 5 monclient: authenticate success, global_id 4591 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.745+0000 7fac90ce8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac74002fc0 con 0x7fac8c0b0410 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac89573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac89573640 1 -- 10.20.193.78:0/2254591657 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fac74003400 con 0x7fac8c0b0410 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac89573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac89573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac89573640 10 monclient: dump: 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.753 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 10 monclient: get_monmap_and_config success 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 4 set_mon_vals no callback set 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 10 monclient: shutdown 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 1 -- 10.20.193.78:0/2254591657 >> v1:10.20.193.155:6789/0 conn(0x7fac8c0b0410 legacy=0x7fac8c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 1 -- 10.20.193.78:0/2254591657 shutdown_connections 2026-02-25T15:13:07.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 1 -- 10.20.193.78:0/2254591657 >> 10.20.193.78:0/2254591657 conn(0x7fac8c0b65f0 msgr2=0x7fac8c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 1 -- 10.20.193.78:0/2254591657 shutdown_connections 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.746+0000 7fac90ce8640 1 -- 10.20.193.78:0/2254591657 wait complete. 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient: build_initial_monmap 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient: monmap: 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:07.755 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 librados: starting msgr at 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 librados: starting objecter 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 Processor -- start 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 -- start start 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 librados: setting wanted keys 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 librados: calling monclient init 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient: init 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient: _reopen_session rank -1 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:13:07.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient(hunting): picked mon.noname-a con 0x7fac8c058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient(hunting): picked mon.noname-c con 0x7fac8c0b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient(hunting): picked mon.noname-b con 0x7fac8c1626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c14a000 con 0x7fac8c058da0 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c14a2e0 con 0x7fac8c1626a0 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c14a5c0 con 0x7fac8c0b0410 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient(hunting): _renew_subs 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.747+0000 7fac90ce8640 10 monclient(hunting): authenticate will time out at 3357.336680s 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.748+0000 7fac8ad76640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fac8c1626a0 0x7fac8c14d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:58488/0 (socket says 10.20.193.78:58488) 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.748+0000 7fac8ad76640 1 -- 10.20.193.78:0/298291652 learned_addr learned my addr 10.20.193.78:0/298291652 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.748+0000 7fac72ffd640 10 client.?.objecter ms_handle_connect 0x7fac8c1626a0 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.748+0000 7fac72ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.748+0000 7fac72ffd640 10 client.?.objecter ms_handle_connect 0x7fac8c058da0 2026-02-25T15:13:07.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.748+0000 7fac72ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.748+0000 7fac72ffd640 10 client.?.objecter ms_handle_connect 0x7fac8c0b0410 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.748+0000 7fac72ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605592298 0 0) 0x7fac8c14a000 con 0x7fac8c058da0 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 10 monclient(hunting): my global_id is 4632 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac58003610 con 0x7fac8c058da0 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067824794 0 0) 0x7fac8c14a2e0 con 0x7fac8c1626a0 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 10 monclient(hunting): my global_id is 4594 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.749+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac8c14a000 con 0x7fac8c1626a0 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.750+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190800884 0 0) 0x7fac8c14a5c0 con 0x7fac8c0b0410 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.750+0000 7fac72ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.750+0000 7fac72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.750+0000 7fac72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.750+0000 7fac72ffd640 10 monclient(hunting): my global_id is 4550 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.750+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac8c14a2e0 con 0x7fac8c0b0410 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.751+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 811309302 0 0) 0x7fac58003610 con 0x7fac8c058da0 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.751+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac8c14a5c0 con 0x7fac8c058da0 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.751+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fac800030b0 con 0x7fac8c058da0 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.751+0000 7fac72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.751+0000 7fac72ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.751+0000 7fac72ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.751+0000 7fac72ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2110692111 0 0) 0x7fac8c14a000 con 0x7fac8c1626a0 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac58003610 con 0x7fac8c1626a0 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fac7c0033c0 con 0x7fac8c1626a0 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.764 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3403219393 0 0) 0x7fac8c14a2e0 con 0x7fac8c0b0410 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac8c14a000 con 0x7fac8c0b0410 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fac74003310 con 0x7fac8c0b0410 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.752+0000 7fac72ffd640 10 monclient(hunting): dump: 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.765 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3869471531 0 0) 0x7fac8c14a5c0 con 0x7fac8c058da0 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 >> v1:10.20.193.167:6789/0 conn(0x7fac8c0b0410 legacy=0x7fac8c13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 >> v1:10.20.193.155:6789/0 conn(0x7fac8c1626a0 legacy=0x7fac8c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 1 monclient: found mon.a 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c14a8a0 con 0x7fac8c058da0 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 10 monclient: _finish_auth 0 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 5 monclient: authenticate success, global_id 4632 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 10 monclient: _renew_subs 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c0a91b0 con 0x7fac8c058da0 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 10 client.4632.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:07.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 10 monclient: _renew_subs 2026-02-25T15:13:07.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fac8c13a6e0 con 0x7fac8c058da0 2026-02-25T15:13:07.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 1 librados: init done 2026-02-25T15:13:07.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.753+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c163660 con 0x7fac8c058da0 2026-02-25T15:13:07.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.842+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac80003250 con 0x7fac8c058da0 2026-02-25T15:13:07.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.842+0000 7fac72ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:07.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.842+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fac80004af0 con 0x7fac8c058da0 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.842+0000 7fac72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.842+0000 7fac72ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.842+0000 7fac88d72640 4 set_mon_vals no callback set 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.842+0000 7fac72ffd640 10 monclient: dump: 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:13:07.845 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:07.846 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:07.846 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:07.846 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:13:07.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.842+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fac8001d960 con 0x7fac8c058da0 2026-02-25T15:13:07.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.843+0000 7fac89d74640 10 monclient: get_auth_request con 0x7fac58077e20 auth_method 0 2026-02-25T15:13:07.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.843+0000 7fac72ffd640 10 client.4632.objecter ms_handle_connect 0x7fac58077e20 2026-02-25T15:13:07.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.845+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8141+0+0 (unknown 2793444480 0 0) 0x7fac800931f0 con 0x7fac8c058da0 2026-02-25T15:13:07.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.845+0000 7fac72ffd640 10 client.4632.objecter ms_dispatch2 0x7fac8c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:13:07.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.845+0000 7fac72ffd640 3 client.4632.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:13:07.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.845+0000 7fac72ffd640 3 client.4632.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:13:07.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.846+0000 7fac72ffd640 20 client.4632.objecter dump_active .. 0 homeless 2026-02-25T15:13:07.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.846+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fac8005dc20 con 0x7fac8c058da0 2026-02-25T15:13:07.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.846+0000 7fac72ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:13:07.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.846+0000 7fac72ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:13:07.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.985+0000 7fac90ce8640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-25T15:13:07.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.985+0000 7fac90ce8640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-25T15:13:07.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.985+0000 7fac90ce8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:13:07.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.985+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fac8c0b6c60 con 0x7fac8c058da0 2026-02-25T15:13:07.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.988+0000 7fac72ffd640 1 -- 10.20.193.78:0/298291652 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7fac8005d520 con 0x7fac8c058da0 2026-02-25T15:13:07.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.988+0000 7fac72ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-25T15:13:07.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.988+0000 7fac72ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:13:07.991 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:13:07.991 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-25T15:13:07.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 10 librados: watch_flush enter 2026-02-25T15:13:07.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 10 librados: watch_flush exit 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 20 client.4632.objecter shutdown clearing up homeless session... 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 10 client.4632.objecter successfully canceled tick 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 >> v1:10.20.193.78:6800/3497602169 conn(0x7fac58077e20 legacy=0x7fac580982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 10 monclient: shutdown 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 >> v1:10.20.193.78:6789/0 conn(0x7fac8c058da0 legacy=0x7fac8c139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 shutdown_connections 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 >> 10.20.193.78:0/298291652 conn(0x7fac8c0b65f0 msgr2=0x7fac8c162b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 shutdown_connections 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 1 -- 10.20.193.78:0/298291652 wait complete. 2026-02-25T15:13:07.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:13:07.990+0000 7fac90ce8640 1 librados: shutdown 2026-02-25T15:13:08.000 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-25T15:13:08.001 INFO:teuthology.run_tasks:Running task workunit... 2026-02-25T15:13:08.025 INFO:tasks.workunit:Pulling workunits from ref 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T15:13:08.026 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-25T15:13:08.026 DEBUG:teuthology.orchestra.run.trial174:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-25T15:13:08.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:13:08.043 INFO:teuthology.orchestra.run.trial174.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-25T15:13:08.043 DEBUG:teuthology.orchestra.run.trial174:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-25T15:13:08.100 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-25T15:13:08.100 DEBUG:teuthology.orchestra.run.trial174:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-25T15:13:08.156 INFO:tasks.workunit:timeout=6h 2026-02-25T15:13:08.157 INFO:tasks.workunit:cleanup=True 2026-02-25T15:13:08.157 DEBUG:teuthology.orchestra.run.trial174:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-25T15:13:08.218 INFO:tasks.workunit.client.0.trial174.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-25T15:13:12.004 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:13.783 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:12.027 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:13.805 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:12.033 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:13.812 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:12.051 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:13.791 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:12.053 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:13.831 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:12.078 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:13.818 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:12.154 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:13.933 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:12.177 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:13.954 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:12.197 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:13.937 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.014 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:33.793 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.015 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:33.795 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.033 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:33.812 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.043 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:33.783 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.044 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:33.821 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.044 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:33.784 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.045 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:33.822 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.062 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:33.802 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:32.063 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:33.841 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:36.170 INFO:tasks.workunit.client.0.trial174.stderr:Note: switching to '36d388f27052dd940bdbaf543bb05bdba0acc155'. 2026-02-25T15:13:36.171 INFO:tasks.workunit.client.0.trial174.stderr: 2026-02-25T15:13:36.171 INFO:tasks.workunit.client.0.trial174.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-25T15:13:36.171 INFO:tasks.workunit.client.0.trial174.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-25T15:13:36.171 INFO:tasks.workunit.client.0.trial174.stderr:state without impacting any branches by switching back to a branch. 2026-02-25T15:13:36.171 INFO:tasks.workunit.client.0.trial174.stderr: 2026-02-25T15:13:36.171 INFO:tasks.workunit.client.0.trial174.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-25T15:13:36.171 INFO:tasks.workunit.client.0.trial174.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-25T15:13:36.171 INFO:tasks.workunit.client.0.trial174.stderr: 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr: git switch -c 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr: 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr:Or undo this operation with: 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr: 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr: git switch - 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr: 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr: 2026-02-25T15:13:36.172 INFO:tasks.workunit.client.0.trial174.stderr:HEAD is now at 36d388f2705 Merge branch 'aclamk-rocksdb-binned-cache-perf-counters-tentacle' of https://github.com/aclamk/ceph into wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-25T15:13:36.179 DEBUG:teuthology.orchestra.run.trial174:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-25T15:13:36.235 INFO:tasks.workunit.client.0.trial174.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-25T15:13:36.237 INFO:tasks.workunit.client.0.trial174.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-25T15:13:36.237 INFO:tasks.workunit.client.0.trial174.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-25T15:13:36.326 INFO:tasks.workunit.client.0.trial174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-25T15:13:36.358 INFO:tasks.workunit.client.0.trial174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-25T15:13:36.384 INFO:tasks.workunit.client.0.trial174.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-25T15:13:36.386 INFO:tasks.workunit.client.0.trial174.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-25T15:13:36.386 INFO:tasks.workunit.client.0.trial174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-25T15:13:36.412 INFO:tasks.workunit.client.0.trial174.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-25T15:13:36.415 DEBUG:teuthology.orchestra.run.trial174:> set -ex 2026-02-25T15:13:36.415 DEBUG:teuthology.orchestra.run.trial174:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-25T15:13:36.472 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-25T15:13:36.475 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-25T15:13:36.475 DEBUG:teuthology.orchestra.run.trial174:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36d388f27052dd940bdbaf543bb05bdba0acc155 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-25T15:13:36.533 INFO:tasks.workunit.client.0.trial174.stderr:+ parallel=1 2026-02-25T15:13:36.533 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' '' = --serial ']' 2026-02-25T15:13:36.533 INFO:tasks.workunit.client.0.trial174.stderr:+ crimson=0 2026-02-25T15:13:36.533 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' '' = --crimson ']' 2026-02-25T15:13:36.533 INFO:tasks.workunit.client.0.trial174.stderr:+ color= 2026-02-25T15:13:36.533 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -t 1 ']' 2026-02-25T15:13:36.534 INFO:tasks.workunit.client.0.trial174.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-25T15:13:36.534 INFO:tasks.workunit.client.0.trial174.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-25T15:13:36.534 INFO:tasks.workunit.client.0.trial174.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-25T15:13:36.535 INFO:tasks.workunit.client.0.trial174.stderr:+ declare -A pids 2026-02-25T15:13:36.535 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.535 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.535 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_aio 2026-02-25T15:13:36.535 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_aio' 2026-02-25T15:13:36.535 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_aio 2026-02-25T15:13:36.535 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.536 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_aio 2026-02-25T15:13:36.536 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47727 2026-02-25T15:13:36.536 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_aio on pid 47727' 2026-02-25T15:13:36.537 INFO:tasks.workunit.client.0.trial174.stdout:test api_aio on pid 47727 2026-02-25T15:13:36.539 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47727 2026-02-25T15:13:36.539 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.539 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.539 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_aio_pp 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_aio_pp' 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_aio_pp 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.540 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.541 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_aio_pp 2026-02-25T15:13:36.542 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47734 2026-02-25T15:13:36.542 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_aio_pp on pid 47734' 2026-02-25T15:13:36.542 INFO:tasks.workunit.client.0.trial174.stdout:test api_aio_pp on pid 47734 2026-02-25T15:13:36.545 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47734 2026-02-25T15:13:36.545 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_io 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_io' 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_io 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.546 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.547 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.548 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_io 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47745 2026-02-25T15:13:36.549 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_io on pid 47745' 2026-02-25T15:13:36.550 INFO:tasks.workunit.client.0.trial174.stdout:test api_io on pid 47745 2026-02-25T15:13:36.554 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47745 2026-02-25T15:13:36.554 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.554 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-25T15:13:36.554 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.554 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_io_pp 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_io_pp' 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_io_pp 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.555 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.556 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.557 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.558 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.559 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.559 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_io_pp 2026-02-25T15:13:36.559 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47756 2026-02-25T15:13:36.559 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_io_pp on pid 47756' 2026-02-25T15:13:36.559 INFO:tasks.workunit.client.0.trial174.stdout:test api_io_pp on pid 47756 2026-02-25T15:13:36.565 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47756 2026-02-25T15:13:36.565 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.565 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.565 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-25T15:13:36.565 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_asio 2026-02-25T15:13:36.565 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_asio' 2026-02-25T15:13:36.565 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.566 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_asio 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.567 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.568 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.569 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.570 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_asio 2026-02-25T15:13:36.571 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47772 2026-02-25T15:13:36.571 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_asio on pid 47772' 2026-02-25T15:13:36.571 INFO:tasks.workunit.client.0.trial174.stdout:test api_asio on pid 47772 2026-02-25T15:13:36.577 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47772 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_list 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_list' 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.578 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.579 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47727/exe ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_list 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.580 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.581 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47727/exe 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.582 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_list 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47788 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_list on pid 47788' 2026-02-25T15:13:36.583 INFO:tasks.workunit.client.0.trial174.stdout:test api_list on pid 47788 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47788 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_lock 2026-02-25T15:13:36.588 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_lock' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_aio: /' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.589 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_lock 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.590 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47734/exe ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47734/exe 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.591 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.592 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.593 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.593 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.593 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.593 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.593 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_lock 2026-02-25T15:13:36.593 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47807 2026-02-25T15:13:36.593 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_lock on pid 47807' 2026-02-25T15:13:36.593 INFO:tasks.workunit.client.0.trial174.stdout:test api_lock on pid 47807 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47807 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_lock_pp 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_lock_pp' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.597 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.598 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_lock_pp 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47745/exe ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47745/exe 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.599 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.600 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_lock_pp 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47826 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_lock_pp on pid 47826' 2026-02-25T15:13:36.601 INFO:tasks.workunit.client.0.trial174.stdout:test api_lock_pp on pid 47826 2026-02-25T15:13:36.603 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47826 2026-02-25T15:13:36.603 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.603 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.603 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.603 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.603 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.603 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.603 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_misc 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_misc' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_io.log 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_io: /' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_misc 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.604 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47756/exe ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47756/exe 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.605 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.606 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_misc 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47846 2026-02-25T15:13:36.607 INFO:tasks.workunit.client.0.trial174.stdout:test api_misc on pid 47846 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_misc on pid 47846' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47846 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_misc_pp 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_misc_pp' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.610 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_misc_pp 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.611 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.612 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47772/exe ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47772/exe 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_misc_pp 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47868 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_misc_pp on pid 47868' 2026-02-25T15:13:36.613 INFO:tasks.workunit.client.0.trial174.stdout:test api_misc_pp on pid 47868 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47868 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_pool 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_pool' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_pool 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.616 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.617 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47788/exe ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_asio: /' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47788/exe 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.618 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_pool 2026-02-25T15:13:36.619 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47887 2026-02-25T15:13:36.619 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_pool on pid 47887' 2026-02-25T15:13:36.619 INFO:tasks.workunit.client.0.trial174.stdout:test api_pool on pid 47887 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47887 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_snapshots 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_snapshots' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_snapshots 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.621 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.622 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47807/exe ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_list.log 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_list: /' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47807/exe 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.623 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_snapshots 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47909 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.624 INFO:tasks.workunit.client.0.trial174.stdout:test api_snapshots on pid 47909 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_snapshots on pid 47909' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47909 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.626 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_snapshots_pp 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47826/exe ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.627 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_snapshots_pp' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_lock: /' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47826/exe 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_snapshots_pp 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.628 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_snapshots_pp 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47937 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_snapshots_pp on pid 47937' 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47937 2026-02-25T15:13:36.629 INFO:tasks.workunit.client.0.trial174.stdout:test api_snapshots_pp on pid 47937 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_stat 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_stat' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47846/exe ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.632 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_stat 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47846/exe 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.633 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.634 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.635 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.635 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.635 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-25T15:13:36.635 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-25T15:13:36.635 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_stat 2026-02-25T15:13:36.635 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_misc: /' 2026-02-25T15:13:36.635 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47968 2026-02-25T15:13:36.635 INFO:tasks.workunit.client.0.trial174.stdout:test api_stat on pid 47968 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_stat on pid 47968' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47968 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_stat_pp 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_stat_pp' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47868/exe ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_stat_pp 2026-02-25T15:13:36.637 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47868/exe 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.638 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47887/exe ']' 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_stat_pp 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47887/exe 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47991 2026-02-25T15:13:36.639 INFO:tasks.workunit.client.0.trial174.stdout:test api_stat_pp on pid 47991 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_stat_pp on pid 47991' 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=47991 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_watch_notify 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_watch_notify' 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_watch_notify 2026-02-25T15:13:36.641 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.642 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_watch_notify 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48023 2026-02-25T15:13:36.643 INFO:tasks.workunit.client.0.trial174.stdout:test api_watch_notify on pid 48023 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_watch_notify on pid 48023' 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48023 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.645 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_watch_notify_pp 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_pool: /' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_watch_notify_pp' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_watch_notify_pp 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.646 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47909/exe ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.647 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47909/exe 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_watch_notify_pp 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48053 2026-02-25T15:13:36.648 INFO:tasks.workunit.client.0.trial174.stdout:test api_watch_notify_pp on pid 48053 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_watch_notify_pp on pid 48053' 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48053 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_cmd 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_cmd' 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.650 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_cmd 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.651 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47937/exe ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.652 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47937/exe 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_cmd 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48082 2026-02-25T15:13:36.653 INFO:tasks.workunit.client.0.trial174.stdout:test api_cmd on pid 48082 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_cmd on pid 48082' 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48082 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_cmd_pp 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_cmd_pp' 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.655 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_cmd_pp 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47968/exe ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.656 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47968/exe 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.657 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.658 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.658 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.658 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.658 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.658 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.658 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_cmd_pp 2026-02-25T15:13:36.658 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48119 2026-02-25T15:13:36.658 INFO:tasks.workunit.client.0.trial174.stdout:test api_cmd_pp on pid 48119 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_cmd_pp on pid 48119' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48119 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.660 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_service 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_service' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_service 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_stat: /' 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.661 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.662 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/47991/exe ']' 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/47991/exe 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_service 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48146 2026-02-25T15:13:36.663 INFO:tasks.workunit.client.0.trial174.stdout:test api_service on pid 48146 2026-02-25T15:13:36.665 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_service on pid 48146' 2026-02-25T15:13:36.665 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48146 2026-02-25T15:13:36.665 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.665 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.665 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-25T15:13:36.665 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_service_pp 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48023/exe ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_service_pp' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48023/exe 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_service_pp 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.666 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.667 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_service_pp 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48171 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_service_pp on pid 48171' 2026-02-25T15:13:36.668 INFO:tasks.workunit.client.0.trial174.stdout:test api_service_pp on pid 48171 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48171 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_c_write_operations 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_c_write_operations' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.671 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_c_write_operations 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48053/exe ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48053/exe 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.672 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_c_write_operations 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48205 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_c_write_operations on pid 48205' 2026-02-25T15:13:36.673 INFO:tasks.workunit.client.0.trial174.stdout:test api_c_write_operations on pid 48205 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48205 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s api_c_read_operations 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' api_c_read_operations' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.676 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48082/exe ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48082/exe 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ echo api_c_read_operations 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.677 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.678 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_cmd: /' 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=api_c_read_operations 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48249 2026-02-25T15:13:36.679 INFO:tasks.workunit.client.0.trial174.stdout:test api_c_read_operations on pid 48249 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test api_c_read_operations on pid 48249' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48249 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s list_parallel 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' list_parallel' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:++ echo list_parallel 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.681 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48119/exe ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.682 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48119/exe 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=list_parallel 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48275 2026-02-25T15:13:36.683 INFO:tasks.workunit.client.0.trial174.stdout:test list_parallel on pid 48275 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test list_parallel on pid 48275' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48275 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.685 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s open_pools_parallel 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' open_pools_parallel' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ echo open_pools_parallel 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.686 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.687 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48146/exe ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48146/exe 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=open_pools_parallel 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48309 2026-02-25T15:13:36.688 INFO:tasks.workunit.client.0.trial174.stdout:test open_pools_parallel on pid 48309 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test open_pools_parallel on pid 48309' 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48309 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s delete_pools_parallel 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.690 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' delete_pools_parallel' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48171/exe ']' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:++ echo delete_pools_parallel 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.691 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48171/exe 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-25T15:13:36.692 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_service.log 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_service: /' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=delete_pools_parallel 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48329 2026-02-25T15:13:36.693 INFO:tasks.workunit.client.0.trial174.stdout:test delete_pools_parallel on pid 48329 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test delete_pools_parallel on pid 48329' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48329 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s cls 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.696 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' cls' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48205/exe ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ echo cls 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48205/exe 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.697 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=cls 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48361 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.698 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.699 INFO:tasks.workunit.client.0.trial174.stdout:test cls on pid 48361 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test cls on pid 48361' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48361 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s cmd 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48249/exe ']' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' cmd' 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-25T15:13:36.701 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48249/exe 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ echo cmd 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.702 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=cmd 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.703 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48382 2026-02-25T15:13:36.704 INFO:tasks.workunit.client.0.trial174.stdout:test cmd on pid 48382 2026-02-25T15:13:36.705 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test cmd on pid 48382' 2026-02-25T15:13:36.705 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48382 2026-02-25T15:13:36.705 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.705 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.705 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s handler_error 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' handler_error' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ echo handler_error 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.706 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=handler_error 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48275/exe ']' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48410 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.707 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test handler_error on pid 48410' 2026-02-25T15:13:36.708 INFO:tasks.workunit.client.0.trial174.stdout:test handler_error on pid 48410 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48410 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s io 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48275/exe 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' io' 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:++ echo io 2026-02-25T15:13:36.710 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.711 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.712 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=io 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ list_parallel: /' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48432 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48309/exe ']' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test io on pid 48432' 2026-02-25T15:13:36.713 INFO:tasks.workunit.client.0.trial174.stdout:test io on pid 48432 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48432 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s ec_io 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48309/exe 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' ec_io' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:++ echo ec_io 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.715 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.716 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48329/exe ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.717 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=ec_io 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48464 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test ec_io on pid 48464' 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48329/exe 2026-02-25T15:13:36.718 INFO:tasks.workunit.client.0.trial174.stdout:test ec_io on pid 48464 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48464 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s list 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' list' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++ echo list 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.720 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.721 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=list 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48488 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test list on pid 48488' 2026-02-25T15:13:36.722 INFO:tasks.workunit.client.0.trial174.stdout:test list on pid 48488 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48488 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s ec_list 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' ec_list' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ echo ec_list 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.725 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48361/exe ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.726 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48361/exe 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.727 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=ec_list 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48518 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test ec_list on pid 48518' 2026-02-25T15:13:36.728 INFO:tasks.workunit.client.0.trial174.stdout:test ec_list on pid 48518 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48518 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48382/exe ']' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s misc 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' misc' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48382/exe 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.731 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48410/exe ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ echo misc 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_cls 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_cls.log 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.732 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ cls: /' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48410/exe 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.733 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_cmd 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ cmd: /' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=misc 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48566 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test misc on pid 48566' 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.734 INFO:tasks.workunit.client.0.trial174.stdout:test misc on pid 48566 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48566 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_handler_error 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s pool 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ handler_error: /' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' pool' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.736 INFO:tasks.workunit.client.0.trial174.stderr:++ echo pool 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48432/exe ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.737 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48432/exe 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=pool 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48589 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test pool on pid 48589' 2026-02-25T15:13:36.738 INFO:tasks.workunit.client.0.trial174.stdout:test pool on pid 48589 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48589 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s read_operations 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' read_operations' 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.740 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_io 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_io.log 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ io: /' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ echo read_operations 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.741 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.742 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=read_operations 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48629 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test read_operations on pid 48629' 2026-02-25T15:13:36.743 INFO:tasks.workunit.client.0.trial174.stdout:test read_operations on pid 48629 2026-02-25T15:13:36.745 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48629 2026-02-25T15:13:36.745 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.745 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.745 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s snapshots 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' snapshots' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ echo snapshots 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.746 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48464/exe ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.747 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48464/exe 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48488/exe ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48488/exe 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=snapshots 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48671 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test snapshots on pid 48671' 2026-02-25T15:13:36.748 INFO:tasks.workunit.client.0.trial174.stdout:test snapshots on pid 48671 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48671 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s watch_notify 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' watch_notify' 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.751 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_ec_io 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ echo watch_notify 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ ec_io: /' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_list 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.752 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ list: /' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48518/exe ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_list.log 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48518/exe 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.753 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=watch_notify 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48702 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test watch_notify on pid 48702' 2026-02-25T15:13:36.754 INFO:tasks.workunit.client.0.trial174.stdout:test watch_notify on pid 48702 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48702 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:++ printf %25s write_operations 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+ r=' write_operations' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.756 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ awk '{print $1}' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ echo write_operations 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_ec_list 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.757 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ ec_list: /' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48566/exe ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+ ff=write_operations 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48743 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+ echo 'test write_operations on pid 48743' 2026-02-25T15:13:36.758 INFO:tasks.workunit.client.0.trial174.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-25T15:13:36.759 INFO:tasks.workunit.client.0.trial174.stdout:test write_operations on pid 48743 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48566/exe 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+ pids[$f]=48743 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+ ret=0 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47772 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47772 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.766 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+ . /etc/bashrc 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -z '' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ shopt -q login_shell 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ umask 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ SHELL=/bin/bash 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.767 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48589/exe ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.768 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48589/exe 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_misc 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_misc.log 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ misc: /' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48629/exe ']' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.769 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48629/exe 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ return 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ export S_COLORS=auto 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ S_COLORS=auto 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_pool 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_pool.log 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ pool: /' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.770 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_read_operations 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ read_operations: /' 2026-02-25T15:13:36.771 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ prefix=/usr 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset prefix 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.772 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48702/exe ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48671/exe ']' 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/locale 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48702/exe 2026-02-25T15:13:36.773 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48671/exe 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_watch_notify 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ watch_notify: /' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ unset LANG_backup config 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n '' ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:13:36.774 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_snapshots 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ '[' '' ']' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ '[' -r /proc/48743/exe ']' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ snapshots: /' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++++ readlink /proc/48743/exe 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++++ basename /usr/bin/bash 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ SHELLNAME=bash 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_declare='declare -f' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ which_opt=-f 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ export which_declare 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+++ export -f which 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ unset i 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:++ unset -f pathmunge 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ export PATH 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ unset rc 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ ceph_test_neorados_write_operations 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stderr:+ sed 's/^/ write_operations: /' 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [----------] Global test environment set-up. 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient: get_monmap_and_config 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient: build_initial_monmap 2026-02-25T15:13:36.775 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient: monmap: 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: epoch 0 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: last_changed 0.000000 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: created 0.000000 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: election_strategy: 1 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 1 Processor -- start 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 1 -- start start 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient: init 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient: _reopen_session rank -1 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient(hunting): picked mon.noname-c con 0x55e22a0a1c10 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient(hunting): picked mon.noname-a con 0x55e22a0c2b90 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient(hunting): picked mon.noname-b con 0x55e22a0e46c0 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e22a0aa3d0 con 0x55e22a0c2b90 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e22a09eff0 con 0x55e22a0e46c0 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e22a0a01d0 con 0x55e22a0a1c10 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient(hunting): _renew_subs 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.617+0000 7f2ab23c5880 10 monclient(hunting): authenticate will time out at 3379.277653s 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.634+0000 7f2aab7fe640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x55e22a0a1c10 0x55e22a0a9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.174:40086/0 (socket says 10.20.193.174:40086) 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.634+0000 7f2aab7fe640 1 -- 10.20.193.174:0/2693484785 learned_addr learned my addr 10.20.193.174:0/2693484785 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.659+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959635608 0 0) 0x55e22a0a01d0 con 0x55e22a0a1c10 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.659+0000 7f2aa9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.659+0000 7f2aa9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.659+0000 7f2aa9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.659+0000 7f2aa9ffb640 10 monclient(hunting): my global_id is 4628 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.659+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a98001e10 con 0x55e22a0a1c10 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.673+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340053615 0 0) 0x55e22a0aa3d0 con 0x55e22a0c2b90 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.673+0000 7f2aa9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.673+0000 7f2aa9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.673+0000 7f2aa9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.673+0000 7f2aa9ffb640 10 monclient(hunting): my global_id is 4707 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.673+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55e22a0a01d0 con 0x55e22a0c2b90 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.679+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868853311 0 0) 0x55e22a09eff0 con 0x55e22a0e46c0 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.679+0000 7f2aa9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.679+0000 7f2aa9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.679+0000 7f2aa9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:36.776 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.679+0000 7f2aa9ffb640 10 monclient(hunting): my global_id is 4666 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.679+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55e22a0aa3d0 con 0x55e22a0e46c0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 386356070 0 0) 0x55e22a0aa3d0 con 0x55e22a0e46c0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 >> v1:10.20.193.167:6789/0 conn(0x55e22a0a1c10 legacy=0x55e22a0a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 >> v1:10.20.193.78:6789/0 conn(0x55e22a0c2b90 legacy=0x55e22a0e3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 1 monclient: found mon.noname-b 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22a0a13b0 con 0x55e22a0e46c0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2aa4001900 con 0x55e22a0e46c0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2aa9ffb640 10 monclient: dump: 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: epoch 1 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: election_strategy: 3 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2ab23c5880 5 monclient: authenticate success, global_id 4666 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.696+0000 7f2ab23c5880 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.744+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2aa4001b60 con 0x55e22a0e46c0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.744+0000 7f2aa9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.744+0000 7f2aa9ffb640 1 -- 10.20.193.174:0/2693484785 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2aa4001f70 con 0x55e22a0e46c0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2aa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2aa9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2aa9ffb640 10 monclient: dump: 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: epoch 1 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: election_strategy: 3 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.777 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient: get_monmap_and_config success 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 4 set_mon_vals no callback set 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient: shutdown 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- 10.20.193.174:0/2693484785 >> v1:10.20.193.155:6789/0 conn(0x55e22a0e46c0 legacy=0x55e22a09c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- 10.20.193.174:0/2693484785 shutdown_connections 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- 10.20.193.174:0/2693484785 >> 10.20.193.174:0/2693484785 conn(0x55e229ff1a70 msgr2=0x55e22a104b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- 10.20.193.174:0/2693484785 shutdown_connections 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- 10.20.193.174:0/2693484785 wait complete. 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient: build_initial_monmap 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient: monmap: 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: epoch 0 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: last_changed 0.000000 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: created 0.000000 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-25T15:13:36.778 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: election_strategy: 1 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 librados: starting msgr at 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 librados: starting objecter 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 Processor -- start 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- start start 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 librados: setting wanted keys 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 librados: calling monclient init 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient: init 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient: _reopen_session rank -1 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient(hunting): picked mon.noname-b con 0x55e22a0a1c10 addr v1:10.20.193.155:6789/0 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient(hunting): picked mon.noname-c con 0x55e22a0c2b90 addr v1:10.20.193.167:6789/0 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient(hunting): picked mon.noname-a con 0x55e22a0e46c0 addr v1:10.20.193.78:6789/0 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e22a0ac610 con 0x55e22a0e46c0 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e22a0b1a00 con 0x55e22a0a1c10 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e22a0b2be0 con 0x55e22a0c2b90 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient(hunting): _renew_subs 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.745+0000 7f2ab23c5880 10 monclient(hunting): authenticate will time out at 3379.405994s 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.776+0000 7f2aab7fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x55e22a0a1c10 0x55e22a0abad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.174:36632/0 (socket says 10.20.193.174:36632) 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.776+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 learned_addr learned my addr 10.20.193.174:0/518169719 (peer_addr_for_me v1:10.20.193.174:0/0) 2026-02-25T15:13:36.819 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.777+0000 7f2aa8ff9640 10 client.?.objecter ms_handle_connect 0x55e22a0a1c10 2026-02-25T15:13:36.820 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.777+0000 7f2aa8ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:36.820 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.791+0000 7f2aa8ff9640 10 client.?.objecter ms_handle_connect 0x55e22a0e46c0 2026-02-25T15:13:36.820 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.791+0000 7f2aa8ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:36.820 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.797+0000 7f2aa8ff9640 10 client.?.objecter ms_handle_connect 0x55e22a0c2b90 2026-02-25T15:13:36.820 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.797+0000 7f2aa8ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:13:36.820 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.817+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1602246570 0 0) 0x55e22a0b1a00 con 0x55e22a0a1c10 2026-02-25T15:13:36.820 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.817+0000 7f2aa8ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:36.908 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.817+0000 7f2aa8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:36.908 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.817+0000 7f2aa8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.817+0000 7f2aa8ff9640 10 monclient(hunting): my global_id is 4786 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.817+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a98001b30 con 0x55e22a0a1c10 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.827+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985067979 0 0) 0x55e22a0ac610 con 0x55e22a0e46c0 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.827+0000 7f2aa8ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.827+0000 7f2aa8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.827+0000 7f2aa8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.827+0000 7f2aa8ff9640 10 monclient(hunting): my global_id is 4815 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.827+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55e22a0b1a00 con 0x55e22a0e46c0 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.858+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701201148 0 0) 0x55e22a0b2be0 con 0x55e22a0c2b90 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.858+0000 7f2aa8ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.858+0000 7f2aa8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.858+0000 7f2aa8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.858+0000 7f2aa8ff9640 10 monclient(hunting): my global_id is 4742 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.858+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55e22a0ac610 con 0x55e22a0c2b90 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.900+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2174907037 0 0) 0x55e22a0b1a00 con 0x55e22a0e46c0 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.900+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55e22a0b2be0 con 0x55e22a0e46c0 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.900+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2aa4001cd0 con 0x55e22a0e46c0 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.900+0000 7f2aa8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.900+0000 7f2aa8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.900+0000 7f2aa8ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: epoch 1 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:13:36.909 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: election_strategy: 3 2026-02-25T15:13:36.910 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:36.910 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:36.910 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:36.910 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.910 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.900+0000 7f2aa8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.906+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 819425477 0 0) 0x55e22a0ac610 con 0x55e22a0c2b90 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.906+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55e22a0b1a00 con 0x55e22a0c2b90 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.906+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2aa0001840 con 0x55e22a0c2b90 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.906+0000 7f2aa8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.906+0000 7f2aa8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.906+0000 7f2aa8ff9640 10 monclient(hunting): dump: 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: epoch 1 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:13:36.967 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: election_strategy: 3 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 473097708 0 0) 0x55e22a0b1a00 con 0x55e22a0c2b90 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 >> v1:10.20.193.155:6789/0 conn(0x55e22a0a1c10 legacy=0x55e22a0abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 >> v1:10.20.193.78:6789/0 conn(0x55e22a0e46c0 legacy=0x55e22a09b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 1 monclient: found mon.c 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22a0b3dc0 con 0x55e22a0c2b90 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 10 monclient: _finish_auth 0 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2aa8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 5 monclient: authenticate success, global_id 4742 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 10 monclient: _renew_subs 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x55e22a09d030 con 0x55e22a0c2b90 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 10 client.4742.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 10 monclient: _renew_subs 2026-02-25T15:13:36.968 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:37.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x55e22a09d500 con 0x55e22a0c2b90 2026-02-25T15:13:37.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 1 librados: init done 2026-02-25T15:13:37.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:36.965+0000 7f2ab23c5880 10 librados: wait_for_osdmap waiting 2026-02-25T15:13:37.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.028+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2aa00030d0 con 0x55e22a0c2b90 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.028+0000 7f2aa8ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.028+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2aa0003420 con 0x55e22a0c2b90 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.028+0000 7f2aa8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.028+0000 7f2aa8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.028+0000 7f2aa8ff9640 10 monclient: dump: 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: epoch 1 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:37.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: election_strategy: 3 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.028+0000 7f2aa9ffb640 4 set_mon_vals no callback set 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.029+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f2aa001c290 con 0x55e22a0c2b90 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8141+0+0 (unknown 2793444480 0 0) 0x7f2aa0091af0 con 0x55e22a0c2b90 2026-02-25T15:13:37.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2aa8ff9640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_map(29..29 src has 1..29) 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2aab7fe640 10 monclient: get_auth_request con 0x7f2a98076b10 auth_method 0 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2aa8ff9640 20 client.4742.objecter dump_active .. 0 homeless 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2ab23c5880 10 librados: wait_for_osdmap done waiting 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2ab23c5880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x55e229f9fda0 con 0x55e22a0c2b90 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.030+0000 7f2aa8ff9640 10 client.4742.objecter ms_handle_connect 0x7f2a98076b10 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.158+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f2aa0058190 con 0x55e22a0c2b90 2026-02-25T15:13:37.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.158+0000 7f2aa8ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:13:38.703 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.158+0000 7f2aa97fa640 10 client.4742.objecter _get_latest_version latest 29, have it 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.158+0000 7f2ab23c5880 10 client.4742.objecter create_pool name=ceph_test_rados_api_asio 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.158+0000 7f2ab23c5880 10 client.4742.objecter pool_op_submit 1 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.158+0000 7f2ab23c5880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:37.158+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6789/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x55e229f24570 con 0x55e22a0c2b90 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 10 ==== pool_op_reply(tid 1 (0) Success v31) ==== 43+0+0 (unknown 3286071717 0 0) 0x7f2aa005c520 con 0x55e22a0c2b90 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 pool_op_reply(tid 1 (0) Success v31) 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 10 client.4742.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v31) 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 10 client.4742.objecter have request 1 at 0x55e22a0ab230 Op: create 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 20 client.4742.objecter waiting for client to reach epoch 31 before calling back 2026-02-25T15:13:38.704 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 10 client.4742.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 10 monclient: _renew_subs 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=30}) -- 0x55e22a0b1a00 con 0x55e22a0c2b90 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.601+0000 7f2aa8ff9640 10 client.4742.objecter done 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== mon.2 v1:10.20.193.167:6789/0 11 ==== osd_map(30..31 src has 1..31) ==== 18899+0+0 (unknown 2713428742 0 0) 0x7f2aa0057db0 con 0x55e22a0c2b90 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2aa8ff9640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_map(30..31 src has 1..31) 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map got epochs [30,31] > 29 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map decoding incremental epoch 30 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map decoding incremental epoch 31 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2aa8ff9640 20 client.4742.objecter dump_active .. 0 homeless 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 10 librados: set snap read head -> 1 2026-02-25T15:13:38.705 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 10 librados: writefull oid=exist nspace= 2026-02-25T15:13:38.706 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a09d7f0 2026-02-25T15:13:38.706 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 31 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:38.706 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:38.706 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:38.706 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 2 osd.6 2026-02-25T15:13:41.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 2 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 15 client.4742.objecter _send_op 2 to 34.1 on osd.6 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:2 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e22a0b4fa0 con 0x55e22a0b20e0 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:38.701+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:39.321+0000 7f2aabfff640 10 monclient: get_auth_request con 0x55e22a0b20e0 auth_method 0 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:39.342+0000 7f2aa8ff9640 10 client.4742.objecter ms_handle_connect 0x55e22a0b20e0 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:39.746+0000 7f2a937fe640 10 monclient: tick 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:39.746+0000 7f2a937fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:39.746+0000 7f2a937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:41.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:39.746+0000 7f2a937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.746+0000 7f2a937fe640 10 monclient: tick 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.746+0000 7f2a937fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.746+0000 7f2a937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 1 ==== osd_map(32..32 src has 1..32) ==== 4755+0+0 (unknown 295349147 0 0) 0x7f2aa4004430 con 0x55e22a0b20e0 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_map(32..32 src has 1..32) 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map got epochs [32,32] > 31 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map decoding incremental epoch 32 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 10 client.4742.objecter checking op 2 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 20 client.4742.objecter dump_active .. 0 homeless 2026-02-25T15:13:41.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:40.909+0000 7f2aa8ff9640 20 client.4742.objecter 2 34.d3a59201 osd.6 exist [writefull 0~5 in=5b] 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.148+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 2 ==== osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 3325229556 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.148+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 2 ondisk uv 1 in 34.1 attempt 0 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 2 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aabfff640 15 client.4742.objecter _finish_op 2 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 2 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 librados: Objecter returned from writefull r=0 2026-02-25T15:13:41.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b2db0 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.4 of [6,4] 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 3 osd.4 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 4 3 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 15 client.4742.objecter _send_op 3 to 34.1 on osd.4 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.78:6805/2928350245 -- osd_op(unknown.0.0:3 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b6a60 con 0x55e22a0b3770 2026-02-25T15:13:41.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b6f70 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 4 osd.6 2026-02-25T15:13:41.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.228 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 4 2026-02-25T15:13:41.228 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 15 client.4742.objecter _send_op 4 to 34.1 on osd.6 2026-02-25T15:13:41.228 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:4 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b7420 con 0x55e22a0b20e0 2026-02-25T15:13:41.228 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.228 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.228 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.149+0000 7f2aab7fe640 10 monclient: get_auth_request con 0x55e22a0b3770 auth_method 0 2026-02-25T15:13:41.228 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.150+0000 7f2aa8ff9640 10 client.4742.objecter ms_handle_connect 0x55e22a0b3770 2026-02-25T15:13:41.228 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 <== osd.4 v1:10.20.193.78:6805/2928350245 1 ==== osd_op_reply(3 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2661884003 0 0) 0x7f2a9c002ad0 con 0x55e22a0b3770 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(3 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 7 client.4742.objecter handle_osd_op_reply 3 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 7 client.4742.objecter got -EAGAIN, resubmitting 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 15 client.4742.objecter _session_op_remove 4 3 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 10 client.4742.objecter _op_submit op 0x55e22a0b2db0 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.229 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 5 osd.6 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 15 client.4742.objecter _session_op_assign 6 5 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 15 client.4742.objecter _send_op 5 to 34.1 on osd.6 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:5 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b6a60 con 0x55e22a0b20e0 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.174+0000 7f2aab7fe640 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1406129365 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 4 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.230 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 4 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 15 client.4742.objecter _finish_op 4 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 4 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 1892243269 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 5 ondisk uv 1 in 34.1 attempt 1 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 5 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 15 client.4742.objecter _finish_op 5 2026-02-25T15:13:41.231 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 5 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (76 ms) 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b2db0 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.232 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 6 osd.6 2026-02-25T15:13:41.249 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.249 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 6 2026-02-25T15:13:41.249 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 15 client.4742.objecter _send_op 6 to 34.1 on osd.6 2026-02-25T15:13:41.249 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:6 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b6f50 con 0x55e22a0b20e0 2026-02-25T15:13:41.249 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.249 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.249 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b78f0 2026-02-25T15:13:41.249 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 7 osd.6 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 7 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 15 client.4742.objecter _send_op 7 to 34.1 on osd.6 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:7 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b7da0 con 0x55e22a0b20e0 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.225+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 5 ==== osd_op_reply(6 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 3289653260 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.250 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(6 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 6 ondisk uv 1 in 34.1 attempt 0 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 6 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 15 client.4742.objecter _finish_op 6 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 6 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 6 ==== osd_op_reply(7 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1406129365 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(7 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.251 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 7 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 7 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 15 client.4742.objecter _finish_op 7 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 7 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (21 ms) 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b78f0 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.252 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 8 osd.6 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 8 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 15 client.4742.objecter _send_op 8 to 34.1 on osd.6 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:8 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b2db0 con 0x55e22a0b20e0 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.253 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83c0 2026-02-25T15:13:41.261 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 9 osd.6 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 9 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 15 client.4742.objecter _send_op 9 to 34.1 on osd.6 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:9 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b8870 con 0x55e22a0b20e0 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.262 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.246+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 7 ==== osd_op_reply(8 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 3289653260 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(8 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 8 ondisk uv 1 in 34.1 attempt 0 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 8 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 15 client.4742.objecter _finish_op 8 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 8 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 8 ==== osd_op_reply(9 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1406129365 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.263 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(9 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 9 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 9 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 15 client.4742.objecter _finish_op 9 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 9 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (12 ms) 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.264 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 10 osd.6 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 10 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 15 client.4742.objecter _send_op 10 to 34.1 on osd.6 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:10 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b7a00 con 0x55e22a0b20e0 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.265 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b8ef0 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.4 of [6,4] 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 11 osd.4 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.266 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 4 11 2026-02-25T15:13:41.267 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 15 client.4742.objecter _send_op 11 to 34.1 on osd.4 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.78:6805/2928350245 -- osd_op(unknown.0.0:11 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b93a0 con 0x55e22a0b3770 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.259+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 9 ==== osd_op_reply(10 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 3289653260 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(10 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 10 ondisk uv 1 in 34.1 attempt 0 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 10 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 15 client.4742.objecter _finish_op 10 2026-02-25T15:13:41.268 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 10 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.263+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 <== osd.4 v1:10.20.193.78:6805/2928350245 2 ==== osd_op_reply(11 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1406129365 0 0) 0x7f2a9c002ad0 con 0x55e22a0b3770 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(11 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 7 client.4742.objecter handle_osd_op_reply 11 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 15 client.4742.objecter handle_osd_op_reply completed tid 11 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 15 client.4742.objecter _finish_op 11 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.269 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 15 client.4742.objecter _session_op_remove 4 11 2026-02-25T15:13:41.270 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2aab7fe640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.270 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (5 ms) 2026-02-25T15:13:41.270 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-25T15:13:41.270 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.270 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.275 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.275 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.275 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.275 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.275 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 12 osd.6 2026-02-25T15:13:41.275 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.275 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 12 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 15 client.4742.objecter _send_op 12 to 34.1 on osd.6 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:12 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b9000 con 0x55e22a0b20e0 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b9870 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 13 osd.6 2026-02-25T15:13:41.276 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 13 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 15 client.4742.objecter _send_op 13 to 34.1 on osd.6 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:13 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b9d20 con 0x55e22a0b20e0 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.265+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 10 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 3289653260 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 12 ondisk uv 1 in 34.1 attempt 0 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 12 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 15 client.4742.objecter _finish_op 12 2026-02-25T15:13:41.277 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 12 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 11 ==== osd_op_reply(13 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1406129365 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(13 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 13 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 13 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 15 client.4742.objecter _finish_op 13 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 13 2026-02-25T15:13:41.278 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (7 ms) 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0b9000 write_seq 1 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 14 osd.6 2026-02-25T15:13:41.279 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.298 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 14 2026-02-25T15:13:41.298 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 15 client.4742.objecter _send_op 14 to 34.1 on osd.6 2026-02-25T15:13:41.298 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:14 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b9850 con 0x55e22a0b20e0 2026-02-25T15:13:41.298 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.298 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.272+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 12 ==== osd_op_reply(14 exist [write 0~5] v32'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 3330573084 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(14 exist [write 0~5] v32'2 uv2 ondisk = 0) 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 14 ondisk uv 2 in 34.1 attempt 0 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 14 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 15 client.4742.objecter _finish_op 14 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 14 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.299 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0b9000 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (23 ms) 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0b9c10 write_seq 2 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 15 osd.6 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.300 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 15 2026-02-25T15:13:41.301 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 15 client.4742.objecter _send_op 15 to 34.1 on osd.6 2026-02-25T15:13:41.348 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:15 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b9850 con 0x55e22a0b20e0 2026-02-25T15:13:41.348 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.348 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.296+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 13 ==== osd_op_reply(15 exist [write 0~5] v32'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 2986621128 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(15 exist [write 0~5] v32'3 uv3 ondisk = 0) 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 15 ondisk uv 3 in 34.1 attempt 0 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 15 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 15 client.4742.objecter _finish_op 15 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 15 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (49 ms) 2026-02-25T15:13:41.349 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0b9c10 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0b9150 write_seq 3 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 16 osd.6 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.350 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 16 2026-02-25T15:13:41.351 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 15 client.4742.objecter _send_op 16 to 34.1 on osd.6 2026-02-25T15:13:41.589 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:16 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0b9850 con 0x55e22a0b20e0 2026-02-25T15:13:41.589 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.589 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.589 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.346+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:13:41.589 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 14 ==== osd_op_reply(16 exist [write 0~5] v32'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 4167789845 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.589 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(16 exist [write 0~5] v32'4 uv4 ondisk = 0) 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 16 ondisk uv 4 in 34.1 attempt 0 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 16 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 15 client.4742.objecter _finish_op 16 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 16 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0b9150 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (240 ms) 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-25T15:13:41.590 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0b9d40 write_seq 4 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 17 osd.6 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 17 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 15 client.4742.objecter _send_op 17 to 34.1 on osd.6 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:17 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0c14c0 con 0x55e22a0b20e0 2026-02-25T15:13:41.591 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.685 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.685 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.586+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 15 ==== osd_op_reply(17 exist [write 0~5] v32'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 2364266177 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(17 exist [write 0~5] v32'5 uv5 ondisk = 0) 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 17 ondisk uv 5 in 34.1 attempt 0 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 17 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 15 client.4742.objecter _finish_op 17 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (38 ms) 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-25T15:13:41.686 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 17 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0b9d40 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0c1880 write_seq 5 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 18 osd.6 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 18 2026-02-25T15:13:41.687 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 15 client.4742.objecter _send_op 18 to 34.1 on osd.6 2026-02-25T15:13:41.688 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:18 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e22a0c19b0 con 0x55e22a0b20e0 2026-02-25T15:13:41.688 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.688 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.688 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.625+0000 7f2ab23c5880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:13:41.750 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 16 ==== osd_map(33..33 src has 1..33) ==== 4110+0+0 (unknown 2660134662 0 0) 0x7f2aa4004a40 con 0x55e22a0b20e0 2026-02-25T15:13:41.750 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_map(33..33 src has 1..33) 2026-02-25T15:13:41.750 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map got epochs [33,33] > 32 2026-02-25T15:13:41.750 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 3 client.4742.objecter handle_osd_map decoding incremental epoch 33 2026-02-25T15:13:41.750 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 10 client.4742.objecter checking op 18 2026-02-25T15:13:41.750 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 20 client.4742.objecter dump_active .. 0 homeless 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.683+0000 7f2aa8ff9640 20 client.4742.objecter 18 34.d3a59201 osd.6 exist [write 0~5 in=5b] 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.746+0000 7f2a937fe640 10 monclient: tick 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.746+0000 7f2a937fe640 10 monclient: _check_auth_tickets 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.746+0000 7f2a937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 17 ==== osd_op_reply(18 exist [write 0~5] v33'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 3573343699 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(18 exist [write 0~5] v33'6 uv6 ondisk = 0) 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 18 ondisk uv 6 in 34.1 attempt 0 2026-02-25T15:13:41.751 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 18 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 15 client.4742.objecter _finish_op 18 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 18 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0c1880 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (122 ms) 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.752 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.753 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.753 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.4 of [6,4] 2026-02-25T15:13:41.757 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.757 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 19 osd.4 2026-02-25T15:13:41.757 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.757 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 4 19 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 15 client.4742.objecter _send_op 19 to 34.1 on osd.4 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.78:6805/2928350245 -- osd_op(unknown.0.0:19 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c19b0 con 0x55e22a0b3770 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c1e10 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 20 osd.6 2026-02-25T15:13:41.758 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 20 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 15 client.4742.objecter _send_op 20 to 34.1 on osd.6 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:20 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c22c0 con 0x55e22a0b20e0 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.747+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 18 ==== osd_op_reply(20 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3091462471 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(20 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 20 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.759 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 20 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 15 client.4742.objecter _finish_op 20 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 20 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.755+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 <== osd.4 v1:10.20.193.78:6805/2928350245 3 ==== osd_op_reply(19 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 1965362673 0 0) 0x7f2a9c002ad0 con 0x55e22a0b3770 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(19 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.845 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 7 client.4742.objecter handle_osd_op_reply 19 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 7 client.4742.objecter got -EAGAIN, resubmitting 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 15 client.4742.objecter _session_op_remove 4 19 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 21 osd.6 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 15 client.4742.objecter _session_op_assign 6 21 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 15 client.4742.objecter _send_op 21 to 34.1 on osd.6 2026-02-25T15:13:41.846 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:21 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c19b0 con 0x55e22a0b20e0 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.838+0000 7f2aab7fe640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 19 ==== osd_op_reply(21 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 2965280980 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(21 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 21 ondisk uv 6 in 34.1 attempt 1 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 21 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 15 client.4742.objecter _finish_op 21 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 21 2026-02-25T15:13:41.847 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (94 ms) 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.4 of [6,4] 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 22 osd.4 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 4 22 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 15 client.4742.objecter _send_op 22 to 34.1 on osd.4 2026-02-25T15:13:41.848 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.78:6805/2928350245 -- osd_op(unknown.0.0:22 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c19b0 con 0x55e22a0b3770 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.849 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 23 osd.6 2026-02-25T15:13:41.917 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.917 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 23 2026-02-25T15:13:41.917 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 15 client.4742.objecter _send_op 23 to 34.1 on osd.6 2026-02-25T15:13:41.917 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:23 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1e10 con 0x55e22a0b20e0 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.842+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 20 ==== osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3091462471 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 23 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 23 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 15 client.4742.objecter _finish_op 23 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.918 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 23 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.844+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 <== osd.4 v1:10.20.193.78:6805/2928350245 4 ==== osd_op_reply(22 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 1965362673 0 0) 0x7f2a9c002ad0 con 0x55e22a0b3770 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(22 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 7 client.4742.objecter handle_osd_op_reply 22 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 7 client.4742.objecter got -EAGAIN, resubmitting 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 15 client.4742.objecter _session_op_remove 4 22 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.919 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 24 osd.6 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 15 client.4742.objecter _session_op_assign 6 24 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 15 client.4742.objecter _send_op 24 to 34.1 on osd.6 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:24 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c19b0 con 0x55e22a0b20e0 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.915+0000 7f2aab7fe640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.944 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 21 ==== osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 2965280980 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 24 ondisk uv 6 in 34.1 attempt 1 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 24 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 15 client.4742.objecter _finish_op 24 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 24 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (99 ms) 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-25T15:13:41.945 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.946 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.946 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.946 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.946 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.946 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.946 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 25 osd.6 2026-02-25T15:13:41.958 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.958 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 25 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 15 client.4742.objecter _send_op 25 to 34.1 on osd.6 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:25 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1e10 con 0x55e22a0b20e0 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.959 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 26 osd.6 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 26 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 15 client.4742.objecter _send_op 26 to 34.1 on osd.6 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:26 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c19b0 con 0x55e22a0b20e0 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.941+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 22 ==== osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 73658269 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 25 ondisk uv 6 in 34.1 attempt 0 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.960 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 25 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 15 client.4742.objecter _finish_op 25 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 25 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 23 ==== osd_op_reply(26 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3091462471 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(26 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 26 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 26 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 15 client.4742.objecter _finish_op 26 2026-02-25T15:13:41.961 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 26 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (14 ms) 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 27 osd.6 2026-02-25T15:13:41.962 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.963 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 27 2026-02-25T15:13:41.963 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 15 client.4742.objecter _send_op 27 to 34.1 on osd.6 2026-02-25T15:13:41.963 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:27 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1e10 con 0x55e22a0b20e0 2026-02-25T15:13:41.963 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.963 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.963 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:41.963 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 28 osd.6 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 28 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 15 client.4742.objecter _send_op 28 to 34.1 on osd.6 2026-02-25T15:13:41.993 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:28 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c2250 con 0x55e22a0b20e0 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.956+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.966+0000 7f2ab2108640 10 client.4742.objecter tick 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.966+0000 7f2ab2108640 20 client.4742.objecter tick: elapsed since last osdmap request 3.36493s, stale_window 10s, epoch 34, monc->get_start(osdmap) 0 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 24 ==== osd_op_reply(27 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 73658269 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(27 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 27 ondisk uv 6 in 34.1 attempt 0 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 27 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 15 client.4742.objecter _finish_op 27 2026-02-25T15:13:41.994 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 27 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (34 ms) 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 25 ==== osd_op_reply(28 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3091462471 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(28 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 28 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 28 2026-02-25T15:13:41.995 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 15 client.4742.objecter _finish_op 28 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 28 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.4 of [6,4] 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 29 osd.4 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 4 29 2026-02-25T15:13:41.996 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 15 client.4742.objecter _send_op 29 to 34.1 on osd.4 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.78:6805/2928350245 -- osd_op(unknown.0.0:29 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1e10 con 0x55e22a0b3770 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:41.997 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 30 osd.6 2026-02-25T15:13:42.008 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.008 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 30 2026-02-25T15:13:42.008 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 15 client.4742.objecter _send_op 30 to 34.1 on osd.6 2026-02-25T15:13:42.008 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:30 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c2250 con 0x55e22a0b20e0 2026-02-25T15:13:42.008 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.008 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.990+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 <== osd.4 v1:10.20.193.78:6805/2928350245 5 ==== osd_op_reply(29 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 1965362673 0 0) 0x7f2a9c002ad0 con 0x55e22a0b3770 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(29 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 7 client.4742.objecter handle_osd_op_reply 29 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 7 client.4742.objecter got -EAGAIN, resubmitting 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 15 client.4742.objecter _session_op_remove 4 29 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.009 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 10 client.4742.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 31 osd.6 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 15 client.4742.objecter _session_op_assign 6 31 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 15 client.4742.objecter _send_op 31 to 34.1 on osd.6 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:31 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1e10 con 0x55e22a0b20e0 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:41.992+0000 7f2aab7fe640 5 client.4742.objecter 2 in flight 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.005+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 26 ==== osd_op_reply(30 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3091462471 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(30 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 30 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:42.010 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 30 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 15 client.4742.objecter _finish_op 30 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 30 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 27 ==== osd_op_reply(31 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 2965280980 0 3741568377) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(31 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 31 ondisk uv 6 in 34.1 attempt 1 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 5 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 31 2026-02-25T15:13:42.011 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 15 client.4742.objecter _finish_op 31 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 31 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (15 ms) 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0c1630 write_seq 6 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.012 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 32 osd.6 2026-02-25T15:13:42.027 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.027 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 32 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 15 client.4742.objecter _send_op 32 to 34.1 on osd.6 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:32 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c2250 con 0x55e22a0b20e0 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.006+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 28 ==== osd_op_reply(32 exist [writefull 0~5] v33'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 1028384915 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(32 exist [writefull 0~5] v33'7 uv7 ondisk = 0) 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 32 ondisk uv 7 in 34.1 attempt 0 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 32 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 15 client.4742.objecter _finish_op 32 2026-02-25T15:13:42.028 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (19 ms) 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 32 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0c1630 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0b9d40 write_seq 7 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 33 osd.6 2026-02-25T15:13:42.029 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.030 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 33 2026-02-25T15:13:42.030 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 15 client.4742.objecter _send_op 33 to 34.1 on osd.6 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:33 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1e10 con 0x55e22a0b20e0 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.025+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 29 ==== osd_op_reply(33 exist [writefull 0~5] v33'8 uv8 ondisk = 0) ==== 149+0+0 (unknown 3709204733 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(33 exist [writefull 0~5] v33'8 uv8 ondisk = 0) 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 33 ondisk uv 8 in 34.1 attempt 0 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.069 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 33 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 15 client.4742.objecter _finish_op 33 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (29 ms) 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 33 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0b9d40 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0c1630 write_seq 8 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.070 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.071 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.071 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 34 osd.6 2026-02-25T15:13:42.071 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.071 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 34 2026-02-25T15:13:42.071 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 15 client.4742.objecter _send_op 34 to 34.1 on osd.6 2026-02-25T15:13:42.071 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:34 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1dc0 con 0x55e22a0b20e0 2026-02-25T15:13:42.071 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.071 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.054+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.082 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 30 ==== osd_op_reply(34 exist [writefull 0~5] v33'9 uv9 ondisk = 0) ==== 149+0+0 (unknown 2845131561 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.082 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(34 exist [writefull 0~5] v33'9 uv9 ondisk = 0) 2026-02-25T15:13:42.082 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 34 ondisk uv 9 in 34.1 attempt 0 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 34 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 15 client.4742.objecter _finish_op 34 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 34 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0c1630 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (12 ms) 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0c1a90 write_seq 9 2026-02-25T15:13:42.083 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 35 osd.6 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 35 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 15 client.4742.objecter _send_op 35 to 34.1 on osd.6 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:35 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1dc0 con 0x55e22a0b20e0 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.066+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.084 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 31 ==== osd_op_reply(35 exist [writefull 0~5] v33'10 uv10 ondisk = 0) ==== 149+0+0 (unknown 873762645 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.085 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(35 exist [writefull 0~5] v33'10 uv10 ondisk = 0) 2026-02-25T15:13:42.095 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.095 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 35 ondisk uv 10 in 34.1 attempt 0 2026-02-25T15:13:42.095 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.095 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 35 2026-02-25T15:13:42.095 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 15 client.4742.objecter _finish_op 35 2026-02-25T15:13:42.095 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.095 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 35 2026-02-25T15:13:42.095 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0c1a90 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (13 ms) 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e22a0c1630 write_seq 10 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0c26b0 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 36 osd.6 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 36 2026-02-25T15:13:42.096 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 15 client.4742.objecter _send_op 36 to 34.1 on osd.6 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:36 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1dc0 con 0x55e22a0b20e0 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.080+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 32 ==== osd_op_reply(36 exist [writefull 0~5] v33'11 uv11 ondisk = 0) ==== 149+0+0 (unknown 1083454593 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(36 exist [writefull 0~5] v33'11 uv11 ondisk = 0) 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 36 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 36 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 15 client.4742.objecter _finish_op 36 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.097 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 36 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e22a0c1630 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (12 ms) 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e22a0c26b0 linger_id 1 cookie 94429856409264 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 1 2026-02-25T15:13:42.098 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 15 client.4742.objecter send_linger 1 register 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [notify cookie 94429856409264 in=17b] tid 37 osd.6 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 37 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 15 client.4742.objecter _send_op 37 to 34.1 on osd.6 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:37 34.1 34:8049a5cb:::exist:head [notify cookie 94429856409264 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1da0 con 0x55e22a0b20e0 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.099 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e229ff45e0 linger_id 2 cookie 94429855565280 2026-02-25T15:13:42.100 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.107 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.107 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.107 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 2 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 15 client.4742.objecter send_linger 2 register 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e229ff5a20 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94429855565280 in=17b] tid 38 osd.6 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 38 2026-02-25T15:13:42.108 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 15 client.4742.objecter _send_op 38 to 34.1 on osd.6 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:38 34.1 34:855dde50:::noexist:head [notify cookie 94429855565280 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e229ff5ed0 con 0x55e22a0b20e0 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.093+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.104+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 33 ==== watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920768 ret 0) ==== 42+0+8 (unknown 3930507590 0 0) 0x7f2aa4009020 con 0x55e22a0b20e0 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.104+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920768 ret 0) 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.104+0000 7f2aa9ffb640 10 librados: operator() completed notify (linger op 0x55e22a0c26b0), ec = system:0 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 34 ==== osd_op_reply(37 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1040702356 0 174112307) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(37 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.109 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 37 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:13:42.110 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 8 2026-02-25T15:13:42.110 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 37 2026-02-25T15:13:42.110 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 15 client.4742.objecter _finish_op 37 2026-02-25T15:13:42.110 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.110 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 37 2026-02-25T15:13:42.110 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.110 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aa97fa640 10 client.4742.objecter _linger_commit 1 2026-02-25T15:13:42.110 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aa97fa640 10 client.4742.objecter _linger_commit notify_id=141733920768 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aa97fa640 10 librados: finish linger op 0x55e22a0c26b0 acked (0) 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aa97fa640 20 client.4742.objecter _linger_cancel linger_id=1 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aa97fa640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.105+0000 7f2aa97fa640 15 client.4742.objecter _session_linger_op_remove 6 1 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 35 ==== osd_op_reply(38 noexist [notify cookie 94429855565280] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1499183825 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(38 noexist [notify cookie 94429855565280] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 38 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 38 2026-02-25T15:13:42.111 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 15 client.4742.objecter _finish_op 38 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 38 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aa9ffb640 10 client.4742.objecter _linger_commit 2 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aa9ffb640 10 librados: finish linger op 0x55e229ff45e0 acked (-2) 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aa97fa640 10 librados: operator() completed notify (linger op 0x55e229ff45e0), ec = osd:2 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aa97fa640 20 client.4742.objecter _linger_cancel linger_id=2 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aa97fa640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2aa97fa640 15 client.4742.objecter _session_linger_op_remove 6 2 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (14 ms) 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e22a0c26b0 linger_id 3 cookie 94429856409264 2026-02-25T15:13:42.112 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 3 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 15 client.4742.objecter send_linger 3 register 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [notify cookie 94429856409264 in=17b] tid 39 osd.6 2026-02-25T15:13:42.113 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 39 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 15 client.4742.objecter _send_op 39 to 34.1 on osd.6 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:39 34.1 34:8049a5cb:::exist:head [notify cookie 94429856409264 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1da0 con 0x55e22a0b20e0 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e229ff55f0 linger_id 4 cookie 94429855569392 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.114 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 4 2026-02-25T15:13:42.115 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.115 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 15 client.4742.objecter send_linger 4 register 2026-02-25T15:13:42.120 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e229ff6a30 2026-02-25T15:13:42.120 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.120 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.120 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.120 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94429855569392 in=17b] tid 40 osd.6 2026-02-25T15:13:42.120 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.120 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 40 2026-02-25T15:13:42.120 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 15 client.4742.objecter _send_op 40 to 34.1 on osd.6 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:40 34.1 34:855dde50:::noexist:head [notify cookie 94429855569392 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e229ff6fa0 con 0x55e22a0b20e0 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.106+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 36 ==== watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920769 ret 0) ==== 42+0+8 (unknown 1342770120 0 0) 0x7f2aa4009020 con 0x55e22a0b20e0 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920769 ret 0) 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 37 ==== osd_op_reply(39 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1040702356 0 1130152724) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(39 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa9ffb640 10 librados: operator() completed notify (linger op 0x55e22a0c26b0), ec = system:0 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 39 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 8 2026-02-25T15:13:42.121 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 39 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 15 client.4742.objecter _finish_op 39 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 39 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa97fa640 10 client.4742.objecter _linger_commit 3 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa97fa640 10 client.4742.objecter _linger_commit notify_id=141733920769 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa97fa640 10 librados: finish linger op 0x55e22a0c26b0 acked (0) 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 38 ==== osd_op_reply(40 noexist [notify cookie 94429855569392] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2847738885 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa97fa640 20 client.4742.objecter _linger_cancel linger_id=3 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa97fa640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa97fa640 15 client.4742.objecter _session_linger_op_remove 6 3 2026-02-25T15:13:42.122 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(40 noexist [notify cookie 94429855569392] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 40 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 40 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 15 client.4742.objecter _finish_op 40 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 40 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (10 ms) 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa9ffb640 10 client.4742.objecter _linger_commit 4 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-25T15:13:42.123 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa9ffb640 10 librados: finish linger op 0x55e229ff55f0 acked (-2) 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa9ffb640 10 librados: operator() completed notify (linger op 0x55e229ff55f0), ec = osd:2 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa9ffb640 20 client.4742.objecter _linger_cancel linger_id=4 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa9ffb640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2aa9ffb640 15 client.4742.objecter _session_linger_op_remove 6 4 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e22a0c26b0 linger_id 5 cookie 94429856409264 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 5 2026-02-25T15:13:42.124 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 15 client.4742.objecter send_linger 5 register 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [notify cookie 94429856409264 in=17b] tid 41 osd.6 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 41 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 15 client.4742.objecter _send_op 41 to 34.1 on osd.6 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:41 34.1 34:8049a5cb:::exist:head [notify cookie 94429856409264 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1da0 con 0x55e22a0b20e0 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.125 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e229ff6fa0 linger_id 6 cookie 94429855575968 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 6 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 15 client.4742.objecter send_linger 6 register 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e229ff55f0 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.126 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.127 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94429855575968 in=17b] tid 42 osd.6 2026-02-25T15:13:42.127 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.127 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 42 2026-02-25T15:13:42.127 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 15 client.4742.objecter _send_op 42 to 34.1 on osd.6 2026-02-25T15:13:42.127 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:42 34.1 34:855dde50:::noexist:head [notify cookie 94429855575968 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e229ff5aa0 con 0x55e22a0b20e0 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.117+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 39 ==== watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920770 ret 0) ==== 42+0+8 (unknown 2603956907 0 0) 0x7f2aa4009020 con 0x55e22a0b20e0 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920770 ret 0) 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aa97fa640 10 librados: operator() completed notify (linger op 0x55e22a0c26b0), ec = system:0 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 40 ==== osd_op_reply(41 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1040702356 0 2551727229) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(41 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 41 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 8 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 41 2026-02-25T15:13:42.128 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 15 client.4742.objecter _finish_op 41 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 41 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aa9ffb640 10 client.4742.objecter _linger_commit 5 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aa9ffb640 10 client.4742.objecter _linger_commit notify_id=141733920770 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aa9ffb640 10 librados: finish linger op 0x55e22a0c26b0 acked (0) 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aa9ffb640 20 client.4742.objecter _linger_cancel linger_id=5 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aa9ffb640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.120+0000 7f2aa9ffb640 15 client.4742.objecter _session_linger_op_remove 6 5 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 41 ==== osd_op_reply(42 noexist [notify cookie 94429855575968] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3241844584 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(42 noexist [notify cookie 94429855575968] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.129 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 42 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 42 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 15 client.4742.objecter _finish_op 42 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 42 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aa97fa640 10 client.4742.objecter _linger_commit 6 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aa97fa640 10 librados: finish linger op 0x55e229ff6fa0 acked (-2) 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aa97fa640 10 librados: operator() completed notify (linger op 0x55e229ff6fa0), ec = osd:2 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aa97fa640 20 client.4742.objecter _linger_cancel linger_id=6 2026-02-25T15:13:42.130 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aa97fa640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2aa97fa640 15 client.4742.objecter _session_linger_op_remove 6 6 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (4 ms) 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e22a0c26b0 linger_id 7 cookie 94429856409264 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 7 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 15 client.4742.objecter send_linger 7 register 2026-02-25T15:13:42.131 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.132 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.132 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.132 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.132 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [notify cookie 94429856409264 in=17b] tid 43 osd.6 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 43 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 15 client.4742.objecter _send_op 43 to 34.1 on osd.6 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:43 34.1 34:8049a5cb:::exist:head [notify cookie 94429856409264 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1da0 con 0x55e22a0b20e0 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e229ff6fa0 linger_id 8 cookie 94429855575968 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.133 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 8 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 15 client.4742.objecter send_linger 8 register 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e229ff55f0 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94429855575968 in=17b] tid 44 osd.6 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 44 2026-02-25T15:13:42.134 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 15 client.4742.objecter _send_op 44 to 34.1 on osd.6 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:44 34.1 34:855dde50:::noexist:head [notify cookie 94429855575968 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1da0 con 0x55e22a0b20e0 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.122+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 42 ==== watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920771 ret 0) ==== 42+0+8 (unknown 561707045 0 0) 0x7f2aa4009020 con 0x55e22a0b20e0 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920771 ret 0) 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 43 ==== osd_op_reply(43 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1040702356 0 3508812122) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(43 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa9ffb640 10 librados: operator() completed notify (linger op 0x55e22a0c26b0), ec = system:0 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 43 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 8 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 43 2026-02-25T15:13:42.135 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 15 client.4742.objecter _finish_op 43 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 43 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa97fa640 10 client.4742.objecter _linger_commit 7 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 44 ==== osd_op_reply(44 noexist [notify cookie 94429855575968] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3241844584 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa97fa640 10 client.4742.objecter _linger_commit notify_id=141733920771 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa97fa640 10 librados: finish linger op 0x55e22a0c26b0 acked (0) 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(44 noexist [notify cookie 94429855575968] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa97fa640 20 client.4742.objecter _linger_cancel linger_id=7 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa97fa640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.136 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa97fa640 15 client.4742.objecter _session_linger_op_remove 6 7 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 44 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 44 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 15 client.4742.objecter _finish_op 44 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 44 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa9ffb640 10 client.4742.objecter _linger_commit 8 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa9ffb640 10 librados: finish linger op 0x55e229ff6fa0 acked (-2) 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa9ffb640 10 librados: operator() completed notify (linger op 0x55e229ff6fa0), ec = osd:2 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa9ffb640 20 client.4742.objecter _linger_cancel linger_id=8 2026-02-25T15:13:42.137 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (4 ms) 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa9ffb640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2aa9ffb640 15 client.4742.objecter _session_linger_op_remove 6 8 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e22a0c26b0 linger_id 9 cookie 94429856409264 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 9 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.138 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 15 client.4742.objecter send_linger 9 register 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid exist '@34' '@34' [notify cookie 94429856409264 in=17b] tid 45 osd.6 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 45 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 15 client.4742.objecter _send_op 45 to 34.1 on osd.6 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:45 34.1 34:8049a5cb:::exist:head [notify cookie 94429856409264 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1da0 con 0x55e22a0b20e0 2026-02-25T15:13:42.139 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 10 client.4742.objecter linger_register info 0x55e229ff45e0 linger_id 10 cookie 94429855565280 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 5 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 15 client.4742.objecter _session_linger_op_assign 6 10 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 15 client.4742.objecter send_linger 10 register 2026-02-25T15:13:42.150 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e229ff5a20 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94429855565280 in=17b] tid 46 osd.6 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 46 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 15 client.4742.objecter _send_op 46 to 34.1 on osd.6 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:46 34.1 34:855dde50:::noexist:head [notify cookie 94429855565280 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e229ff5ed0 con 0x55e22a0b20e0 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.126+0000 7f2ab23c5880 5 client.4742.objecter 2 in flight 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 45 ==== watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920772 ret 0) ==== 42+0+8 (unknown 144780956 0 0) 0x7f2aa4009020 con 0x55e22a0b20e0 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 watch-notify(notify_complete (2) cookie 94429856409264 notify 141733920772 ret 0) 2026-02-25T15:13:42.151 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 46 ==== osd_op_reply(45 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1040702356 0 729627742) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa97fa640 10 librados: operator() completed notify (linger op 0x55e22a0c26b0), ec = system:0 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(45 exist [notify cookie 94429856409264 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 45 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 8 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 45 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 15 client.4742.objecter _finish_op 45 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 7 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 45 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 47 ==== osd_op_reply(46 noexist [notify cookie 94429855565280] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1499183825 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 10 client.4742.objecter _linger_commit 9 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(46 noexist [notify cookie 94429855565280] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.152 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 10 client.4742.objecter _linger_commit notify_id=141733920772 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 46 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 10 client.4742.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 46 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 15 client.4742.objecter _finish_op 46 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 6 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 46 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 10 librados: finish linger op 0x55e22a0c26b0 acked (0) 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 10 client.4742.objecter _linger_commit 10 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa97fa640 20 client.4742.objecter _linger_cancel linger_id=9 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa97fa640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa97fa640 15 client.4742.objecter _session_linger_op_remove 6 9 2026-02-25T15:13:42.153 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 10 librados: finish linger op 0x55e229ff45e0 acked (-2) 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 10 librados: operator() completed notify (linger op 0x55e229ff45e0), ec = osd:2 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 20 client.4742.objecter _linger_cancel linger_id=10 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2aa9ffb640 15 client.4742.objecter _session_linger_op_remove 6 10 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (21 ms) 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.4 of [6,4] 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:42.154 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [stat] tid 47 osd.4 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 4 47 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _send_op 47 to 34.1 on osd.4 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.78:6805/2928350245 -- osd_op(unknown.0.0:47 34.1 34:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c1da0 con 0x55e22a0b3770 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 4 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 5 client.4742.objecter _op_cancel: cancelling tid 47 r=-125 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter op_cancel tid 47 in session 4 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _finish_op 47 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 3 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _session_op_remove 4 47 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.155 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter chose random osd.6 of [6,4] 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [stat] tid 48 osd.6 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 48 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _send_op 48 to 34.1 on osd.6 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:48 34.1 34:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c26b0 con 0x55e22a0b20e0 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.156 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 5 client.4742.objecter _op_cancel: cancelling tid 48 r=-125 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter op_cancel tid 48 in session 6 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _finish_op 48 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _session_op_remove 6 48 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e229ff6fa0 write_seq 11 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [stat] tid 49 osd.6 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-25T15:13:42.157 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 49 2026-02-25T15:13:42.158 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-25T15:13:42.158 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _send_op 49 to 34.1 on osd.6 2026-02-25T15:13:42.158 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:49 34.1 34:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c26b0 con 0x55e22a0b20e0 2026-02-25T15:13:42.158 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.158 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.158 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 5 client.4742.objecter _op_cancel: cancelling tid 49 r=-125 2026-02-25T15:13:42.158 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter op_cancel tid 49 in session 6 2026-02-25T15:13:42.158 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 librados: complete_aio_write 0x55e229ff6fa0 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _finish_op 49 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _session_op_remove 6 49 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 librados: queue_aio_write 0x55e229f4a390 completion 0x55e229ff6fa0 write_seq 12 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _op_submit op 0x55e22a0b83a0 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [6,4] primary 6 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter _get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 10 client.4742.objecter _op_submit oid noexist '@34' '@34' [stat] tid 50 osd.6 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter get_session s=0x55e22a09dca0 osd=6 3 2026-02-25T15:13:42.159 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _session_op_assign 6 50 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 15 client.4742.objecter _send_op 50 to 34.1 on osd.6 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 --> v1:10.20.193.167:6812/762620751 -- osd_op(unknown.0.0:50 34.1 34:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e22a0c26b0 con 0x55e22a0b20e0 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.147+0000 7f2ab23c5880 5 client.4742.objecter 1 in flight 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.150+0000 7f2aab7fe640 1 -- 10.20.193.174:0/518169719 <== osd.4 v1:10.20.193.78:6805/2928350245 6 ==== osd_op_reply(47 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 628379603 0 0) 0x7f2a9c002ad0 con 0x55e22a0b3770 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.150+0000 7f2aab7fe640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(47 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.150+0000 7f2aab7fe640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.150+0000 7f2aab7fe640 7 client.4742.objecter handle_osd_op_reply 47 ondisk ... stray 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 48 ==== osd_op_reply(48 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 628379603 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(48 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 48 ondisk ... stray 2026-02-25T15:13:42.160 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 49 ==== osd_op_reply(49 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2950153110 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(49 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 49 ondisk ... stray 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 <== osd.6 v1:10.20.193.167:6812/762620751 50 ==== osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2950153110 0 0) 0x7f2aa4004730 con 0x55e22a0b20e0 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 10 client.4742.objecter ms_dispatch2 0x55e229f66590 osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 10 client.4742.objecter in handle_osd_op_reply 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 7 client.4742.objecter handle_osd_op_reply 50 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 10 client.4742.objecter op 0 rval 0 len 0 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 15 client.4742.objecter handle_osd_op_reply completed tid 50 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 15 client.4742.objecter _finish_op 50 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 4 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 15 client.4742.objecter _session_op_remove 6 50 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 5 client.4742.objecter 0 in flight 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 20 librados: complete_aio_write 0x55e229ff6fa0 2026-02-25T15:13:42.161 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (7 ms) 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 10 librados: watch_flush enter 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 10 librados: watch_flush exit 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 10 client.4742.objecter close_session for osd.4 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 >> v1:10.20.193.78:6805/2928350245 conn(0x55e22a0b3770 legacy=0x55e22a0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09d880 osd=4 1 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 10 client.4742.objecter close_session for osd.6 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 >> v1:10.20.193.167:6812/762620751 conn(0x55e22a0b20e0 legacy=0x55e22a0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 20 client.4742.objecter put_session s=0x55e22a09dca0 osd=6 1 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 20 client.4742.objecter shutdown clearing up homeless session... 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 10 client.4742.objecter successfully canceled tick 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 >> v1:10.20.193.78:6800/3497602169 conn(0x7f2a98076b10 legacy=0x7f2a98096fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 10 monclient: shutdown 2026-02-25T15:13:42.162 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 >> v1:10.20.193.167:6789/0 conn(0x55e22a0c2b90 legacy=0x55e22a0e2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2aabfff640 1 -- 10.20.193.174:0/518169719 reap_dead start 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 shutdown_connections 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 >> 10.20.193.174:0/518169719 conn(0x55e229ff1a70 msgr2=0x55e22a104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 shutdown_connections 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 -- 10.20.193.174:0/518169719 wait complete. 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.155+0000 7f2ab23c5880 1 librados: shutdown 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [----------] 29 tests from AsioRados (1006 ms total) 2026-02-25T15:13:42.163 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: 2026-02-25T15:13:42.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [----------] Global test environment tear-down 2026-02-25T15:13:42.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (5538 ms total) 2026-02-25T15:13:42.164 INFO:tasks.workunit.client.0.trial174.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-25T15:13:42.164 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:13:42.164 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47909 2026-02-25T15:13:42.164 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47909 2026-02-25T15:13:43.472 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: Running main() from gmock_main.cc 2026-02-25T15:13:43.472 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-25T15:13:43.472 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [----------] Global test environment set-up. 2026-02-25T15:13:43.472 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-25T15:13:43.472 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-25T15:13:43.472 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (6836 ms) 2026-02-25T15:13:43.472 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [----------] 1 test from neocls_handler_error (6836 ms total) 2026-02-25T15:13:43.473 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: 2026-02-25T15:13:43.473 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [----------] Global test environment tear-down 2026-02-25T15:13:43.473 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [==========] 1 test from 1 test suite ran. (6836 ms total) 2026-02-25T15:13:43.473 INFO:tasks.workunit.client.0.trial174.stdout: handler_error: [ PASSED ] 1 test. 2026-02-25T15:13:43.516 INFO:tasks.workunit.client.0.trial174.stdout: cls: Running main() from gmock_main.cc 2026-02-25T15:13:43.516 INFO:tasks.workunit.client.0.trial174.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: [----------] Global test environment set-up. 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: [ OK ] NeoRadosCls.DNE (6884 ms) 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: [----------] 1 test from NeoRadosCls (6884 ms total) 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: [----------] Global test environment tear-down 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: [==========] 1 test from 1 test suite ran. (6884 ms total) 2026-02-25T15:13:43.517 INFO:tasks.workunit.client.0.trial174.stdout: cls: [ PASSED ] 1 test. 2026-02-25T15:13:44.606 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-25T15:13:44.606 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-25T15:13:44.606 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (598 ms) 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (87 ms) 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (7311 ms) 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (7997 ms total) 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-25T15:13:44.607 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (7997 ms total) 2026-02-25T15:13:44.608 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-25T15:13:45.030 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (460 ms) 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (36 ms) 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (7507 ms) 2026-02-25T15:13:45.031 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:41.668486+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/2235029554' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial174-48029-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:41.670298+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/1459708527' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial174-47812-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:41.674234+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/1250489368' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_trial174-47791-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:42.540078+0000 mon.a [INF] from='client.4870 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial174-48029-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:42.547302+0000 mon.a [INF] from='client.4879 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial174-47812-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:42.549501+0000 mon.a [INF] from='client.4876 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_trial174-47791-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.306675+0000 mon.a [INF] from='client.4870 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial174-48029-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.308241+0000 mon.a [INF] from='client.4879 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial174-47812-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.309216+0000 mon.a [INF] from='client.4876 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_trial174-47791-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.414228+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/2649715473' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial174-48674-1"} : dispatch 2026-02-25T15:13:45.032 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.451586+0000 mon.a [INF] from='client.4787 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial174-48674-1"} : dispatch 2026-02-25T15:13:45.033 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.456616+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/1358049877' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial174-48133-7"} : dispatch 2026-02-25T15:13:48.069 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.466396+0000 mon.a [INF] from='client.4943 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial174-48133-7"} : dispatch 2026-02-25T15:13:48.069 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.495765+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/1358049877' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial174-48133-7"} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.507157+0000 mon.a [INF] from='client.4943 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial174-48133-7"} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.516848+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/3932193966' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial174-47831-16"} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.531571+0000 mon.a [INF] from='client.4952 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial174-47831-16"} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.539308+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/1358049877' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial174-48133-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.545384+0000 mon.a [INF] from='client.4943 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial174-48133-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.546014+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/3932193966' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial174-47831-16"} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.554465+0000 mon.a [INF] from='client.4952 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial174-47831-16"} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.566521+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/3932193966' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial174-47831-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.571596+0000 mon.a [INF] from='client.4952 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial174-47831-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:13:48.070 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.597281+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/2239311701' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial174-48363-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.606475+0000 mon.a [INF] from='client.4927 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial174-48363-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.637173+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/2828775634' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.651969+0000 client.admin [INF] onexx 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:44.654209+0000 mon.a [INF] from='client.4948 ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.589714+0000 mon.a [INF] from='client.4943 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_trial174-48133-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial174-48133-7"}]': finished 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.591465+0000 mon.a [INF] from='client.4952 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_trial174-47831-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial174-47831-16"}]': finished 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.592654+0000 mon.a [INF] from='client.? v1:10.20.193.174:0/1934932805' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial174-48029-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.593628+0000 mon.a [INF] from='client.5003 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial174-48674-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.594971+0000 mon.a [INF] from='client.4879 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial174-47812-3", "field": "max_bytes", "val": "4096"}]': finished 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.691312+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/3006577359' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial174-48674-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial174-48674-2"} : dispatch 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.721470+0000 mon.a [INF] from='client.5003 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial174-48674-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial174-48674-2"} : dispatch 2026-02-25T15:13:48.071 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.725658+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/525747265' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial174-47791-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.728751+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/1079635397' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial174-48727-1"} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.841468+0000 mon.a [INF] from='client.5027 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial174-47791-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.846475+0000 mon.a [INF] from='client.4802 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial174-48727-1"} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.871083+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/1557734071' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_trial174-47935-10"} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.884249+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/274578716' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial174-47911-10"} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.900145+0000 mon.a [INF] from='client.5014 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_trial174-47935-10"} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.905761+0000 mon.a [INF] from='client.5020 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial174-47911-10"} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.912954+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/1557734071' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_trial174-47935-10"} : dispatch 2026-02-25T15:13:48.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.915955+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/274578716' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial174-47911-10"} : dispatch 2026-02-25T15:13:48.757 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T api_c_read_operations: Running main() from gmock_main.cc 2026-02-25T15:13:48.757 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-25T15:13:48.757 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-25T15:13:48.757 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (3336 ms) 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (95 ms) 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (383 ms) 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (368 ms) 2026-02-25T15:13:48.758 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (167 ms) 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (245 ms) 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (670 ms) 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (213 ms) 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (48 ms) 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (1480 ms) 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-25T15:13:48.759 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (481 ms) 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (54 ms) 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (208 ms) 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (1095 ms) 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (820 ms) 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (76 ms) 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (9747 ms total) 2026-02-25T15:13:48.760 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: 2026-02-25T15:13:48.761 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-25T15:13:48.761 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (12137 ms total) 2026-02-25T15:13:48.761 INFO:tasks.workunit.client.0.trial174.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-25T15:13:49.072 INFO:tasks.workunit.client.0.trial174.stdout:15:13:47.926033+0000 mon.a [INF] from='client.5014 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_trial174-47935-10"} : dispatch 2026-02-25T15:13:49.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.928761+0000 mon.a [INF] from='client.5020 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial174-47911-10"} : dispatch 2026-02-25T15:13:49.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.937497+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/1557734071' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial174-47935-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:13:49.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.942199+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/274578716' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial174-47911-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:13:49.072 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.942757+0000 mon.a [INF] from='client.5014 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial174-47935-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:47.949525+0000 mon.a [INF] from='client.5020 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial174-47911-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.068562+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/2828775634' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.077253+0000 client.admin [INF] threexx 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.079818+0000 mon.a [INF] from='client.4948 ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.652944+0000 mon.a [INF] from='client.4976 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial174-48162-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial174-48162-7"}]': finished 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.655003+0000 mon.a [INF] from='client.5027 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_trial174-47791-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.657495+0000 mon.a [INF] from='client.4802 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial174-48727-1"}]': finished 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.658932+0000 mon.a [INF] from='client.5014 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial174-47935-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.660188+0000 mon.a [INF] from='client.5020 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial174-47911-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.738714+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/1079635397' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial174-48727-1"} : dispatch 2026-02-25T15:13:49.073 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.748278+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/1557734071' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial174-47935-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial174-47935-10"} : dispatch 2026-02-25T15:13:49.802 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.752745+00 cmd: Running main() from gmock_main.cc 2026-02-25T15:13:49.802 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [----------] Global test environment set-up. 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (3132 ms) 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (4159 ms) 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (5877 ms) 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [----------] 3 tests from NeoRadosCmd (13168 ms total) 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: 2026-02-25T15:13:49.803 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [----------] Global test environment tear-down 2026-02-25T15:13:49.804 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [==========] 3 tests from 1 test suite ran. (13168 ms total) 2026-02-25T15:13:49.804 INFO:tasks.workunit.client.0.trial174.stdout: cmd: [ PASSED ] 3 tests. 2026-02-25T15:13:51.930 INFO:tasks.workunit.client.0.trial174.stdout: pool: Running main() from gmock_main.cc 2026-02-25T15:13:51.930 INFO:tasks.workunit.client.0.trial174.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-25T15:13:51.930 INFO:tasks.workunit.client.0.trial174.stdout: pool: [----------] Global test environment set-up. 2026-02-25T15:13:51.930 INFO:tasks.workunit.client.0.trial174.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-25T15:13:51.930 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-25T15:13:51.930 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ OK ] NeoRadosPools.PoolList (3110 ms) 2026-02-25T15:13:51.930 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-25T15:13:51.930 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (3943 ms) 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (1767 ms) 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2232 ms) 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2095 ms) 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2127 ms) 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [----------] 6 tests from NeoRadosPools (15276 ms total) 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [----------] Global test environment tear-down 2026-02-25T15:13:51.931 INFO:tasks.workunit.client.0.trial174.stdout: pool: [==========] 6 tests from 1 test suite ran. (15276 ms total) 2026-02-25T15:13:51.932 INFO:tasks.workunit.client.0.trial174.stdout: pool: [ PASSED ] 6 tests. 2026-02-25T15:13:52.081 INFO:tasks.workunit.client.0.trial174.stdout:00 mon.c [INF] from='client.? v1:10.20.193.174:0/3230278876' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial174-48208-1"} : dispatch 2026-02-25T15:13:52.081 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.752813+0000 mon.b [INF] from='client.? v1:10.20.193.174:0/274578716' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial174-47911-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial174-47911-10"} : dispatch 2026-02-25T15:13:52.081 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.754437+0000 mon.a [INF] from='client.4802 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial174-48727-1"} : dispatch 2026-02-25T15:13:52.081 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.755793+0000 mon.c [INF] from='client.? v1:10.20.193.174:0/1506554599' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial174-48363-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:52.081 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.784246+0000 mon.a [INF] from='client.5014 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial174-47935-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial174-47935-10"} : dispatch 2026-02-25T15:13:52.081 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.796132+0000 mon.a [INF] from='client.5020 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial174-47911-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial174-47911-10"} : dispatch 2026-02-25T15:13:52.081 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.801839+0000 mon.a [INF] from='client.4724 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial174-48208-1"} : dispatch 2026-02-25T15:13:52.081 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: got: 2026-02-25T15:13:48.804223+0000 mon.a [INF] from='client.5051 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial174-48363-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:13:52.082 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (7474 ms) 2026-02-25T15:13:52.082 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (15478 ms total) 2026-02-25T15:13:52.082 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: 2026-02-25T15:13:52.082 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-25T15:13:52.082 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (15478 ms total) 2026-02-25T15:13:52.082 INFO:tasks.workunit.client.0.trial174.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-25T15:13:52.360 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: Running main() from gmock_main.cc 2026-02-25T15:13:52.360 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-25T15:13:52.360 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [----------] Global test environment set-up. 2026-02-25T15:13:52.360 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-25T15:13:52.360 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-25T15:13:52.360 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStat.Stat (3221 ms) 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (226 ms) 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStat.StatNS (114 ms) 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (388 ms) 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (651 ms) 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [----------] 5 tests from LibRadosStat (4602 ms total) 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-25T15:13:52.361 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (2313 ms) 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (530 ms) 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1 ms) 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (20 ms) 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (2866 ms total) 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [----------] Global test environment tear-down 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (15767 ms total) 2026-02-25T15:13:52.362 INFO:tasks.workunit.client.0.trial174.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-25T15:13:52.428 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:54.207 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:52.434 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:54.213 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:52.467 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:54.207 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:52.472 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:54.212 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:52.475 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:54.252 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:52.480 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:54.258 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:52.537 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:01:54.316 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:52.558 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:01:54.335 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:52.562 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:01:54.302 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:13:53.512 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: Running main() from gmock_main.cc 2026-02-25T15:13:53.512 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: seed 48162 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (2836 ms) 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (1138 ms) 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (230 ms) 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-25T15:13:53.513 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (817 ms) 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (467 ms) 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (5490 ms total) 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1742 ms) 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (29 ms) 2026-02-25T15:13:53.514 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-25T15:13:53.515 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (269 ms) 2026-02-25T15:13:53.515 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (2043 ms total) 2026-02-25T15:13:53.515 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: 2026-02-25T15:13:53.515 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-25T15:13:53.515 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (16914 ms total) 2026-02-25T15:13:53.515 INFO:tasks.workunit.client.0.trial174.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_1_[48574]: starting. 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_1_[48574]: creating pool ceph_test_rados_open_pools_parallel.trial174-48465 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_1_[48574]: created object 0... 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_1_[48574]: created object 25... 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_1_[48574]: created object 49... 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_1_[48574]: finishing. 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_1_[48574]: shutting down. 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_2_[48578]: starting. 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_2_[48578]: rados_pool_create. 2026-02-25T15:13:53.521 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_2_[48578]: rados_ioctx_create. 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_2_[48578]: shutting down. 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: ******************************* 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_3_[49924]: starting. 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_3_[49924]: creating pool ceph_test_rados_open_pools_parallel.trial174-48465 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_3_[49924]: created object 0... 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_3_[49924]: created object 25... 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_3_[49924]: created object 49... 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_3_[49924]: finishing. 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_3_[49924]: shutting down. 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: ******************************* 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_4_[49925]: starting. 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_4_[49925]: rados_pool_create. 2026-02-25T15:13:53.522 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_4_[49925]: rados_ioctx_create. 2026-02-25T15:13:53.523 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: process_4_[49925]: shutting down. 2026-02-25T15:13:53.523 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: ******************************* 2026-02-25T15:13:53.523 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: ******************************* 2026-02-25T15:13:53.523 INFO:tasks.workunit.client.0.trial174.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-25T15:13:54.406 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: Running main() from gmock_main.cc 2026-02-25T15:13:54.406 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-25T15:13:54.406 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [----------] Global test environment set-up. 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (9912 ms) 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (7848 ms) 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (17761 ms total) 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [----------] Global test environment tear-down 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (17761 ms total) 2026-02-25T15:13:54.407 INFO:tasks.workunit.client.0.trial174.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-25T15:13:55.479 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_1_[48583]: starting. 2026-02-25T15:13:55.479 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_1_[48583]: creating pool ceph_test_rados_delete_pools_parallel.trial174-48485 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_1_[48583]: created object 0... 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_1_[48583]: created object 25... 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_1_[48583]: created object 49... 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_1_[48583]: finishing. 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_1_[48583]: shutting down. 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_2_[48585]: starting. 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_2_[48585]: deleting pool ceph_test_rados_delete_pools_parallel.trial174-48485 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_2_[48585]: shutting down. 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_3_[50046]: starting. 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_3_[50046]: creating pool ceph_test_rados_delete_pools_parallel.trial174-48485 2026-02-25T15:13:55.480 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_3_[50046]: created object 0... 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_3_[50046]: created object 25... 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_3_[50046]: created object 49... 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_3_[50046]: finishing. 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_3_[50046]: shutting down. 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_5_[50048]: starting. 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_5_[50048]: listing objects. 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_5_[50048]: listed object 0... 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_5_[50048]: listed object 25... 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_5_[50048]: saw 50 objects 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_5_[50048]: shutting down. 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:13:55.481 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_4_[50047]: starting. 2026-02-25T15:13:55.482 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_4_[50047]: deleting pool ceph_test_rados_delete_pools_parallel.trial174-48485 2026-02-25T15:13:55.482 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: process_4_[50047]: shutting down. 2026-02-25T15:13:55.482 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:13:55.482 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:13:55.482 INFO:tasks.workunit.client.0.trial174.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-25T15:13:56.510 INFO:tasks.workunit.client.0.trial174.stdout: api_io: Running main() from gmock_main.cc 2026-02-25T15:13:56.510 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-25T15:13:56.510 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [----------] Global test environment set-up. 2026-02-25T15:13:56.510 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-25T15:13:56.510 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-25T15:13:56.510 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (2766 ms) 2026-02-25T15:13:56.510 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: no timeout :/ 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: no timeout :/ 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: no timeout :/ 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: no timeout :/ 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: no timeout :/ 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (1184 ms) 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (153 ms) 2026-02-25T15:13:56.511 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.Checksum (82 ms) 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (74 ms) 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (70 ms) 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (42 ms) 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (27 ms) 2026-02-25T15:13:56.512 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.TruncTest (41 ms) 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (47 ms) 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (53 ms) 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.RmXattr (127 ms) 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIo.XattrIter (65 ms) 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [----------] 14 tests from LibRadosIo (4738 ms total) 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: 2026-02-25T15:13:56.513 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1997 ms) 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (713 ms) 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (239 ms) 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (107 ms) 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (796 ms) 2026-02-25T15:13:56.514 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (99 ms) 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (75 ms) 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (180 ms) 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (1271 ms) 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (143 ms) 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [----------] 10 tests from LibRadosIoEC (5625 ms total) 2026-02-25T15:13:56.515 INFO:tasks.workunit.client.0.trial174.stdout: api_io: 2026-02-25T15:13:56.516 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [----------] Global test environment tear-down 2026-02-25T15:13:56.516 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [==========] 24 tests from 2 test suites ran. (19947 ms total) 2026-02-25T15:13:56.516 INFO:tasks.workunit.client.0.trial174.stdout: api_io: [ PASSED ] 24 tests. 2026-02-25T15:13:57.289 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-25T15:13:57.289 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [----------] Global test environment set-up. 2026-02-25T15:13:57.289 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-25T15:13:57.289 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-25T15:13:57.289 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosList.ListObjects (4167 ms) 2026-02-25T15:13:57.289 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-25T15:13:57.289 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (346 ms) 2026-02-25T15:13:57.289 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: myset foo1,foo2,foo3 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo1 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo2 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo3 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: myset foo1,foo4,foo5 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo4 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo5 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo1 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: myset foo6,foo7 2026-02-25T15:13:57.290 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo7 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo6 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns1:foo4 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns1:foo5 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns2:foo7 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns2:foo6 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns1:foo1 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: :foo1 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: :foo2 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: :foo3 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (6319 ms) 2026-02-25T15:13:57.291 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 1 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 10 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 13 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 7 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 14 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 0 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 15 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 11 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 5 0 2026-02-25T15:13:57.292 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 8 0 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 6 0 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 3 0 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 4 0 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 12 0 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 9 0 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 2 0 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (4586 ms) 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: x cursor=MIN 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=1 cursor=9:02547ec2:::1:head 2026-02-25T15:13:57.293 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=10 cursor=9:52ea6a34:::10:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=13 cursor=9:566253c9:::13:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=7 cursor=9:5c6b0b28:::7:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=14 cursor=9:62a1935d:::14:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=0 cursor=9:6cac518f:::0:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=15 cursor=9:863748b0:::15:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=11 cursor=9:89d3ae78:::11:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=5 cursor=9:b29083e3:::5:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=8 cursor=9:bd63b0f1:::8:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=6 cursor=9:c4fdafeb:::6:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=3 cursor=9:cfc208b3:::3:head 2026-02-25T15:13:57.294 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=4 cursor=9:d83876eb:::4:head 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=12 cursor=9:de5d7c5f:::12:head 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=9 cursor=9:e960b815:::9:head 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > oid=2 cursor=9:f905c69b:::2:head 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=1 cursor=9:02547ec2:::1:head 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:02547ec2:::1:head 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:02547ec2:::1:head -> 1 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=10 cursor=9:52ea6a34:::10:head 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:52ea6a34:::10:head 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:52ea6a34:::10:head -> 10 2026-02-25T15:13:57.295 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=13 cursor=9:566253c9:::13:head 2026-02-25T15:13:57.296 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:566253c9:::13:head 2026-02-25T15:13:57.296 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:566253c9:::13:head -> 13 2026-02-25T15:13:57.296 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=7 cursor=9:5c6b0b28:::7:head 2026-02-25T15:13:57.296 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:5c6b0b28:::7:head 2026-02-25T15:13:57.296 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:5c6b0b28:::7:head -> 7 2026-02-25T15:13:58.463 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=14 cursor=9:62a1935d:::14:he api_lock_pp: Running main() from gmock_main.cc 2026-02-25T15:13:58.463 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-25T15:13:58.463 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-25T15:13:58.463 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-25T15:13:58.463 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: seed 47935 2026-02-25T15:13:58.463 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (2735 ms) 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (829 ms) 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1072 ms) 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1090 ms) 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (830 ms) 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (73 ms) 2026-02-25T15:13:58.464 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (1139 ms) 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (61 ms) 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (7834 ms total) 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (2271 ms) 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (94 ms) 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1121 ms) 2026-02-25T15:13:58.465 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1536 ms) 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (170 ms) 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (88 ms) 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (123 ms) 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (57 ms) 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (5463 ms total) 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-25T15:13:58.466 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (21885 ms total) 2026-02-25T15:13:58.467 INFO:tasks.workunit.client.0.trial174.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout:ad 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:62a1935d:::14:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:62a1935d:::14:head -> 14 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=0 cursor=9:6cac518f:::0:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:6cac518f:::0:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:6cac518f:::0:head -> 0 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=15 cursor=9:863748b0:::15:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:863748b0:::15:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:863748b0:::15:head -> 15 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=11 cursor=9:89d3ae78:::11:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:89d3ae78:::11:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:89d3ae78:::11:head -> 11 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=5 cursor=9:b29083e3:::5:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:b29083e3:::5:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:b29083e3:::5:head -> 5 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=8 cursor=9:bd63b0f1:::8:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:bd63b0f1:::8:head 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:bd63b0f1:::8:head -> 8 2026-02-25T15:13:59.073 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=6 cursor=9:c4fdafeb:::6:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:c4fdafeb:::6:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:c4fdafeb:::6:head -> 6 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=3 cursor=9:cfc208b3:::3:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:cfc208b3:::3:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:cfc208b3:::3:head -> 3 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=4 cursor=9:d83876eb:::4:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:d83876eb:::4:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:d83876eb:::4:head -> 4 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=12 cursor=9:de5d7c5f:::12:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:de5d7c5f:::12:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:de5d7c5f:::12:head -> 12 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=9 cursor=9:e960b815:::9:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:e960b815:::9:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:e960b815:::9:head -> 9 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : oid=2 cursor=9:f905c69b:::2:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:f905c69b:::2:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:f905c69b:::2:head -> 2 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:52ea6a34:::10:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:52ea6a34:::10:head expected=9:52ea6a34:::10:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:52ea6a34:::10:head -> 10 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=10 expected=10 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:f905c69b:::2:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:f905c69b:::2:head expected=9:f905c69b:::2:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:f905c69b:::2:head -> 2 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=2 expected=2 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:e960b815:::9:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:e960b815:::9:head expected=9:e960b815:::9:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:e960b815:::9:head -> 9 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=9 expected=9 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:de5d7c5f:::12:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:de5d7c5f:::12:head expected=9:de5d7c5f:::12:head 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:de5d7c5f:::12:head -> 12 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=12 expected=12 2026-02-25T15:13:59.074 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:d83876eb:::4:head 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:d83876eb:::4:head expected=9:d83876eb:::4:head 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:d83876eb:::4:head -> 4 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=4 expected=4 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:cfc208b3:::3:head 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:cfc208b3:::3:head expected=9:cfc208b3:::3:head 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:cfc208b3:::3:head -> 3 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=3 expected=3 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:c4fdafeb:::6:head 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:c4fdafeb:::6:head expected=9:c4fdafeb:::6:head 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:c4fdafeb:::6:head -> 6 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=6 expected=6 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:bd63b0f1:::8:head 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:bd63b0f1:::8:head expected=9:bd63b0f1:::8:head 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:bd63b0f1:::8:head -> 8 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=8 expected=8 2026-02-25T15:13:59.075 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:b29083e3:::5:head 2026-02-25T15:13:59.600 INFO:tasks.workunit.client.0.trial174.stdout: api_l api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-25T15:13:59.600 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-25T15:13:59.600 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-25T15:13:59.600 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-25T15:13:59.600 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: notify 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (5220 ms) 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (377 ms) 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (5597 ms total) 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: notify 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (1857 ms) 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-25T15:13:59.601 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: notify 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3837 ms) 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (178 ms) 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (98 ms) 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817192016 notify_id 210453397505 notifier_gid 5126 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (665 ms) 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 210453397504 notifier_gid 5126 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 210453397504 notifier_gid 5126 2026-02-25T15:13:59.602 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 210453397505 notifier_gid 5126 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (222 ms) 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 210453397505 notifier_gid 5126 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (76 ms) 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 210453397506 notifier_gid 5126 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (90 ms) 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 210453397507 notifier_gid 5126 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (84 ms) 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 210453397508 notifier_gid 5126 2026-02-25T15:13:59.603 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (74 ms) 2026-02-25T15:13:59.604 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-25T15:14:00.952 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_ api_lock: Running main() from gmock_main.cc 2026-02-25T15:14:00.952 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [----------] Global test environment set-up. 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (2024 ms) 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLock.LockShared (552 ms) 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1325 ms) 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1411 ms) 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (194 ms) 2026-02-25T15:14:00.953 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLock.Unlock (133 ms) 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (1816 ms) 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (305 ms) 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [----------] 8 tests from LibRadosLock (7765 ms total) 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (2163 ms) 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-25T15:14:00.954 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (206 ms) 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1107 ms) 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1755 ms) 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (74 ms) 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (159 ms) 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (115 ms) 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (55 ms) 2026-02-25T15:14:00.955 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (5638 ms total) 2026-02-25T15:14:00.956 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: 2026-02-25T15:14:00.956 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [----------] Global test environment tear-down 2026-02-25T15:14:00.956 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (24377 ms total) 2026-02-25T15:14:00.956 INFO:tasks.workunit.client.0.trial174.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: Running main() from gmock_main.cc 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: seed 47853 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (2280 ms) 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-25T15:14:01.010 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (1391 ms) 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (43 ms) 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (9212 ms) 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (23 ms) 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (75 ms) 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (31 ms) 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-25T15:14:01.011 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (37 ms) 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (31 ms) 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (47 ms) 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (618 ms) 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (506 ms) 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (93 ms) 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (48 ms) 2026-02-25T15:14:01.012 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (40 ms) 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (871 ms) 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (49 ms) 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (43 ms) 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (39 ms) 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (20 ms) 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-25T15:14:01.013 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (575 ms) 2026-02-25T15:14:01.014 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (16081 ms total) 2026-02-25T15:14:01.014 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: 2026-02-25T15:14:01.014 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-25T15:14:01.014 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-25T15:14:01.014 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (2225 ms) 2026-02-25T15:14:01.014 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-25T15:14:01.014 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (210 ms) 2026-02-25T15:14:01.014 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-25T15:14:03.372 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadO list_parallel: process_1_[48520]: starting. 2026-02-25T15:14:03.372 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_1_[48520]: creating pool ceph_test_rados_list_parallel.trial174-48428 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_1_[48520]: created object 0... 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_1_[48520]: created object 25... 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_1_[48520]: created object 49... 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_1_[48520]: finishing. 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_1_[48520]: shutting down. 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_2_[48525]: starting. 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_2_[48525]: listing objects. 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_2_[48525]: listed object 0... 2026-02-25T15:14:03.373 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_2_[48525]: listed object 25... 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_2_[48525]: saw 50 objects 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_2_[48525]: shutting down. 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_3_[50133]: starting. 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_3_[50133]: creating pool ceph_test_rados_list_parallel.trial174-48428 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_3_[50133]: created object 0... 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_3_[50133]: created object 25... 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_3_[50133]: created object 49... 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_3_[50133]: finishing. 2026-02-25T15:14:03.374 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_3_[50133]: shutting down. 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_4_[50134]: starting. 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_4_[50134]: listing objects. 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_4_[50134]: listed object 0... 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_4_[50134]: listed object 25... 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_4_[50134]: saw 41 objects 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_4_[50134]: shutting down. 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_5_[50135]: starting. 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_5_[50135]: removed 25 objects... 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_5_[50135]: removed half of the objects 2026-02-25T15:14:03.375 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_5_[50135]: removed 50 objects... 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_5_[50135]: removed 50 objects 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_5_[50135]: shutting down. 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_6_[50671]: starting. 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_6_[50671]: creating pool ceph_test_rados_list_parallel.trial174-48428 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_6_[50671]: created object 0... 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_6_[50671]: created object 25... 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_6_[50671]: created object 49... 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_6_[50671]: finishing. 2026-02-25T15:14:03.376 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_6_[50671]: shutting down. 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_7_[50672]: starting. 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_7_[50672]: listing objects. 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_7_[50672]: listed object 0... 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_7_[50672]: listed object 25... 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_7_[50672]: listed object 50... 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_7_[50672]: saw 54 objects 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_7_[50672]: shutting down. 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.377 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_8_[50673]: starting. 2026-02-25T15:14:03.378 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_8_[50673]: added 25 objects... 2026-02-25T15:14:03.378 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_8_[50673]: added half of the objects 2026-02-25T15:14:03.378 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_8_[50673]: added 50 objects... 2026-02-25T15:14:03.378 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_8_[50673]: added 50 objects 2026-02-25T15:14:03.378 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_8_[50673]: shutting down. 2026-02-25T15:14:03.378 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:03.378 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:05.798 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ************************* api_service: [==========] Running 4 tests from 1 test suite. 2026-02-25T15:14:05.798 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [----------] Global test environment set-up. 2026-02-25T15:14:05.798 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-25T15:14:05.798 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5352 ms) 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ OK ] LibRadosService.RegisterLate (432 ms) 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: cluster: 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: id: 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: health: HEALTH_OK 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: services: 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 85s) [leader: a] 2026-02-25T15:14:05.799 INFO:tasks.workunit.client.0.trial174.stdout: api_service: mgr: y(active, since 83s), standbys: x 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: osd: 16 osds: 16 up (since 52s), 16 in (since 79s) 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: data: 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: pools: 29 pools, 873 pgs 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: objects: 4 objects, 449 KiB 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: usage: 426 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: pgs: 98.969% pgs unknown 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 864 unknown 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 9 active+clean 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.800 INFO:tasks.workunit.client.0.trial174.stdout: api_service: cluster: 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: id: 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: health: HEALTH_OK 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: services: 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 87s) [leader: a] 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: mgr: y(active, since 85s), standbys: x 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: osd: 16 osds: 16 up (since 54s), 16 in (since 81s) 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: data: 2026-02-25T15:14:05.801 INFO:tasks.workunit.client.0.trial174.stdout: api_service: pools: 28 pools, 793 pgs 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: objects: 26 objects, 450 KiB 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: usage: 428 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: pgs: 35.561% pgs unknown 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 4.035% pgs not active 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 479 active+clean 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 282 unknown 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 22 creating+peering 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 10 creating+activating 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: io: 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: client: 1.2 KiB/s rd, 4.3 KiB/s wr, 2 op/s rd, 5 op/s wr 2026-02-25T15:14:05.802 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ OK ] LibRadosService.StatusFormat (3372 ms) 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ OK ] LibRadosService.Status (20021 ms) 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [----------] 4 tests from LibRadosService (29178 ms total) 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [----------] Global test environment tear-down 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [==========] 4 tests from 1 test suite ran. (29178 ms total) 2026-02-25T15:14:05.803 INFO:tasks.workunit.client.0.trial174.stdout: api_service: [ PASSED ] 4 tests. 2026-02-25T15:14:09.666 INFO:tasks.workunit.client.0.trial174.stdout:****** 2026-02-25T15:14:09.666 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_9_[53350]: starting. 2026-02-25T15:14:09.666 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_9_[53350]: creating pool ceph_test_rados_list_parallel.trial174-48428 2026-02-25T15:14:09.666 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_9_[53350]: created object 0... 2026-02-25T15:14:09.666 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_9_[53350]: created object 25... 2026-02-25T15:14:09.666 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_9_[53350]: created object 49... 2026-02-25T15:14:09.666 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_9_[53350]: finishing. 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_9_[53350]: shutting down. 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_10_[53351]: starting. 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_10_[53351]: listing objects. 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_10_[53351]: listed object 0... 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_10_[53351]: listed object 25... 2026-02-25T15:14:09.667 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_10_[53351]: listed object 50... 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_10_[53351]: listed object 75... 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_10_[53351]: saw 97 objects 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_10_[53351]: shutting down. 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_12_[53353]: starting. 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_12_[53353]: added 25 objects... 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_12_[53353]: added half of the objects 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_12_[53353]: added 50 objects... 2026-02-25T15:14:09.668 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_12_[53353]: added 50 objects 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_12_[53353]: shutting down. 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_13_[53354]: starting. 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_13_[53354]: removed 25 objects... 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_13_[53354]: removed half of the objects 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_13_[53354]: removed 50 objects... 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_13_[53354]: removed 50 objects 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_13_[53354]: shutting down. 2026-02-25T15:14:09.669 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_11_[53352]: starting. 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_11_[53352]: added 25 objects... 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_11_[53352]: added half of the objects 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_11_[53352]: added 50 objects... 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_11_[53352]: added 50 objects 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_11_[53352]: shutting down. 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.670 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_14_[57925]: starting. 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_14_[57925]: creating pool ceph_test_rados_list_parallel.trial174-48428 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_14_[57925]: created object 0... 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_14_[57925]: created object 25... 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_14_[57925]: created object 49... 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_14_[57925]: finishing. 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_14_[57925]: shutting down. 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.671 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.672 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:09.672 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: starting. 2026-02-25T15:14:09.672 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: listing objects. 2026-02-25T15:14:09.672 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: listed object 0... 2026-02-25T15:14:09.672 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: listed object 25... 2026-02-25T15:14:12.206 INFO:tasks.workunit.client.0.trial174.stdout: list: Running main() from gmock_main.cc 2026-02-25T15:14:12.206 INFO:tasks.workunit.client.0.trial174.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-25T15:14:12.206 INFO:tasks.workunit.client.0.trial174.stdout: list: [----------] Global test environment set-up. 2026-02-25T15:14:12.206 INFO:tasks.workunit.client.0.trial174.stdout: list: [----------] 3 tests from NeoradosList 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [ OK ] NeoradosList.ListObjects (7801 ms) 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [ OK ] NeoradosList.ListObjectsNS (6424 ms) 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [ OK ] NeoradosList.ListObjectsMany (21333 ms) 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [----------] 3 tests from NeoradosList (35560 ms total) 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [----------] Global test environment tear-down 2026-02-25T15:14:12.207 INFO:tasks.workunit.client.0.trial174.stdout: list: [==========] 3 tests from 1 test suite ran. (35560 ms total) 2026-02-25T15:14:12.208 INFO:tasks.workunit.client.0.trial174.stdout: list: [ PASSED ] 3 tests. 2026-02-25T15:14:12.927 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:02:14.706 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:12.935 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:02:14.714 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:13.002 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:02:14.781 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:13.025 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:02:14.802 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:13.099 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:02:14.876 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:13.199 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:02:14.976 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:13.252 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:02:14.992 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:13.313 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:02:15.053 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:13.353 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:02:15.093 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:13.396 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-25T15:14:13.396 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-25T15:14:13.396 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-25T15:14:13.396 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5402 ms) 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (1546 ms) 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20186 ms) 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: attempt 0 of 20 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (9641 ms) 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36775 ms total) 2026-02-25T15:14:13.397 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: 2026-02-25T15:14:13.398 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-25T15:14:13.398 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36775 ms total) 2026-02-25T15:14:13.398 INFO:tasks.workunit.client.0.trial174.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-25T15:14:14.386 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-25T15:14:14.387 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-25T15:14:14.387 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-25T15:14:14.387 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-25T15:14:14.387 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-25T15:14:14.387 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify_test_cb 2026-02-25T15:14:14.387 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (3977 ms) 2026-02-25T15:14:14.387 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-25T15:14:14.387 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94662682819024 err -107 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1399 ms) 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94662682839184 err -107 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1836 ms) 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_cb from 4727 notify_id 154618822656 cookie 94662682839184 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (285 ms) 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-25T15:14:14.388 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_cb from 4727 notify_id 154618822657 cookie 94662682879520 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (1122 ms) 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_cb from 4727 notify_id 158913789952 cookie 94662682879520 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (112 ms) 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_cb from 4727 notify_id 158913789953 cookie 94662682879520 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_cb from 4727 notify_id 158913789953 cookie 94662682890128 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (104 ms) 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-25T15:14:14.389 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_cb from 4727 notify_id 163208757249 cookie 94662682879520 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_cb from 4727 notify_id 167503724546 cookie 94662682879520 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3909 ms) 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94662682879520 err -107 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_cb from 4727 notify_id 201863462918 cookie 94662682879520 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5674 ms) 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94662682879520 err -107 2026-02-25T15:14:14.390 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1088 ms) 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (19510 ms total) 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: watch_notify_test_cb 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1548 ms) 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1548 ms total) 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-25T15:14:14.391 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (37789 ms total) 2026-02-25T15:14:14.392 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-25T15:14:15.545 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: listed object 50... 2026-02-25T15:14:15.545 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: listed object 75... 2026-02-25T15:14:15.545 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: listed object 100... 2026-02-25T15:14:15.545 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: listed object 125... 2026-02-25T15:14:15.545 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: saw 150 objects 2026-02-25T15:14:15.545 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_15_[57934]: shutting down. 2026-02-25T15:14:15.545 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.545 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_16_[57939]: starting. 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_16_[57939]: added 25 objects... 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_16_[57939]: added half of the objects 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_16_[57939]: added 50 objects... 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_16_[57939]: added 50 objects 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: process_16_[57939]: shutting down. 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.546 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.547 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******************************* 2026-02-25T15:14:15.547 INFO:tasks.workunit.client.0.trial174.stdout: list_parallel: ******* SUCCESS ********** 2026-02-25T15:14:21.492 INFO:tasks.workunit.client.0.trial174.stdout:notify_pp: trying... 2026-02-25T15:14:21.492 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 210453397504 notifier_gid 5126 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: timed out 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: flushing 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: flushed 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3069 ms) 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: trying... 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 219043332097 notifier_gid 5126 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: timed out 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: flushing 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: flushed 2026-02-25T15:14:21.493 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3065 ms) 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: List watches 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: notify2 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 227633266690 notifier_gid 5126 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: notify2 done 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: watch_check 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: unwatch2 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: flushing 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: done 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3227 ms) 2026-02-25T15:14:21.494 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: List watches 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: notify2 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: handle_notify cookie 94461817183056 notify_id 236223201282 notifier_gid 5126 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: notify2 done 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: watch_check 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: unwatch2 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: flushing 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: done 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3335 ms) 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (19885 ms total) 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-25T15:14:21.495 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (44890 ms total) 2026-02-25T15:14:21.496 INFO:tasks.workunit.client.0.trial174.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-25T15:14:29.287 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: Running main() from gmock_main.cc 2026-02-25T15:14:29.287 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-25T15:14:29.287 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [----------] Global test environment set-up. 2026-02-25T15:14:29.287 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (13144 ms) 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (8580 ms) 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (30915 ms) 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [----------] 3 tests from NeoradosECList (52639 ms total) 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [----------] Global test environment tear-down 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (52639 ms total) 2026-02-25T15:14:29.288 INFO:tasks.workunit.client.0.trial174.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-25T15:14:29.969 INFO:tasks.workunit.client.0.trial174.stdout:pPP (111 ms) 2026-02-25T15:14:29.969 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-25T15:14:29.969 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (109 ms) 2026-02-25T15:14:29.969 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-25T15:14:29.969 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (118 ms) 2026-02-25T15:14:29.969 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-25T15:14:29.969 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (75 ms) 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (64 ms) 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (35 ms) 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (71 ms) 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (53 ms) 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (64 ms) 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-25T15:14:29.970 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (318 ms) 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (303 ms) 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (19252 ms) 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1785 ms) 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (181 ms) 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (42 ms) 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-25T15:14:29.971 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (166 ms) 2026-02-25T15:14:29.972 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (25190 ms total) 2026-02-25T15:14:29.972 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: 2026-02-25T15:14:29.972 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-25T15:14:29.972 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (53401 ms total) 2026-02-25T15:14:29.972 INFO:tasks.workunit.client.0.trial174.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-25T15:14:38.007 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:02:39.786 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:38.017 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:02:39.796 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:38.057 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:02:39.836 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:38.287 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:02:40.064 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:38.370 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:02:40.147 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:38.404 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:02:40.181 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:38.466 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:02:40.206 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:38.525 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:02:40.264 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:38.561 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:02:40.301 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:14:39.468 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-25T15:14:39.468 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-25T15:14:39.468 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-25T15:14:39.468 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-25T15:14:39.468 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (6886 ms) 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (4197 ms) 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3182 ms) 2026-02-25T15:14:39.469 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3551 ms) 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3013 ms) 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (8076 ms) 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (33944 ms) 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (62852 ms total) 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (62852 ms total) 2026-02-25T15:14:39.470 INFO:tasks.workunit.client.0.trial174.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-25T15:14:43.728 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: Running main() from gmock_main.cc 2026-02-25T15:14:43.728 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-25T15:14:43.728 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [----------] Global test environment set-up. 2026-02-25T15:14:43.728 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-25T15:14:43.728 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-25T15:14:43.728 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (7750 ms) 2026-02-25T15:14:43.728 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3315 ms) 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3148 ms) 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3543 ms) 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (4042 ms) 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (5265 ms) 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-25T15:14:43.729 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (33990 ms) 2026-02-25T15:14:43.730 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-25T15:14:43.730 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (6009 ms) 2026-02-25T15:14:43.730 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (67065 ms total) 2026-02-25T15:14:43.730 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: 2026-02-25T15:14:43.730 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [----------] Global test environment tear-down 2026-02-25T15:14:43.730 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (67065 ms total) 2026-02-25T15:14:43.730 INFO:tasks.workunit.client.0.trial174.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-25T15:14:45.643 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: Running main() from gmock_main.cc 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [----------] Global test environment set-up. 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolList (3191 ms) 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (5735 ms) 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3265 ms) 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-25T15:14:45.644 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3151 ms) 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2505 ms) 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5895 ms) 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (13643 ms) 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (11824 ms) 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (19845 ms) 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [----------] 9 tests from LibRadosPools (69058 ms total) 2026-02-25T15:14:45.645 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: 2026-02-25T15:14:45.646 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [----------] Global test environment tear-down 2026-02-25T15:14:45.646 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (69058 ms total) 2026-02-25T15:14:45.646 INFO:tasks.workunit.client.0.trial174.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-25T15:14:51.679 INFO:tasks.workunit.client.0.trial174.stdout: misc: Running main() from gmock_main.cc 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [----------] Global test environment set-up. 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.Version (3235 ms) 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (4047 ms) 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.LongName (4841 ms) 2026-02-25T15:14:51.680 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (3596 ms) 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3106 ms) 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (2981 ms) 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.Exec (9049 ms) 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (12330 ms) 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (5962 ms) 2026-02-25T15:14:51.681 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.BigObject (6840 ms) 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (9397 ms) 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (9638 ms) 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [----------] 12 tests from NeoRadosMisc (75026 ms total) 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [----------] Global test environment tear-down 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [==========] 12 tests from 1 test suite ran. (75026 ms total) 2026-02-25T15:14:51.682 INFO:tasks.workunit.client.0.trial174.stdout: misc: [ PASSED ] 12 tests. 2026-02-25T15:14:58.683 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-25T15:14:58.683 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] Global test environment set-up. 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: 2026-02-25T15:13:36.790+0000 7f20d8a88880 -1 failed for service _ceph-mon._tcp 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: 2026-02-25T15:13:36.790+0000 7f20d8a88880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-25T15:14:58.684 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (210 ms) 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5002 ms) 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5213 ms total) 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: started 0x55f5164b2fb0 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: started 0x55f516695af0 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: started 2 aios 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: waiting 0x55f5164b2fb0 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: waiting 0x55f516695af0 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: done. 2026-02-25T15:14:58.685 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (7999 ms) 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (7999 ms total) 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMisc.Exec (945 ms) 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (300 ms) 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (107 ms) 2026-02-25T15:14:58.686 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5156 ms) 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (59271 ms) 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] 8 tests from LibRadosMisc (65781 ms total) 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [----------] Global test environment tear-down 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (82085 ms total) 2026-02-25T15:14:58.687 INFO:tasks.workunit.client.0.trial174.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-25T15:15:02.718 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:04.497 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:02.722 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:04.501 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:02.755 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:04.532 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:02.755 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:04.534 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:02.758 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:04.536 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:02.772 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:04.512 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:02.774 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:04.514 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:02.792 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:04.569 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:02.813 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:04.552 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:05.669 INFO:tasks.workunit.client.0.trial174.stdout: io: Running main() from gmock_main.cc 2026-02-25T15:15:05.669 INFO:tasks.workunit.client.0.trial174.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [----------] Global test environment set-up. 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.Limits (7775 ms) 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (4331 ms) 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.ReadOp (3635 ms) 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.SparseRead (3076 ms) 2026-02-25T15:15:05.670 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.RoundTrip (2996 ms) 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (8985 ms) 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (9727 ms) 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (7231 ms) 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (8320 ms) 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.Trunc (9318 ms) 2026-02-25T15:15:05.671 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.Remove (12010 ms) 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (5615 ms) 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.RmXattr (3020 ms) 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [ OK ] NeoRadosIo.GetXattrs (2982 ms) 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [----------] 14 tests from NeoRadosIo (89028 ms total) 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [----------] Global test environment tear-down 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [==========] 14 tests from 1 test suite ran. (89028 ms total) 2026-02-25T15:15:05.672 INFO:tasks.workunit.client.0.trial174.stdout: io: [ PASSED ] 14 tests. 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: Running main() from gmock_main.cc 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [----------] Global test environment set-up. 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (6867 ms) 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3046 ms) 2026-02-25T15:15:08.734 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3250 ms) 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (4592 ms) 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (3068 ms) 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (6511 ms) 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (8003 ms) 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (11125 ms) 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-25T15:15:08.735 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (9586 ms) 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (9334 ms) 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (12010 ms) 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (5610 ms) 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2943 ms) 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-25T15:15:08.736 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3043 ms) 2026-02-25T15:15:08.737 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-25T15:15:08.737 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (3081 ms) 2026-02-25T15:15:08.737 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (92075 ms total) 2026-02-25T15:15:08.737 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: 2026-02-25T15:15:08.737 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [----------] Global test environment tear-down 2026-02-25T15:15:08.737 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (92075 ms total) 2026-02-25T15:15:08.737 INFO:tasks.workunit.client.0.trial174.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-25T15:15:16.836 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: Running main() from gmock_main.cc 2026-02-25T15:15:16.836 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-25T15:15:16.836 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-25T15:15:16.836 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (4621 ms) 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (3221 ms) 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2076 ms) 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2115 ms) 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (12035 ms total) 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-25T15:15:16.837 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4397 ms) 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (11583 ms) 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (12731 ms) 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (28712 ms total) 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (7758 ms) 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-25T15:15:16.838 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (4197 ms) 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (7885 ms) 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1960 ms) 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (21801 ms total) 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4199 ms) 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3899 ms) 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8099 ms total) 2026-02-25T15:15:16.839 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: 2026-02-25T15:15:16.840 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-25T15:15:16.840 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (100248 ms total) 2026-02-25T15:15:16.840 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-25T15:15:16.841 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:15:16.841 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48329 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48329 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48119 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48119 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47991 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47991 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47846 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47846 2026-02-25T15:15:16.842 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48053 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48053 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48432 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48432 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48464 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48464 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47868 2026-02-25T15:15:16.843 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47868 2026-02-25T15:15:22.679 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:24.458 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:22.712 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:24.491 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:22.719 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:24.497 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:22.729 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:24.506 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:22.743 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:24.483 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:22.747 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:24.487 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:22.755 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:24.534 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:22.768 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:24.545 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:22.788 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:24.528 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: Running main() from gmock_main.cc 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [----------] Global test environment set-up. 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (8856 ms) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (5356 ms) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (3533 ms) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (5981 ms) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (16780 ms) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (40508 ms total) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (10643 ms) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (15776 ms) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (17089 ms) 2026-02-25T15:15:30.317 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6009 ms) 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4133 ms) 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial174-48825-11. 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: Waiting for snaps to purge. 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19495 ms) 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (73147 ms total) 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [----------] Global test environment tear-down 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (113656 ms total) 2026-02-25T15:15:30.318 INFO:tasks.workunit.client.0.trial174.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-25T15:15:32.673 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2026-02-25T15:15:32.673 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-25T15:15:32.673 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-25T15:15:32.673 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-25T15:15:32.673 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: seed 48096 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5879 ms) 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2115 ms) 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2192 ms) 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2110 ms) 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-25T15:15:32.674 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4584 ms) 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (16882 ms total) 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (12067 ms) 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (11109 ms) 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (20436 ms) 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-25T15:15:32.675 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (11911 ms) 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (5114 ms) 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial174-48096-7 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-25T15:15:32.676 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17699 ms) 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (78338 ms total) 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (2 ms) 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4961 ms) 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (4964 ms total) 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-25T15:15:32.677 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-25T15:15:32.678 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3368 ms) 2026-02-25T15:15:32.678 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-25T15:15:32.678 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2019 ms) 2026-02-25T15:15:32.678 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-25T15:15:42.710 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:44.489 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:42.742 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:44.521 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:42.772 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:44.549 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:42.776 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:44.515 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:42.776 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:44.553 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:42.780 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:44.519 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:42.791 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:03:44.570 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:42.812 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:03:44.552 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:42.813 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:03:44.591 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ api_misc_pp: [==========] Running 31 tests from 7 test suites. 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: seed 47995 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (2 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (2673 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (1191 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (175 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (165 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (48 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (38 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (133 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (35 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (123 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (27 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (54 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (674 ms) 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-25T15:15:44.718 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (39969 ms) 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (5391 ms) 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: done waiting, doing copies 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: done waiting 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (69968 ms) 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (47 ms) 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (24 ms) 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4257 ms) 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-25T15:15:44.719 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-25T15:15:47.820 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 22 tests api_aio: Running main() from gmock_main.cc 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [----------] Global test environment set-up. 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.TooBig (3207 ms) 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (6857 ms) 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (4257 ms) 2026-02-25T15:15:47.821 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3546 ms) 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3013 ms) 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (4260 ms) 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (8694 ms) 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (9441 ms) 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (8150 ms) 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-25T15:15:47.822 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (14131 ms) 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (11864 ms) 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (5669 ms) 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2948 ms) 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3064 ms) 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.Flush (3062 ms) 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3156 ms) 2026-02-25T15:15:47.823 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (2848 ms) 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3137 ms) 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3100 ms) 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (2853 ms) 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3140 ms) 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3348 ms) 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2348 ms) 2026-02-25T15:15:47.824 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-25T15:15:47.825 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3220 ms) 2026-02-25T15:15:47.825 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-25T15:15:47.825 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3219 ms) 2026-02-25T15:15:47.825 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-25T15:15:47.825 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3131 ms) 2026-02-25T15:15:47.825 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-25T15:15:47.825 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (2492 ms) 2026-02-25T15:15:47.825 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: a OK ] LibRadosSnapshotsECPP.RollbackPP (1346 ms) 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2086 ms) 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8820 ms total) 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (3735 ms) 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-25T15:15:55.824 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3931 ms) 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3830 ms) 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11497 ms total) 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (139232 ms total) 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-25T15:15:55.825 INFO:tasks.workunit.client.0.trial174.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-25T15:16:00.910 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: Running main() from gmock_main.cc 2026-02-25T15:16:00.910 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (3344 ms) 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (27535 ms) 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (15534 ms) 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (12877 ms) 2026-02-25T15:16:00.911 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (9789 ms) 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (11312 ms) 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3732 ms) 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2948 ms) 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3051 ms) 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3111 ms) 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-25T15:16:00.912 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2838 ms) 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3163 ms) 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3145 ms) 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3034 ms) 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (2834 ms) 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3469 ms) 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-25T15:16:00.913 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3036 ms) 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2409 ms) 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3231 ms) 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3192 ms) 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2536 ms) 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3038 ms) 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3172 ms) 2026-02-25T15:16:00.914 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-25T15:16:00.915 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3033 ms) 2026-02-25T15:16:00.915 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-25T15:16:00.915 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2809 ms) 2026-02-25T15:16:00.915 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-25T15:16:00.915 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3120 ms) 2026-02-25T15:16:00.915 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-25T15:16:02.794 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:04:04.573 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:02.798 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:04:04.575 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:02.802 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:04:04.581 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:02.802 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:04:04.579 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:02.827 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:04:04.567 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:02.830 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:04:04.569 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:02.842 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:04:04.619 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:02.855 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:04:04.634 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:02.863 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:04:04.603 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:12.249 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosfrom LibRadosMiscPP (125003 ms total) 2026-02-25T15:16:12.249 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: 2026-02-25T15:16:12.249 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-25T15:16:12.249 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-25T15:16:12.249 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (1451 ms) 2026-02-25T15:16:12.249 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (1451 ms total) 2026-02-25T15:16:12.249 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: 2026-02-25T15:16:12.249 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (194 ms) 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (27 ms) 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (221 ms total) 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (124 ms) 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-25T15:16:12.250 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (26 ms) 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (151 ms total) 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (158 ms) 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (30 ms) 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (188 ms total) 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1261 ms) 2026-02-25T15:16:12.251 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1261 ms total) 2026-02-25T15:16:12.252 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: 2026-02-25T15:16:12.252 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-25T15:16:12.252 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (155659 ms total) 2026-02-25T15:16:12.252 INFO:tasks.workunit.client.0.trial174.stdout: api_misc_pp: [ PASSED ] 31 tests. 2026-02-25T15:16:12.253 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:16:12.253 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48361 2026-02-25T15:16:12.253 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48361 2026-02-25T15:16:12.253 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:16:12.253 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47745 2026-02-25T15:16:12.253 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47745 2026-02-25T15:16:12.253 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:16:12.254 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47807 2026-02-25T15:16:12.254 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47807 2026-02-25T15:16:12.254 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:16:12.254 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48275 2026-02-25T15:16:12.254 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48275 2026-02-25T15:16:12.254 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:16:12.254 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47734 2026-02-25T15:16:12.254 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47734 2026-02-25T15:16:19.165 INFO:tasks.workunit.client.0.trial174.stdout:ist: : cursor()=9:b29083e3:::5:head expected=9:b29083e3:::5:head 2026-02-25T15:16:19.165 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:b29083e3:::5:head -> 5 2026-02-25T15:16:19.165 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=5 expected=5 2026-02-25T15:16:19.165 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:89d3ae78:::11:head 2026-02-25T15:16:19.165 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:89d3ae78:::11:head expected=9:89d3ae78:::11:head 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:89d3ae78:::11:head -> 11 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=11 expected=11 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:863748b0:::15:head 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:863748b0:::15:head expected=9:863748b0:::15:head 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:863748b0:::15:head -> 15 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=15 expected=15 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:6cac518f:::0:head 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:6cac518f:::0:head expected=9:6cac518f:::0:head 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:6cac518f:::0:head -> 0 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=0 expected=0 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:62a1935d:::14:head 2026-02-25T15:16:19.166 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:62a1935d:::14:head expected=9:62a1935d:::14:head 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:62a1935d:::14:head -> 14 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=14 expected=14 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:5c6b0b28:::7:head 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:5c6b0b28:::7:head expected=9:5c6b0b28:::7:head 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:5c6b0b28:::7:head -> 7 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=7 expected=7 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:02547ec2:::1:head 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:02547ec2:::1:head expected=9:02547ec2:::1:head 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:02547ec2:::1:head -> 1 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=1 expected=1 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : seek to 9:566253c9:::13:head 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : cursor()=9:566253c9:::13:head expected=9:566253c9:::13:head 2026-02-25T15:16:19.167 INFO:tasks.workunit.client.0.trial174.stdout: api_list: > 9:566253c9:::13:head -> 13 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: : entry=13 expected=13 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (5864 ms) 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (59485 ms) 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: split 0/5 -> MIN 9:33333333::::head 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: split 1/5 -> 9:33333333::::head 9:66666666::::head 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: split 2/5 -> 9:66666666::::head 9:99999999::::head 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: split 3/5 -> 9:99999999::::head 9:cccccccc::::head 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: split 4/5 -> 9:cccccccc::::head MAX 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (73970 ms) 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [----------] 7 tests from LibRadosList (154740 ms total) 2026-02-25T15:16:19.168 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1333 ms) 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: myset foo1,foo2,foo3 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo1 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo2 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo3 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: myset foo1,foo4,foo5 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo4 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo5 2026-02-25T15:16:19.169 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo1 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: myset foo6,foo7 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo7 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: foo6 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns1:foo4 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns1:foo5 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns2:foo7 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns2:foo6 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: ns1:foo1 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: :foo1 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: :foo2 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: :foo3 2026-02-25T15:16:19.170 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (414 ms) 2026-02-25T15:16:19.171 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-25T15:16:19.171 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 1 0 2026-02-25T15:16:19.171 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 10 0 2026-02-25T15:16:19.171 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 13 0 2026-02-25T15:16:24.953 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 7 0 2026-02-25T15:16:24.953 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 14 0 2026-02-25T15:16:24.953 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 0 0 2026-02-25T15:16:24.953 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 15 0 2026-02-25T15:16:24.953 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 11 0 2026-02-25T15:16:24.953 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 5 0 2026-02-25T15:16:24.953 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 8 0 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 6 0 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 3 0 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 4 0 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 12 0 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 9 0 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 2 0 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (886 ms) 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [----------] 3 tests from LibRadosListEC (2634 ms total) 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-25T15:16:24.954 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2974 ms) 2026-02-25T15:16:24.955 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [----------] 1 test from LibRadosListNP (2974 ms total) 2026-02-25T15:16:24.955 INFO:tasks.workunit.client.0.trial174.stdout: api_list: 2026-02-25T15:16:24.955 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [----------] Global test environment tear-down 2026-02-25T15:16:24.955 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [==========] 11 tests from 3 test suites ran. (168375 ms total) 2026-02-25T15:16:24.955 INFO:tasks.workunit.client.0.trial174.stdout: api_list: [ PASSED ] 11 tests. 2026-02-25T15:16:42.866 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:04:44.645 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:42.869 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:04:44.648 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:42.901 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:04:44.679 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:42.905 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:04:44.683 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:42.921 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:04:44.700 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:42.948 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:04:44.726 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:42.956 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:04:44.695 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:42.957 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:04:44.697 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:16:42.998 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:04:44.737 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.878 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:04.657 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.901 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:04.678 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.902 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:04.680 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.905 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:04.684 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.924 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:04.701 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.926 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:04.705 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.930 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:04.669 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.930 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:04.670 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:02.952 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:04.692 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.911 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:24.690 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.936 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:24.713 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.937 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:24.676 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.938 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:24.714 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.938 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:24.677 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.940 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:24.719 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.956 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:24.695 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.963 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:24.740 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:22.966 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:24.745 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:42.942 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:44.720 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:42.969 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:44.746 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:42.969 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:44.748 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:42.971 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:44.749 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:42.993 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:44.733 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:42.994 INFO:tasks.workunit.client.0.trial174.stdout:pi_aio: [ OK ] LibRadosAio.CancelBeforeComplete (3091 ms) 2026-02-25T15:17:42.994 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-25T15:17:42.994 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (3117 ms) 2026-02-25T15:17:42.994 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [----------] 29 tests from LibRadosAio (134379 ms total) 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6925 ms) 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6906 ms) 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7417 ms) 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6705 ms) 2026-02-25T15:17:42.995 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7112 ms) 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6791 ms) 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7392 ms) 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6847 ms) 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6834 ms) 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-25T15:17:42.996 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7184 ms) 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6858 ms) 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7030 ms) 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7120 ms) 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7008 ms) 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (6923 ms) 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6993 ms) 2026-02-25T15:17:42.997 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112054 ms total) 2026-02-25T15:17:42.998 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: 2026-02-25T15:17:42.998 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [----------] Global test environment tear-down 2026-02-25T15:17:42.998 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (246433 ms total) 2026-02-25T15:17:42.998 INFO:tasks.workunit.client.0.trial174.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-25T15:17:42.999 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:05:44.776 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:42.999 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:44.735 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:42.999 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:05:44.772 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:17:43.017 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:05:44.756 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.005 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:04.782 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.006 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:04.784 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.007 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:04.786 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.007 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:04.784 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.026 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:04.803 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.026 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:04.805 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.031 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:04.770 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.032 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:04.771 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:03.051 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:04.790 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:22.413 INFO:tasks.workunit.client.0.trial174.stdout:Aio.RoundTripAppendPP (3045 ms) 2026-02-25T15:18:22.414 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-25T15:18:22.414 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2851 ms) 2026-02-25T15:18:22.414 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-25T15:18:22.414 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3169 ms) 2026-02-25T15:18:22.414 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-25T15:18:22.415 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3154 ms) 2026-02-25T15:18:22.415 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-25T15:18:22.415 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: sending pool EIO time: 2026-02-25T15:16:17.266851+0000 2026-02-25T15:18:22.415 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-25T15:18:22.415 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-25T15:18:22.415 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: 2026-02-25T15:18:22.415 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (8809 ms) 2026-02-25T15:18:22.415 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3078 ms) 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (165413 ms total) 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (2980 ms) 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (8901 ms) 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15191 ms) 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-25T15:18:22.416 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3106 ms) 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30180 ms total) 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (2712 ms) 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (2713 ms total) 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (14065 ms) 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6983 ms) 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-25T15:18:22.417 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6981 ms) 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7194 ms) 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (2821 ms) 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7223 ms) 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6962 ms) 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6864 ms) 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-25T15:18:22.418 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7342 ms) 2026-02-25T15:18:22.419 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-25T15:18:22.419 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (6794 ms) 2026-02-25T15:18:22.419 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-25T15:18:22.419 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6993 ms) 2026-02-25T15:18:22.419 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-25T15:18:22.419 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7317 ms) 2026-02-25T15:18:23.051 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:24.828 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:23.051 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:24.829 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:23.052 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:24.791 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:23.052 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:24.829 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:23.053 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:24.832 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:23.054 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:24.794 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:23.071 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:24.848 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:23.073 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:24.813 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:23.073 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:24.852 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.306 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:42.085 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.331 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:42.110 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.353 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:42.131 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.358 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:42.097 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.359 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:42.099 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.360 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:42.137 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.361 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:42.138 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.380 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:42.119 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:40.381 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:42.158 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.076 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:44.854 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.078 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:44.857 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.087 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:06:44.865 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.104 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:44.881 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.104 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:44.882 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.105 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:44.844 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.106 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:44.845 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.111 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:06:44.888 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:18:43.112 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:06:44.852 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.095 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:04.873 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.124 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:04.903 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.146 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:04.924 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.155 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:04.931 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.156 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:04.894 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.156 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:04.933 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.159 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:04.898 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.179 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:04.956 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:03.181 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:04.920 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:17.277 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-25T15:19:17.277 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6913 ms) 2026-02-25T15:19:17.277 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-25T15:19:17.277 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3077 ms) 2026-02-25T15:19:17.277 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-25T15:19:17.277 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6917 ms) 2026-02-25T15:19:17.277 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6830 ms) 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (6919 ms) 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7281 ms) 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (6971 ms) 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6792 ms) 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139250 ms total) 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: 2026-02-25T15:19:17.278 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (129 ms) 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-25T15:19:17.279 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (2 ms) 2026-02-25T15:19:17.280 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (132 ms total) 2026-02-25T15:19:17.280 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: 2026-02-25T15:19:17.280 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-25T15:19:17.280 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (340713 ms total) 2026-02-25T15:19:17.280 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-25T15:19:17.280 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-25T15:19:17.280 INFO:tasks.workunit.client.0.trial174.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-25T15:19:17.281 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47756 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47756 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48566 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48566 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47937 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47937 2026-02-25T15:19:17.282 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48629 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48629 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48023 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48023 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48410 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48410 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48702 2026-02-25T15:19:17.283 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48702 2026-02-25T15:19:23.148 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:24.927 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:23.150 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:24.930 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:23.174 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:24.953 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:23.175 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:24.914 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:23.176 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:24.916 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:23.178 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:24.955 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:23.179 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:24.957 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:23.197 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:24.936 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:23.200 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:24.977 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:26.286 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-25T15:19:26.286 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-25T15:19:26.286 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-25T15:19:26.286 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-25T15:19:26.286 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-25T15:19:26.286 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: handle_notify cookie 94320059697136 notify_id 137438953472 notifier_gid 4790 2026-02-25T15:19:26.286 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (6813 ms) 2026-02-25T15:19:26.286 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: Trying... 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: handle_notify cookie 94320072524160 notify_id 154618822656 notifier_gid 4930 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: Waiting for 3.000000000s 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: Timed out. 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: Flushing... 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: Flushed... 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7400 ms) 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (14213 ms total) 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-25T15:19:26.287 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: Likely spurious timeout. 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (325282 ms) 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (4308 ms) 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (2660 ms) 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (3161 ms) 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (335412 ms total) 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (349626 ms total) 2026-02-25T15:19:26.288 INFO:tasks.workunit.client.0.trial174.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-25T15:19:26.291 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.291 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47968 2026-02-25T15:19:26.291 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47968 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48309 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48309 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48518 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48518 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48382 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48382 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48589 2026-02-25T15:19:26.292 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48589 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48249 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48249 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47887 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47887 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48671 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48671 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48146 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48146 2026-02-25T15:19:26.293 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47727 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47727 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47788 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47788 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48082 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48082 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=47826 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 47826 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.294 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48171 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48171 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48205 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48205 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48488 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48488 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ pid=48743 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ wait 48743 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ exit 0 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ cleanup 2026-02-25T15:19:26.295 INFO:tasks.workunit.client.0.trial174.stderr:+ pkill -P 47721 2026-02-25T15:19:26.297 INFO:tasks.workunit.client.0.trial174.stderr:+ true 2026-02-25T15:19:26.297 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-25T15:19:26.297 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-25T15:19:26.323 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2026-02-25T15:19:26.324 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-25T15:19:26.667 DEBUG:teuthology.parallel:result is None 2026-02-25T15:19:26.668 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T15:19:26.692 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T15:19:26.692 DEBUG:teuthology.orchestra.run.trial174:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-25T15:19:26.748 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T15:19:26.748 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-25T15:19:26.762 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T15:19:26.762 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:19:26.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.831+0000 7f6a45609640 10 monclient: get_monmap_and_config 2026-02-25T15:19:26.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.831+0000 7f6a45609640 10 monclient: build_initial_monmap 2026-02-25T15:19:26.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.831+0000 7f6a45609640 10 monclient: monmap: 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:26.832638+0000 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:26.832638+0000 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:26.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 1 Processor -- start 2026-02-25T15:19:26.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 1 -- start start 2026-02-25T15:19:26.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 10 monclient: init 2026-02-25T15:19:26.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:26.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:26.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 10 monclient(hunting): picked mon.noname-b con 0x7f6a40058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:26.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 10 monclient(hunting): picked mon.noname-c con 0x7f6a400b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:26.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 10 monclient(hunting): picked mon.noname-a con 0x7f6a401626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:26.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a401655c0 con 0x7f6a401626a0 2026-02-25T15:19:26.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a400b12b0 con 0x7f6a40058da0 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a400b1590 con 0x7f6a400b0410 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.832+0000 7f6a45609640 10 monclient(hunting): authenticate will time out at 3736.421755s 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.833+0000 7f6a3f7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6a401626a0 0x7f6a401c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50088/0 (socket says 10.20.193.78:50088) 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.833+0000 7f6a3f7fe640 1 -- 10.20.193.78:0/1154629650 learned_addr learned my addr 10.20.193.78:0/1154629650 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.833+0000 7f6a3effd640 1 --1- 10.20.193.78:0/1154629650 >> v1:10.20.193.155:6789/0 conn(0x7f6a40058da0 0x7f6a401647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:45842/0 (socket says 10.20.193.78:45842) 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695258172 0 0) 0x7f6a401655c0 con 0x7f6a401626a0 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): my global_id is 30750 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a2c003610 con 0x7f6a401626a0 2026-02-25T15:19:26.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733348724 0 0) 0x7f6a400b12b0 con 0x7f6a40058da0 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): my global_id is 30037 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a401655c0 con 0x7f6a40058da0 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160609840 0 0) 0x7f6a400b1590 con 0x7f6a400b0410 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 10 monclient(hunting): my global_id is 27584 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.834+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a400b12b0 con 0x7f6a400b0410 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4254966973 0 0) 0x7f6a401655c0 con 0x7f6a40058da0 2026-02-25T15:19:26.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 >> v1:10.20.193.167:6789/0 conn(0x7f6a400b0410 legacy=0x7f6a40164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 >> v1:10.20.193.78:6789/0 conn(0x7f6a401626a0 legacy=0x7f6a401c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 1 monclient: found mon.noname-b 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a400b1870 con 0x7f6a40058da0 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6a34002df0 con 0x7f6a40058da0 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:26.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a3dffb640 10 monclient: dump: 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a45609640 5 monclient: authenticate success, global_id 30037 2026-02-25T15:19:26.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.836+0000 7f6a45609640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a34002fc0 con 0x7f6a40058da0 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a3dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a3dffb640 1 -- 10.20.193.78:0/1154629650 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6a34003400 con 0x7f6a40058da0 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 4 set_mon_vals no callback set 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a3dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a3dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a3dffb640 10 monclient: dump: 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:26.850 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 10 monclient: shutdown 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 1 -- 10.20.193.78:0/1154629650 >> v1:10.20.193.155:6789/0 conn(0x7f6a40058da0 legacy=0x7f6a401647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 1 -- 10.20.193.78:0/1154629650 shutdown_connections 2026-02-25T15:19:26.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 1 -- 10.20.193.78:0/1154629650 >> 10.20.193.78:0/1154629650 conn(0x7f6a400b65f0 msgr2=0x7f6a400b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 1 -- 10.20.193.78:0/1154629650 shutdown_connections 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.837+0000 7f6a45609640 1 -- 10.20.193.78:0/1154629650 wait complete. 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 10 monclient: build_initial_monmap 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 10 monclient: monmap: 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 1 librados: starting msgr at 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 1 librados: starting objecter 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 1 Processor -- start 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 1 -- start start 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 1 librados: setting wanted keys 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 1 librados: calling monclient init 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.838+0000 7f6a45609640 10 monclient: init 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 10 monclient(hunting): picked mon.noname-a con 0x7f6a40058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 10 monclient(hunting): picked mon.noname-b con 0x7f6a400b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 10 monclient(hunting): picked mon.noname-c con 0x7f6a401626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a40162100 con 0x7f6a40058da0 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a40138d00 con 0x7f6a400b0410 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a40138fe0 con 0x7f6a401626a0 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a45609640 10 monclient(hunting): authenticate will time out at 3736.428274s 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a3effd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6a40058da0 0x7f6a40138460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50102/0 (socket says 10.20.193.78:50102) 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a3effd640 1 -- 10.20.193.78:0/366267338 learned_addr learned my addr 10.20.193.78:0/366267338 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a1f7fe640 10 client.?.objecter ms_handle_connect 0x7f6a40058da0 2026-02-25T15:19:26.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a1f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a1f7fe640 10 client.?.objecter ms_handle_connect 0x7f6a400b0410 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a1f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a1f7fe640 10 client.?.objecter ms_handle_connect 0x7f6a401626a0 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.839+0000 7f6a1f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321931182 0 0) 0x7f6a40138d00 con 0x7f6a400b0410 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): my global_id is 30040 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a0c003610 con 0x7f6a400b0410 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828973589 0 0) 0x7f6a40162100 con 0x7f6a40058da0 2026-02-25T15:19:26.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): my global_id is 30753 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a40138d00 con 0x7f6a40058da0 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620741972 0 0) 0x7f6a40138fe0 con 0x7f6a401626a0 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 10 monclient(hunting): my global_id is 27587 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.840+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a40162100 con 0x7f6a401626a0 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.842+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1117799610 0 0) 0x7f6a0c003610 con 0x7f6a400b0410 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.842+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a40138fe0 con 0x7f6a400b0410 2026-02-25T15:19:26.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.842+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6a28003060 con 0x7f6a400b0410 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.842+0000 7f6a1f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.842+0000 7f6a1f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.842+0000 7f6a1f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:26.857 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.842+0000 7f6a1f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 598706812 0 0) 0x7f6a40138d00 con 0x7f6a40058da0 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a0c003610 con 0x7f6a40058da0 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6a34003310 con 0x7f6a40058da0 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.858 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2061584045 0 0) 0x7f6a40162100 con 0x7f6a401626a0 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a40138d00 con 0x7f6a401626a0 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6a30003250 con 0x7f6a401626a0 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.843+0000 7f6a1f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:26.859 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1975359853 0 0) 0x7f6a40138fe0 con 0x7f6a400b0410 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 >> v1:10.20.193.167:6789/0 conn(0x7f6a401626a0 legacy=0x7f6a401fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 >> v1:10.20.193.78:6789/0 conn(0x7f6a40058da0 legacy=0x7f6a40138460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:26.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 1 monclient: found mon.b 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a401392c0 con 0x7f6a400b0410 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 5 monclient: authenticate success, global_id 30040 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 10 monclient: _renew_subs 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6a401395a0 con 0x7f6a400b0410 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 10 client.30040.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:26.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 10 monclient: _renew_subs 2026-02-25T15:19:26.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:26.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6a401face0 con 0x7f6a400b0410 2026-02-25T15:19:26.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 1 librados: init done 2026-02-25T15:19:26.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:26.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:26.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:26.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.844+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a40163bc0 con 0x7f6a400b0410 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.849+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a28003700 con 0x7f6a400b0410 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.849+0000 7f6a1f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.849+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6a28003a50 con 0x7f6a400b0410 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.849+0000 7f6a1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.849+0000 7f6a1f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.849+0000 7f6a1f7fe640 10 monclient: dump: 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:26.864 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.849+0000 7f6a3d7fa640 4 set_mon_vals no callback set 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.853+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6a2801c720 con 0x7f6a400b0410 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.854+0000 7f6a3effd640 10 monclient: get_auth_request con 0x7f6a0c077db0 auth_method 0 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.854+0000 7f6a1f7fe640 10 client.30040.objecter ms_handle_connect 0x7f6a0c077db0 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.854+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(351..351 src has 1..351) ==== 8955+0+0 (unknown 1841964965 0 0) 0x7f6a28091ff0 con 0x7f6a400b0410 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.854+0000 7f6a1f7fe640 10 client.30040.objecter ms_dispatch2 0x7f6a40000b90 osd_map(351..351 src has 1..351) 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.854+0000 7f6a1f7fe640 3 client.30040.objecter handle_osd_map got epochs [351,351] > 0 2026-02-25T15:19:26.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.854+0000 7f6a1f7fe640 3 client.30040.objecter handle_osd_map decoding full epoch 351 2026-02-25T15:19:26.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.854+0000 7f6a1f7fe640 20 client.30040.objecter dump_active .. 0 homeless 2026-02-25T15:19:26.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.943+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6a2805ca20 con 0x7f6a400b0410 2026-02-25T15:19:26.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.943+0000 7f6a1f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:26.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:26.943+0000 7f6a1f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:27.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.047+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a400b6c10 con 0x7f6a0c077db0 2026-02-25T15:19:27.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.048+0000 7f6a1f7fe640 1 -- 10.20.193.78:0/366267338 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125438 (unknown 2965378022 0 1204392180) 0x7f6a400b6c10 con 0x7f6a0c077db0 2026-02-25T15:19:27.052 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:19:27.053 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-25T15:19:27.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.049+0000 7f6a45609640 10 librados: watch_flush enter 2026-02-25T15:19:27.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.049+0000 7f6a45609640 10 librados: watch_flush exit 2026-02-25T15:19:27.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.049+0000 7f6a45609640 20 client.30040.objecter shutdown clearing up homeless session... 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.049+0000 7f6a45609640 10 client.30040.objecter successfully canceled tick 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6a0c077db0 legacy=0x7f6a0c098260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 10 monclient: shutdown 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 >> v1:10.20.193.155:6789/0 conn(0x7f6a400b0410 legacy=0x7f6a401619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 shutdown_connections 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 >> 10.20.193.78:0/366267338 conn(0x7f6a400b65f0 msgr2=0x7f6a40059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 shutdown_connections 2026-02-25T15:19:27.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 1 -- 10.20.193.78:0/366267338 wait complete. 2026-02-25T15:19:27.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.050+0000 7f6a45609640 1 librados: shutdown 2026-02-25T15:19:27.060 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2026-02-25T15:19:26.806845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":561260,"kb_used_data":111852,"kb_used_omap":24528,"kb_used_meta":424623,"kb_avail":1509388180,"statfs":{"total":1546188226560,"available":1545613496320,"internally_reserved":0,"allocated":114536448,"data_stored":73070621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25117127,"internal_metadata":434814521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":128,"apply_latency_ms":128,"commit_latency_ns":128000000,"apply_latency_ns":128000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000560"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.603903+0000","last_change":"2026-02-25T15:13:41.230819+0000","last_active":"2026-02-25T15:19:21.603903+0000","last_peered":"2026-02-25T15:19:21.603903+0000","last_clean":"2026-02-25T15:19:21.603903+0000","last_became_active":"2026-02-25T15:13:41.228177+0000","last_became_peered":"2026-02-25T15:13:41.228177+0000","last_unstale":"2026-02-25T15:19:21.603903+0000","last_undegraded":"2026-02-25T15:19:21.603903+0000","last_fullsized":"2026-02-25T15:19:21.603903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:49:00.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.588554+0000","last_change":"2026-02-25T15:13:41.573948+0000","last_active":"2026-02-25T15:19:21.588554+0000","last_peered":"2026-02-25T15:19:21.588554+0000","last_clean":"2026-02-25T15:19:21.588554+0000","last_became_active":"2026-02-25T15:13:41.568996+0000","last_became_peered":"2026-02-25T15:13:41.568996+0000","last_unstale":"2026-02-25T15:19:21.588554+0000","last_undegraded":"2026-02-25T15:19:21.588554+0000","last_fullsized":"2026-02-25T15:19:21.588554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:28:43.106179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.236151+0000","last_change":"2026-02-25T15:13:41.273148+0000","last_active":"2026-02-25T15:19:25.236151+0000","last_peered":"2026-02-25T15:19:25.236151+0000","last_clean":"2026-02-25T15:19:25.236151+0000","last_became_active":"2026-02-25T15:13:41.269950+0000","last_became_peered":"2026-02-25T15:13:41.269950+0000","last_unstale":"2026-02-25T15:19:25.236151+0000","last_undegraded":"2026-02-25T15:19:25.236151+0000","last_fullsized":"2026-02-25T15:19:25.236151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:33:46.151980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.286367+0000","last_change":"2026-02-25T15:13:40.992594+0000","last_active":"2026-02-25T15:19:25.286367+0000","last_peered":"2026-02-25T15:19:25.286367+0000","last_clean":"2026-02-25T15:19:25.286367+0000","last_became_active":"2026-02-25T15:13:40.989776+0000","last_became_peered":"2026-02-25T15:13:40.989776+0000","last_unstale":"2026-02-25T15:19:25.286367+0000","last_undegraded":"2026-02-25T15:19:25.286367+0000","last_fullsized":"2026-02-25T15:19:25.286367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:55:46.397970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.274734+0000","last_change":"2026-02-25T15:13:41.092568+0000","last_active":"2026-02-25T15:19:26.274734+0000","last_peered":"2026-02-25T15:19:26.274734+0000","last_clean":"2026-02-25T15:19:26.274734+0000","last_became_active":"2026-02-25T15:13:41.090430+0000","last_became_peered":"2026-02-25T15:13:41.090430+0000","last_unstale":"2026-02-25T15:19:26.274734+0000","last_undegraded":"2026-02-25T15:19:26.274734+0000","last_fullsized":"2026-02-25T15:19:26.274734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:14:22.171630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.268344+0000","last_change":"2026-02-25T15:13:41.057696+0000","last_active":"2026-02-25T15:19:26.268344+0000","last_peered":"2026-02-25T15:19:26.268344+0000","last_clean":"2026-02-25T15:19:26.268344+0000","last_became_active":"2026-02-25T15:13:41.036970+0000","last_became_peered":"2026-02-25T15:13:41.036970+0000","last_unstale":"2026-02-25T15:19:26.268344+0000","last_undegraded":"2026-02-25T15:19:26.268344+0000","last_fullsized":"2026-02-25T15:19:26.268344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:39:06.670127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.239251+0000","last_change":"2026-02-25T15:13:41.099282+0000","last_active":"2026-02-25T15:19:25.239251+0000","last_peered":"2026-02-25T15:19:25.239251+0000","last_clean":"2026-02-25T15:19:25.239251+0000","last_became_active":"2026-02-25T15:13:41.097058+0000","last_became_peered":"2026-02-25T15:13:41.097058+0000","last_unstale":"2026-02-25T15:19:25.239251+0000","last_undegraded":"2026-02-25T15:19:25.239251+0000","last_fullsized":"2026-02-25T15:19:25.239251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:45:41.954587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":647,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.288531+0000","last_change":"2026-02-25T15:13:40.983728+0000","last_active":"2026-02-25T15:19:25.288531+0000","last_peered":"2026-02-25T15:19:25.288531+0000","last_clean":"2026-02-25T15:19:25.288531+0000","last_became_active":"2026-02-25T15:13:40.967270+0000","last_became_peered":"2026-02-25T15:13:40.967270+0000","last_unstale":"2026-02-25T15:19:25.288531+0000","last_undegraded":"2026-02-25T15:19:25.288531+0000","last_fullsized":"2026-02-25T15:19:25.288531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:08:51.542526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.308023+0000","last_change":"2026-02-25T15:13:42.531762+0000","last_active":"2026-02-25T15:19:26.308023+0000","last_peered":"2026-02-25T15:19:26.308023+0000","last_clean":"2026-02-25T15:19:26.308023+0000","last_became_active":"2026-02-25T15:13:42.528480+0000","last_became_peered":"2026-02-25T15:13:42.528480+0000","last_unstale":"2026-02-25T15:19:26.308023+0000","last_undegraded":"2026-02-25T15:19:26.308023+0000","last_fullsized":"2026-02-25T15:19:26.308023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:29:51.951525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.280073+0000","last_change":"2026-02-25T15:13:40.710531+0000","last_active":"2026-02-25T15:19:25.280073+0000","last_peered":"2026-02-25T15:19:25.280073+0000","last_clean":"2026-02-25T15:19:25.280073+0000","last_became_active":"2026-02-25T15:13:40.708195+0000","last_became_peered":"2026-02-25T15:13:40.708195+0000","last_unstale":"2026-02-25T15:19:25.280073+0000","last_undegraded":"2026-02-25T15:19:25.280073+0000","last_fullsized":"2026-02-25T15:19:25.280073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:38:22.786132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.237514+0000","last_change":"2026-02-25T15:13:41.101698+0000","last_active":"2026-02-25T15:19:25.237514+0000","last_peered":"2026-02-25T15:19:25.237514+0000","last_clean":"2026-02-25T15:19:25.237514+0000","last_became_active":"2026-02-25T15:13:41.096638+0000","last_became_peered":"2026-02-25T15:13:41.096638+0000","last_unstale":"2026-02-25T15:19:25.237514+0000","last_undegraded":"2026-02-25T15:19:25.237514+0000","last_fullsized":"2026-02-25T15:19:25.237514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:46:32.563058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.591024+0000","last_change":"2026-02-25T15:13:40.931228+0000","last_active":"2026-02-25T15:19:21.591024+0000","last_peered":"2026-02-25T15:19:21.591024+0000","last_clean":"2026-02-25T15:19:21.591024+0000","last_became_active":"2026-02-25T15:13:40.929107+0000","last_became_peered":"2026-02-25T15:13:40.929107+0000","last_unstale":"2026-02-25T15:19:21.591024+0000","last_undegraded":"2026-02-25T15:19:21.591024+0000","last_fullsized":"2026-02-25T15:19:21.591024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:17:18.195998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":641,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.269130+0000","last_change":"2026-02-25T15:13:41.276463+0000","last_active":"2026-02-25T15:19:25.269130+0000","last_peered":"2026-02-25T15:19:25.269130+0000","last_clean":"2026-02-25T15:19:25.269130+0000","last_became_active":"2026-02-25T15:13:41.271609+0000","last_became_peered":"2026-02-25T15:13:41.271609+0000","last_unstale":"2026-02-25T15:19:25.269130+0000","last_undegraded":"2026-02-25T15:19:25.269130+0000","last_fullsized":"2026-02-25T15:19:25.269130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:52:28.798855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.228818+0000","last_change":"2026-02-25T15:13:40.970698+0000","last_active":"2026-02-25T15:19:25.228818+0000","last_peered":"2026-02-25T15:19:25.228818+0000","last_clean":"2026-02-25T15:19:25.228818+0000","last_became_active":"2026-02-25T15:13:40.968637+0000","last_became_peered":"2026-02-25T15:13:40.968637+0000","last_unstale":"2026-02-25T15:19:25.228818+0000","last_undegraded":"2026-02-25T15:19:25.228818+0000","last_fullsized":"2026-02-25T15:19:25.228818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:43:07.137572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":640,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.683636+0000","last_change":"2026-02-25T15:13:40.965092+0000","last_active":"2026-02-25T15:19:21.683636+0000","last_peered":"2026-02-25T15:19:21.683636+0000","last_clean":"2026-02-25T15:19:21.683636+0000","last_became_active":"2026-02-25T15:13:40.949974+0000","last_became_peered":"2026-02-25T15:13:40.949974+0000","last_unstale":"2026-02-25T15:19:21.683636+0000","last_undegraded":"2026-02-25T15:19:21.683636+0000","last_fullsized":"2026-02-25T15:19:21.683636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:14:03.541451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":647,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.284795+0000","last_change":"2026-02-25T15:13:41.003202+0000","last_active":"2026-02-25T15:19:25.284795+0000","last_peered":"2026-02-25T15:19:25.284795+0000","last_clean":"2026-02-25T15:19:25.284795+0000","last_became_active":"2026-02-25T15:13:40.988676+0000","last_became_peered":"2026-02-25T15:13:40.988676+0000","last_unstale":"2026-02-25T15:19:25.284795+0000","last_undegraded":"2026-02-25T15:19:25.284795+0000","last_fullsized":"2026-02-25T15:19:25.284795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:24:11.988588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.223776+0000","last_change":"2026-02-25T15:13:40.749992+0000","last_active":"2026-02-25T15:19:25.223776+0000","last_peered":"2026-02-25T15:19:25.223776+0000","last_clean":"2026-02-25T15:19:25.223776+0000","last_became_active":"2026-02-25T15:13:40.743919+0000","last_became_peered":"2026-02-25T15:13:40.743919+0000","last_unstale":"2026-02-25T15:19:25.223776+0000","last_undegraded":"2026-02-25T15:19:25.223776+0000","last_fullsized":"2026-02-25T15:19:25.223776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:26:24.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.346113+0000","last_change":"2026-02-25T15:13:41.344196+0000","last_active":"2026-02-25T15:19:25.346113+0000","last_peered":"2026-02-25T15:19:25.346113+0000","last_clean":"2026-02-25T15:19:25.346113+0000","last_became_active":"2026-02-25T15:13:41.340878+0000","last_became_peered":"2026-02-25T15:13:41.340878+0000","last_unstale":"2026-02-25T15:19:25.346113+0000","last_undegraded":"2026-02-25T15:19:25.346113+0000","last_fullsized":"2026-02-25T15:19:25.346113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:16:19.205261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.262539+0000","last_change":"2026-02-25T15:13:40.966222+0000","last_active":"2026-02-25T15:19:25.262539+0000","last_peered":"2026-02-25T15:19:25.262539+0000","last_clean":"2026-02-25T15:19:25.262539+0000","last_became_active":"2026-02-25T15:13:40.959639+0000","last_became_peered":"2026-02-25T15:13:40.959639+0000","last_unstale":"2026-02-25T15:19:25.262539+0000","last_undegraded":"2026-02-25T15:19:25.262539+0000","last_fullsized":"2026-02-25T15:19:25.262539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:00:51.139281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.319327+0000","last_change":"2026-02-25T15:13:41.106488+0000","last_active":"2026-02-25T15:19:26.319327+0000","last_peered":"2026-02-25T15:19:26.319327+0000","last_clean":"2026-02-25T15:19:26.319327+0000","last_became_active":"2026-02-25T15:13:41.104041+0000","last_became_peered":"2026-02-25T15:13:41.104041+0000","last_unstale":"2026-02-25T15:19:26.319327+0000","last_undegraded":"2026-02-25T15:19:26.319327+0000","last_fullsized":"2026-02-25T15:19:26.319327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:48:29.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.343833+0000","last_change":"2026-02-25T15:13:41.920429+0000","last_active":"2026-02-25T15:19:25.343833+0000","last_peered":"2026-02-25T15:19:25.343833+0000","last_clean":"2026-02-25T15:19:25.343833+0000","last_became_active":"2026-02-25T15:13:41.918321+0000","last_became_peered":"2026-02-25T15:13:41.918321+0000","last_unstale":"2026-02-25T15:19:25.343833+0000","last_undegraded":"2026-02-25T15:19:25.343833+0000","last_fullsized":"2026-02-25T15:19:25.343833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:57:47.179868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.272670+0000","last_change":"2026-02-25T15:13:41.080682+0000","last_active":"2026-02-25T15:19:25.272670+0000","last_peered":"2026-02-25T15:19:25.272670+0000","last_clean":"2026-02-25T15:19:25.272670+0000","last_became_active":"2026-02-25T15:13:41.078571+0000","last_became_peered":"2026-02-25T15:13:41.078571+0000","last_unstale":"2026-02-25T15:19:25.272670+0000","last_undegraded":"2026-02-25T15:19:25.272670+0000","last_fullsized":"2026-02-25T15:19:25.272670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:59:53.550632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.283969+0000","last_change":"2026-02-25T15:13:41.031697+0000","last_active":"2026-02-25T15:19:25.283969+0000","last_peered":"2026-02-25T15:19:25.283969+0000","last_clean":"2026-02-25T15:19:25.283969+0000","last_became_active":"2026-02-25T15:13:41.027073+0000","last_became_peered":"2026-02-25T15:13:41.027073+0000","last_unstale":"2026-02-25T15:19:25.283969+0000","last_undegraded":"2026-02-25T15:19:25.283969+0000","last_fullsized":"2026-02-25T15:19:25.283969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:46:27.108833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.235782+0000","last_change":"2026-02-25T15:13:40.948864+0000","last_active":"2026-02-25T15:19:25.235782+0000","last_peered":"2026-02-25T15:19:25.235782+0000","last_clean":"2026-02-25T15:19:25.235782+0000","last_became_active":"2026-02-25T15:13:40.944589+0000","last_became_peered":"2026-02-25T15:13:40.944589+0000","last_unstale":"2026-02-25T15:19:25.235782+0000","last_undegraded":"2026-02-25T15:19:25.235782+0000","last_fullsized":"2026-02-25T15:19:25.235782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:57:01.500928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.308760+0000","last_change":"2026-02-25T15:13:42.005732+0000","last_active":"2026-02-25T15:19:26.308760+0000","last_peered":"2026-02-25T15:19:26.308760+0000","last_clean":"2026-02-25T15:19:26.308760+0000","last_became_active":"2026-02-25T15:13:42.003162+0000","last_became_peered":"2026-02-25T15:13:42.003162+0000","last_unstale":"2026-02-25T15:19:26.308760+0000","last_undegraded":"2026-02-25T15:19:26.308760+0000","last_fullsized":"2026-02-25T15:19:26.308760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:38:43.188701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.282230+0000","last_change":"2026-02-25T15:13:41.042732+0000","last_active":"2026-02-25T15:19:26.282230+0000","last_peered":"2026-02-25T15:19:26.282230+0000","last_clean":"2026-02-25T15:19:26.282230+0000","last_became_active":"2026-02-25T15:13:41.040468+0000","last_became_peered":"2026-02-25T15:13:41.040468+0000","last_unstale":"2026-02-25T15:19:26.282230+0000","last_undegraded":"2026-02-25T15:19:26.282230+0000","last_fullsized":"2026-02-25T15:19:26.282230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:14:52.942685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.352513+0000","last_change":"2026-02-25T15:13:40.464514+0000","last_active":"2026-02-25T15:19:25.352513+0000","last_peered":"2026-02-25T15:19:25.352513+0000","last_clean":"2026-02-25T15:19:25.352513+0000","last_became_active":"2026-02-25T15:13:40.462421+0000","last_became_peered":"2026-02-25T15:13:40.462421+0000","last_unstale":"2026-02-25T15:19:25.352513+0000","last_undegraded":"2026-02-25T15:19:25.352513+0000","last_fullsized":"2026-02-25T15:19:25.352513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:13:19.955826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.351051+0000","last_change":"2026-02-25T15:13:40.746985+0000","last_active":"2026-02-25T15:19:25.351051+0000","last_peered":"2026-02-25T15:19:25.351051+0000","last_clean":"2026-02-25T15:19:25.351051+0000","last_became_active":"2026-02-25T15:13:40.744228+0000","last_became_peered":"2026-02-25T15:13:40.744228+0000","last_unstale":"2026-02-25T15:19:25.351051+0000","last_undegraded":"2026-02-25T15:19:25.351051+0000","last_fullsized":"2026-02-25T15:19:25.351051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:17:18.195998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.1","version":"33'11","reported_seq":674,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.234406+0000","last_change":"2026-02-25T15:13:40.735103+0000","last_active":"2026-02-25T15:19:25.234406+0000","last_peered":"2026-02-25T15:19:25.234406+0000","last_clean":"2026-02-25T15:19:25.234406+0000","last_became_active":"2026-02-25T15:13:40.703448+0000","last_became_peered":"2026-02-25T15:13:40.703448+0000","last_unstale":"2026-02-25T15:19:25.234406+0000","last_undegraded":"2026-02-25T15:19:25.234406+0000","last_fullsized":"2026-02-25T15:19:25.234406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:12:02.614079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.586169+0000","last_change":"2026-02-25T15:13:41.235640+0000","last_active":"2026-02-25T15:19:21.586169+0000","last_peered":"2026-02-25T15:19:21.586169+0000","last_clean":"2026-02-25T15:19:21.586169+0000","last_became_active":"2026-02-25T15:13:41.233579+0000","last_became_peered":"2026-02-25T15:13:41.233579+0000","last_unstale":"2026-02-25T15:19:21.586169+0000","last_undegraded":"2026-02-25T15:19:21.586169+0000","last_fullsized":"2026-02-25T15:19:21.586169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:52:24.301222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.242167+0000","last_change":"2026-02-25T15:13:41.023468+0000","last_active":"2026-02-25T15:19:25.242167+0000","last_peered":"2026-02-25T15:19:25.242167+0000","last_clean":"2026-02-25T15:19:25.242167+0000","last_became_active":"2026-02-25T15:13:41.021310+0000","last_became_peered":"2026-02-25T15:13:41.021310+0000","last_unstale":"2026-02-25T15:19:25.242167+0000","last_undegraded":"2026-02-25T15:19:25.242167+0000","last_fullsized":"2026-02-25T15:19:25.242167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:59:17.205188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.278159+0000","last_change":"2026-02-25T15:13:40.703490+0000","last_active":"2026-02-25T15:19:25.278159+0000","last_peered":"2026-02-25T15:19:25.278159+0000","last_clean":"2026-02-25T15:19:25.278159+0000","last_became_active":"2026-02-25T15:13:40.701282+0000","last_became_peered":"2026-02-25T15:13:40.701282+0000","last_unstale":"2026-02-25T15:19:25.278159+0000","last_undegraded":"2026-02-25T15:19:25.278159+0000","last_fullsized":"2026-02-25T15:19:25.278159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:33:36.654692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,12],"acting":[5,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":663,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.316811+0000","last_change":"2026-02-25T15:13:02.846272+0000","last_active":"2026-02-25T15:19:26.316811+0000","last_peered":"2026-02-25T15:19:26.316811+0000","last_clean":"2026-02-25T15:19:26.316811+0000","last_became_active":"2026-02-25T15:13:01.240693+0000","last_became_peered":"2026-02-25T15:13:01.240693+0000","last_unstale":"2026-02-25T15:19:26.316811+0000","last_undegraded":"2026-02-25T15:19:26.316811+0000","last_fullsized":"2026-02-25T15:19:26.316811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:32:46.429234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068336521999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,15],"acting":[12,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":663,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.241263+0000","last_change":"2026-02-25T15:13:03.354671+0000","last_active":"2026-02-25T15:19:25.241263+0000","last_peered":"2026-02-25T15:19:25.241263+0000","last_clean":"2026-02-25T15:19:25.241263+0000","last_became_active":"2026-02-25T15:13:01.107596+0000","last_became_peered":"2026-02-25T15:13:01.107596+0000","last_unstale":"2026-02-25T15:19:25.241263+0000","last_undegraded":"2026-02-25T15:19:25.241263+0000","last_fullsized":"2026-02-25T15:19:25.241263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:21.484744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043275358999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":662,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.245972+0000","last_change":"2026-02-25T15:13:04.197397+0000","last_active":"2026-02-25T15:19:25.245972+0000","last_peered":"2026-02-25T15:19:25.245972+0000","last_clean":"2026-02-25T15:19:25.245972+0000","last_became_active":"2026-02-25T15:13:00.886357+0000","last_became_peered":"2026-02-25T15:13:00.886357+0000","last_unstale":"2026-02-25T15:19:25.245972+0000","last_undegraded":"2026-02-25T15:19:25.245972+0000","last_fullsized":"2026-02-25T15:19:25.245972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:21:14.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047817094999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":662,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.243478+0000","last_change":"2026-02-25T15:13:04.192793+0000","last_active":"2026-02-25T15:19:25.243478+0000","last_peered":"2026-02-25T15:19:25.243478+0000","last_clean":"2026-02-25T15:19:25.243478+0000","last_became_active":"2026-02-25T15:13:01.030043+0000","last_became_peered":"2026-02-25T15:13:01.030043+0000","last_unstale":"2026-02-25T15:19:25.243478+0000","last_undegraded":"2026-02-25T15:19:25.243478+0000","last_fullsized":"2026-02-25T15:19:25.243478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:56:20.078816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047341022000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14],"acting":[11,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"28'2","reported_seq":666,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.291712+0000","last_change":"2026-02-25T15:13:02.847201+0000","last_active":"2026-02-25T15:19:26.291712+0000","last_peered":"2026-02-25T15:19:26.291712+0000","last_clean":"2026-02-25T15:19:26.291712+0000","last_became_active":"2026-02-25T15:13:01.242716+0000","last_became_peered":"2026-02-25T15:13:01.242716+0000","last_unstale":"2026-02-25T15:19:26.291712+0000","last_undegraded":"2026-02-25T15:19:26.291712+0000","last_fullsized":"2026-02-25T15:19:26.291712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:42.867009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073362477999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,8],"acting":[12,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":663,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.249804+0000","last_change":"2026-02-25T15:13:03.340291+0000","last_active":"2026-02-25T15:19:25.249804+0000","last_peered":"2026-02-25T15:19:25.249804+0000","last_clean":"2026-02-25T15:19:25.249804+0000","last_became_active":"2026-02-25T15:13:01.167595+0000","last_became_peered":"2026-02-25T15:13:01.167595+0000","last_unstale":"2026-02-25T15:19:25.249804+0000","last_undegraded":"2026-02-25T15:19:25.249804+0000","last_fullsized":"2026-02-25T15:19:25.249804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:48:42.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030257392000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":666,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.349306+0000","last_change":"2026-02-25T15:13:03.344370+0000","last_active":"2026-02-25T15:19:25.349306+0000","last_peered":"2026-02-25T15:19:25.349306+0000","last_clean":"2026-02-25T15:19:25.349306+0000","last_became_active":"2026-02-25T15:13:01.165967+0000","last_became_peered":"2026-02-25T15:13:01.165967+0000","last_unstale":"2026-02-25T15:19:25.349306+0000","last_undegraded":"2026-02-25T15:19:25.349306+0000","last_fullsized":"2026-02-25T15:19:25.349306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:41:44.607565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030945777000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"26'1","reported_seq":665,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.294757+0000","last_change":"2026-02-25T15:13:02.837950+0000","last_active":"2026-02-25T15:19:26.294757+0000","last_peered":"2026-02-25T15:19:26.294757+0000","last_clean":"2026-02-25T15:19:26.294757+0000","last_became_active":"2026-02-25T15:13:01.049643+0000","last_became_peered":"2026-02-25T15:13:01.049643+0000","last_unstale":"2026-02-25T15:19:26.294757+0000","last_undegraded":"2026-02-25T15:19:26.294757+0000","last_fullsized":"2026-02-25T15:19:26.294757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:51:09.091771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059457101999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"1.0","version":"24'32","reported_seq":701,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.606180+0000","last_change":"2026-02-25T15:12:53.255197+0000","last_active":"2026-02-25T15:19:21.606180+0000","last_peered":"2026-02-25T15:19:21.606180+0000","last_clean":"2026-02-25T15:19:21.606180+0000","last_became_active":"2026-02-25T15:12:53.235995+0000","last_became_peered":"2026-02-25T15:12:53.235995+0000","last_unstale":"2026-02-25T15:19:21.606180+0000","last_undegraded":"2026-02-25T15:19:21.606180+0000","last_fullsized":"2026-02-25T15:19:21.606180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_clean_scrub_stamp":"2026-02-25T15:12:51.067937+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:13:12.776604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280592,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51904,"kb_used_data":6896,"kb_used_omap":4682,"kb_used_meta":40309,"kb_avail":94319936,"statfs":{"total":96636764160,"available":96583614464,"internally_reserved":0,"allocated":7061504,"data_stored":4488878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4795118,"internal_metadata":41276690},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280593,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220942,"internal_metadata":27369714},"hb_peers":[1,2,3,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280594,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4518007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218768,"internal_metadata":27371888},"hb_peers":[0,1,2,4,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":3023,"kb_used_meta":23920,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3096452,"internal_metadata":24494204},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313297,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":8641,"kb_used_meta":18302,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8848431,"internal_metadata":18742225},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33840,"kb_used_data":6880,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338000,"statfs":{"total":96636764160,"available":96602112000,"internally_reserved":0,"allocated":7045120,"data_stored":4479247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214678,"internal_metadata":27375978},"hb_peers":[1,3,4,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280593,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34292,"kb_used_data":7332,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94337548,"statfs":{"total":96636764160,"available":96601649152,"internally_reserved":0,"allocated":7507968,"data_stored":4938527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216439,"internal_metadata":27374217},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280593,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216025,"internal_metadata":27374631},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218373,"internal_metadata":27372283},"hb_peers":[0,1,2,4,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280593,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34364,"kb_used_data":7404,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337476,"statfs":{"total":96636764160,"available":96601575424,"internally_reserved":0,"allocated":7581696,"data_stored":4977273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218913,"internal_metadata":27371743},"hb_peers":[0,1,2,3,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280593,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":2927,"kb_used_meta":24016,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4517993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2997987,"internal_metadata":24592669},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280593,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4527526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218065,"internal_metadata":27372591},"hb_peers":[0,1,2,3,4,5,6,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280593,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4518007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218898,"internal_metadata":27371758},"hb_peers":[0,1,2,3,4,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280594,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33840,"kb_used_data":6880,"kb_used_omap":182,"kb_used_meta":26761,"kb_avail":94338000,"statfs":{"total":96636764160,"available":96602112000,"internally_reserved":0,"allocated":7045120,"data_stored":4479247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187370,"internal_metadata":27403286},"hb_peers":[0,1,2,3,4,5,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280594,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3092248,"internal_metadata":24498408},"hb_peers":[0,1,2,3,4,5,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280593,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138420,"internal_metadata":27452236},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:19:27.064 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:19:27.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.129+0000 7fe1fe7c8640 10 monclient: get_monmap_and_config 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.129+0000 7fe1fe7c8640 10 monclient: build_initial_monmap 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.129+0000 7fe1fe7c8640 10 monclient: monmap: 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:27.130696+0000 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:27.130696+0000 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:27.132 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 1 Processor -- start 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 1 -- start start 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 10 monclient: init 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 10 monclient(hunting): picked mon.noname-a con 0x7fe1f8058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 10 monclient(hunting): picked mon.noname-c con 0x7fe1f80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 10 monclient(hunting): picked mon.noname-b con 0x7fe1f81626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f81655c0 con 0x7fe1f8058da0 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f80b12b0 con 0x7fe1f81626a0 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f80b1590 con 0x7fe1f80b0410 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.130+0000 7fe1fe7c8640 10 monclient(hunting): authenticate will time out at 3736.719781s 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.131+0000 7fe1f7fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe1f8058da0 0x7fe1f81647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50106/0 (socket says 10.20.193.78:50106) 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.131+0000 7fe1f7fff640 1 -- 10.20.193.78:0/1441109336 learned_addr learned my addr 10.20.193.78:0/1441109336 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:27.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.131+0000 7fe1fcd3e640 1 --1- 10.20.193.78:0/1441109336 >> v1:10.20.193.155:6789/0 conn(0x7fe1f81626a0 0x7fe1f81c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:45870/0 (socket says 10.20.193.78:45870) 2026-02-25T15:19:27.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640236230 0 0) 0x7fe1f81655c0 con 0x7fe1f8058da0 2026-02-25T15:19:27.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 10 monclient(hunting): my global_id is 30756 2026-02-25T15:19:27.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1dc003610 con 0x7fe1f8058da0 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436532505 0 0) 0x7fe1f80b1590 con 0x7fe1f80b0410 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 10 monclient(hunting): my global_id is 27590 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.132+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f81655c0 con 0x7fe1f80b0410 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.133+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786065812 0 0) 0x7fe1f80b12b0 con 0x7fe1f81626a0 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.133+0000 7fe1f6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.133+0000 7fe1f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.133+0000 7fe1f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.133+0000 7fe1f6ffd640 10 monclient(hunting): my global_id is 30043 2026-02-25T15:19:27.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.133+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f80b1590 con 0x7fe1f81626a0 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4002013195 0 0) 0x7fe1dc003610 con 0x7fe1f8058da0 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 >> v1:10.20.193.167:6789/0 conn(0x7fe1f80b0410 legacy=0x7fe1f8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 >> v1:10.20.193.155:6789/0 conn(0x7fe1f81626a0 legacy=0x7fe1f81c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 1 monclient: found mon.noname-a 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f80b1870 con 0x7fe1f8058da0 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:27.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1e4002df0 con 0x7fe1f8058da0 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1f6ffd640 10 monclient: dump: 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1fe7c8640 5 monclient: authenticate success, global_id 30756 2026-02-25T15:19:27.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.134+0000 7fe1fe7c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1e4002fc0 con 0x7fe1f8058da0 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1f6ffd640 1 -- 10.20.193.78:0/1441109336 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1e4003400 con 0x7fe1f8058da0 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1f6ffd640 10 monclient: dump: 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 4 set_mon_vals no callback set 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 10 monclient: shutdown 2026-02-25T15:19:27.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/1441109336 >> v1:10.20.193.78:6789/0 conn(0x7fe1f8058da0 legacy=0x7fe1f81647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/1441109336 shutdown_connections 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/1441109336 >> 10.20.193.78:0/1441109336 conn(0x7fe1f80b65f0 msgr2=0x7fe1f80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/1441109336 shutdown_connections 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.135+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/1441109336 wait complete. 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient: build_initial_monmap 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient: monmap: 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 librados: starting msgr at 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 librados: starting objecter 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:27.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 Processor -- start 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 -- start start 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 librados: setting wanted keys 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 librados: calling monclient init 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient: init 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient(hunting): picked mon.noname-a con 0x7fe1f8058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient(hunting): picked mon.noname-b con 0x7fe1f80b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient(hunting): picked mon.noname-c con 0x7fe1f81626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f81fa840 con 0x7fe1f8058da0 2026-02-25T15:19:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f813a3d0 con 0x7fe1f80b0410 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f813a6b0 con 0x7fe1f81626a0 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.136+0000 7fe1fe7c8640 10 monclient(hunting): authenticate will time out at 3736.725731s 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.137+0000 7fe1f77fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fe1f80b0410 0x7fe1f815e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:45874/0 (socket says 10.20.193.78:45874) 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.137+0000 7fe1f77fe640 1 -- 10.20.193.78:0/3053578243 learned_addr learned my addr 10.20.193.78:0/3053578243 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.137+0000 7fe1f4ff9640 10 client.?.objecter ms_handle_connect 0x7fe1f80b0410 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.137+0000 7fe1f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.137+0000 7fe1f4ff9640 10 client.?.objecter ms_handle_connect 0x7fe1f8058da0 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.137+0000 7fe1f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.137+0000 7fe1f4ff9640 10 client.?.objecter ms_handle_connect 0x7fe1f81626a0 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.137+0000 7fe1f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261174147 0 0) 0x7fe1f813a3d0 con 0x7fe1f80b0410 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): my global_id is 30046 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1c8003610 con 0x7fe1f80b0410 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307547207 0 0) 0x7fe1f81fa840 con 0x7fe1f8058da0 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): my global_id is 30759 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f813a3d0 con 0x7fe1f8058da0 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620405946 0 0) 0x7fe1f813a6b0 con 0x7fe1f81626a0 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 10 monclient(hunting): my global_id is 27593 2026-02-25T15:19:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.138+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f81fa840 con 0x7fe1f81626a0 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3715990303 0 0) 0x7fe1f81fa840 con 0x7fe1f81626a0 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1f813a6b0 con 0x7fe1f81626a0 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1ec003330 con 0x7fe1f81626a0 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 255985014 0 0) 0x7fe1c8003610 con 0x7fe1f80b0410 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1f81fa840 con 0x7fe1f80b0410 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1e8003110 con 0x7fe1f80b0410 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.143 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 895974236 0 0) 0x7fe1f813a3d0 con 0x7fe1f8058da0 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1c8003610 con 0x7fe1f8058da0 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1e4003310 con 0x7fe1f8058da0 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.140+0000 7fe1f4ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.144 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 523963836 0 0) 0x7fe1f813a6b0 con 0x7fe1f81626a0 2026-02-25T15:19:27.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 >> v1:10.20.193.155:6789/0 conn(0x7fe1f80b0410 legacy=0x7fe1f815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 >> v1:10.20.193.78:6789/0 conn(0x7fe1f8058da0 legacy=0x7fe1f81fa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 1 monclient: found mon.c 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f813a990 con 0x7fe1f81626a0 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 10 monclient: _finish_auth 0 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 5 monclient: authenticate success, global_id 27593 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 10 monclient: _renew_subs 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f813ac70 con 0x7fe1f81626a0 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 10 client.27593.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 10 monclient: _renew_subs 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe1f813b230 con 0x7fe1f81626a0 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 1 librados: init done 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.142+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f80b6b60 con 0x7fe1f81626a0 2026-02-25T15:19:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.232+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1ec004c50 con 0x7fe1f81626a0 2026-02-25T15:19:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.232+0000 7fe1f4ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.232+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1ec004fa0 con 0x7fe1f81626a0 2026-02-25T15:19:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.232+0000 7fe1f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.232+0000 7fe1f4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.232+0000 7fe1f67fc640 4 set_mon_vals no callback set 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.232+0000 7fe1f4ff9640 10 monclient: dump: 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.235 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.236 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.232+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fe1ec01de10 con 0x7fe1f81626a0 2026-02-25T15:19:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.233+0000 7fe1f7fff640 10 monclient: get_auth_request con 0x7fe1c8077ef0 auth_method 0 2026-02-25T15:19:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.233+0000 7fe1f4ff9640 10 client.27593.objecter ms_handle_connect 0x7fe1c8077ef0 2026-02-25T15:19:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.233+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(351..351 src has 1..351) ==== 8955+0+0 (unknown 1841964965 0 0) 0x7fe1ec093450 con 0x7fe1f81626a0 2026-02-25T15:19:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.233+0000 7fe1f4ff9640 10 client.27593.objecter ms_dispatch2 0x7fe1f8000b90 osd_map(351..351 src has 1..351) 2026-02-25T15:19:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.233+0000 7fe1f4ff9640 3 client.27593.objecter handle_osd_map got epochs [351,351] > 0 2026-02-25T15:19:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.233+0000 7fe1f4ff9640 3 client.27593.objecter handle_osd_map decoding full epoch 351 2026-02-25T15:19:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.233+0000 7fe1f4ff9640 20 client.27593.objecter dump_active .. 0 homeless 2026-02-25T15:19:27.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.235+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe1ec05de80 con 0x7fe1f81626a0 2026-02-25T15:19:27.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.235+0000 7fe1f4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.235+0000 7fe1f4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:27.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.339+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1f805dfd0 con 0x7fe1c8077ef0 2026-02-25T15:19:27.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.340+0000 7fe1f4ff9640 1 -- 10.20.193.78:0/3053578243 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125438 (unknown 2965378022 0 1204392180) 0x7fe1f805dfd0 con 0x7fe1c8077ef0 2026-02-25T15:19:27.344 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:19:27.344 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-25T15:19:27.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 10 librados: watch_flush enter 2026-02-25T15:19:27.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 10 librados: watch_flush exit 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 20 client.27593.objecter shutdown clearing up homeless session... 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 10 client.27593.objecter successfully canceled tick 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 >> v1:10.20.193.78:6800/3497602169 conn(0x7fe1c8077ef0 legacy=0x7fe1c80983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 10 monclient: shutdown 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 >> v1:10.20.193.167:6789/0 conn(0x7fe1f81626a0 legacy=0x7fe1f813e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 shutdown_connections 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 >> 10.20.193.78:0/3053578243 conn(0x7fe1f80b65f0 msgr2=0x7fe1f80566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 shutdown_connections 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 1 -- 10.20.193.78:0/3053578243 wait complete. 2026-02-25T15:19:27.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.342+0000 7fe1fe7c8640 1 librados: shutdown 2026-02-25T15:19:27.353 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2026-02-25T15:19:26.806845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":561260,"kb_used_data":111852,"kb_used_omap":24528,"kb_used_meta":424623,"kb_avail":1509388180,"statfs":{"total":1546188226560,"available":1545613496320,"internally_reserved":0,"allocated":114536448,"data_stored":73070621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25117127,"internal_metadata":434814521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":128,"apply_latency_ms":128,"commit_latency_ns":128000000,"apply_latency_ns":128000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000560"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.603903+0000","last_change":"2026-02-25T15:13:41.230819+0000","last_active":"2026-02-25T15:19:21.603903+0000","last_peered":"2026-02-25T15:19:21.603903+0000","last_clean":"2026-02-25T15:19:21.603903+0000","last_became_active":"2026-02-25T15:13:41.228177+0000","last_became_peered":"2026-02-25T15:13:41.228177+0000","last_unstale":"2026-02-25T15:19:21.603903+0000","last_undegraded":"2026-02-25T15:19:21.603903+0000","last_fullsized":"2026-02-25T15:19:21.603903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:49:00.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.588554+0000","last_change":"2026-02-25T15:13:41.573948+0000","last_active":"2026-02-25T15:19:21.588554+0000","last_peered":"2026-02-25T15:19:21.588554+0000","last_clean":"2026-02-25T15:19:21.588554+0000","last_became_active":"2026-02-25T15:13:41.568996+0000","last_became_peered":"2026-02-25T15:13:41.568996+0000","last_unstale":"2026-02-25T15:19:21.588554+0000","last_undegraded":"2026-02-25T15:19:21.588554+0000","last_fullsized":"2026-02-25T15:19:21.588554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:28:43.106179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.236151+0000","last_change":"2026-02-25T15:13:41.273148+0000","last_active":"2026-02-25T15:19:25.236151+0000","last_peered":"2026-02-25T15:19:25.236151+0000","last_clean":"2026-02-25T15:19:25.236151+0000","last_became_active":"2026-02-25T15:13:41.269950+0000","last_became_peered":"2026-02-25T15:13:41.269950+0000","last_unstale":"2026-02-25T15:19:25.236151+0000","last_undegraded":"2026-02-25T15:19:25.236151+0000","last_fullsized":"2026-02-25T15:19:25.236151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:33:46.151980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.286367+0000","last_change":"2026-02-25T15:13:40.992594+0000","last_active":"2026-02-25T15:19:25.286367+0000","last_peered":"2026-02-25T15:19:25.286367+0000","last_clean":"2026-02-25T15:19:25.286367+0000","last_became_active":"2026-02-25T15:13:40.989776+0000","last_became_peered":"2026-02-25T15:13:40.989776+0000","last_unstale":"2026-02-25T15:19:25.286367+0000","last_undegraded":"2026-02-25T15:19:25.286367+0000","last_fullsized":"2026-02-25T15:19:25.286367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:55:46.397970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.274734+0000","last_change":"2026-02-25T15:13:41.092568+0000","last_active":"2026-02-25T15:19:26.274734+0000","last_peered":"2026-02-25T15:19:26.274734+0000","last_clean":"2026-02-25T15:19:26.274734+0000","last_became_active":"2026-02-25T15:13:41.090430+0000","last_became_peered":"2026-02-25T15:13:41.090430+0000","last_unstale":"2026-02-25T15:19:26.274734+0000","last_undegraded":"2026-02-25T15:19:26.274734+0000","last_fullsized":"2026-02-25T15:19:26.274734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:14:22.171630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.268344+0000","last_change":"2026-02-25T15:13:41.057696+0000","last_active":"2026-02-25T15:19:26.268344+0000","last_peered":"2026-02-25T15:19:26.268344+0000","last_clean":"2026-02-25T15:19:26.268344+0000","last_became_active":"2026-02-25T15:13:41.036970+0000","last_became_peered":"2026-02-25T15:13:41.036970+0000","last_unstale":"2026-02-25T15:19:26.268344+0000","last_undegraded":"2026-02-25T15:19:26.268344+0000","last_fullsized":"2026-02-25T15:19:26.268344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:39:06.670127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.239251+0000","last_change":"2026-02-25T15:13:41.099282+0000","last_active":"2026-02-25T15:19:25.239251+0000","last_peered":"2026-02-25T15:19:25.239251+0000","last_clean":"2026-02-25T15:19:25.239251+0000","last_became_active":"2026-02-25T15:13:41.097058+0000","last_became_peered":"2026-02-25T15:13:41.097058+0000","last_unstale":"2026-02-25T15:19:25.239251+0000","last_undegraded":"2026-02-25T15:19:25.239251+0000","last_fullsized":"2026-02-25T15:19:25.239251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:45:41.954587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":647,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.288531+0000","last_change":"2026-02-25T15:13:40.983728+0000","last_active":"2026-02-25T15:19:25.288531+0000","last_peered":"2026-02-25T15:19:25.288531+0000","last_clean":"2026-02-25T15:19:25.288531+0000","last_became_active":"2026-02-25T15:13:40.967270+0000","last_became_peered":"2026-02-25T15:13:40.967270+0000","last_unstale":"2026-02-25T15:19:25.288531+0000","last_undegraded":"2026-02-25T15:19:25.288531+0000","last_fullsized":"2026-02-25T15:19:25.288531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:08:51.542526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.308023+0000","last_change":"2026-02-25T15:13:42.531762+0000","last_active":"2026-02-25T15:19:26.308023+0000","last_peered":"2026-02-25T15:19:26.308023+0000","last_clean":"2026-02-25T15:19:26.308023+0000","last_became_active":"2026-02-25T15:13:42.528480+0000","last_became_peered":"2026-02-25T15:13:42.528480+0000","last_unstale":"2026-02-25T15:19:26.308023+0000","last_undegraded":"2026-02-25T15:19:26.308023+0000","last_fullsized":"2026-02-25T15:19:26.308023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:29:51.951525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.280073+0000","last_change":"2026-02-25T15:13:40.710531+0000","last_active":"2026-02-25T15:19:25.280073+0000","last_peered":"2026-02-25T15:19:25.280073+0000","last_clean":"2026-02-25T15:19:25.280073+0000","last_became_active":"2026-02-25T15:13:40.708195+0000","last_became_peered":"2026-02-25T15:13:40.708195+0000","last_unstale":"2026-02-25T15:19:25.280073+0000","last_undegraded":"2026-02-25T15:19:25.280073+0000","last_fullsized":"2026-02-25T15:19:25.280073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:38:22.786132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.237514+0000","last_change":"2026-02-25T15:13:41.101698+0000","last_active":"2026-02-25T15:19:25.237514+0000","last_peered":"2026-02-25T15:19:25.237514+0000","last_clean":"2026-02-25T15:19:25.237514+0000","last_became_active":"2026-02-25T15:13:41.096638+0000","last_became_peered":"2026-02-25T15:13:41.096638+0000","last_unstale":"2026-02-25T15:19:25.237514+0000","last_undegraded":"2026-02-25T15:19:25.237514+0000","last_fullsized":"2026-02-25T15:19:25.237514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:46:32.563058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.591024+0000","last_change":"2026-02-25T15:13:40.931228+0000","last_active":"2026-02-25T15:19:21.591024+0000","last_peered":"2026-02-25T15:19:21.591024+0000","last_clean":"2026-02-25T15:19:21.591024+0000","last_became_active":"2026-02-25T15:13:40.929107+0000","last_became_peered":"2026-02-25T15:13:40.929107+0000","last_unstale":"2026-02-25T15:19:21.591024+0000","last_undegraded":"2026-02-25T15:19:21.591024+0000","last_fullsized":"2026-02-25T15:19:21.591024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:17:18.195998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":641,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.269130+0000","last_change":"2026-02-25T15:13:41.276463+0000","last_active":"2026-02-25T15:19:25.269130+0000","last_peered":"2026-02-25T15:19:25.269130+0000","last_clean":"2026-02-25T15:19:25.269130+0000","last_became_active":"2026-02-25T15:13:41.271609+0000","last_became_peered":"2026-02-25T15:13:41.271609+0000","last_unstale":"2026-02-25T15:19:25.269130+0000","last_undegraded":"2026-02-25T15:19:25.269130+0000","last_fullsized":"2026-02-25T15:19:25.269130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:52:28.798855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.228818+0000","last_change":"2026-02-25T15:13:40.970698+0000","last_active":"2026-02-25T15:19:25.228818+0000","last_peered":"2026-02-25T15:19:25.228818+0000","last_clean":"2026-02-25T15:19:25.228818+0000","last_became_active":"2026-02-25T15:13:40.968637+0000","last_became_peered":"2026-02-25T15:13:40.968637+0000","last_unstale":"2026-02-25T15:19:25.228818+0000","last_undegraded":"2026-02-25T15:19:25.228818+0000","last_fullsized":"2026-02-25T15:19:25.228818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:43:07.137572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":640,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.683636+0000","last_change":"2026-02-25T15:13:40.965092+0000","last_active":"2026-02-25T15:19:21.683636+0000","last_peered":"2026-02-25T15:19:21.683636+0000","last_clean":"2026-02-25T15:19:21.683636+0000","last_became_active":"2026-02-25T15:13:40.949974+0000","last_became_peered":"2026-02-25T15:13:40.949974+0000","last_unstale":"2026-02-25T15:19:21.683636+0000","last_undegraded":"2026-02-25T15:19:21.683636+0000","last_fullsized":"2026-02-25T15:19:21.683636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:14:03.541451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":647,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.284795+0000","last_change":"2026-02-25T15:13:41.003202+0000","last_active":"2026-02-25T15:19:25.284795+0000","last_peered":"2026-02-25T15:19:25.284795+0000","last_clean":"2026-02-25T15:19:25.284795+0000","last_became_active":"2026-02-25T15:13:40.988676+0000","last_became_peered":"2026-02-25T15:13:40.988676+0000","last_unstale":"2026-02-25T15:19:25.284795+0000","last_undegraded":"2026-02-25T15:19:25.284795+0000","last_fullsized":"2026-02-25T15:19:25.284795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:24:11.988588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.223776+0000","last_change":"2026-02-25T15:13:40.749992+0000","last_active":"2026-02-25T15:19:25.223776+0000","last_peered":"2026-02-25T15:19:25.223776+0000","last_clean":"2026-02-25T15:19:25.223776+0000","last_became_active":"2026-02-25T15:13:40.743919+0000","last_became_peered":"2026-02-25T15:13:40.743919+0000","last_unstale":"2026-02-25T15:19:25.223776+0000","last_undegraded":"2026-02-25T15:19:25.223776+0000","last_fullsized":"2026-02-25T15:19:25.223776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:26:24.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.346113+0000","last_change":"2026-02-25T15:13:41.344196+0000","last_active":"2026-02-25T15:19:25.346113+0000","last_peered":"2026-02-25T15:19:25.346113+0000","last_clean":"2026-02-25T15:19:25.346113+0000","last_became_active":"2026-02-25T15:13:41.340878+0000","last_became_peered":"2026-02-25T15:13:41.340878+0000","last_unstale":"2026-02-25T15:19:25.346113+0000","last_undegraded":"2026-02-25T15:19:25.346113+0000","last_fullsized":"2026-02-25T15:19:25.346113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:16:19.205261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.262539+0000","last_change":"2026-02-25T15:13:40.966222+0000","last_active":"2026-02-25T15:19:25.262539+0000","last_peered":"2026-02-25T15:19:25.262539+0000","last_clean":"2026-02-25T15:19:25.262539+0000","last_became_active":"2026-02-25T15:13:40.959639+0000","last_became_peered":"2026-02-25T15:13:40.959639+0000","last_unstale":"2026-02-25T15:19:25.262539+0000","last_undegraded":"2026-02-25T15:19:25.262539+0000","last_fullsized":"2026-02-25T15:19:25.262539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:00:51.139281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.319327+0000","last_change":"2026-02-25T15:13:41.106488+0000","last_active":"2026-02-25T15:19:26.319327+0000","last_peered":"2026-02-25T15:19:26.319327+0000","last_clean":"2026-02-25T15:19:26.319327+0000","last_became_active":"2026-02-25T15:13:41.104041+0000","last_became_peered":"2026-02-25T15:13:41.104041+0000","last_unstale":"2026-02-25T15:19:26.319327+0000","last_undegraded":"2026-02-25T15:19:26.319327+0000","last_fullsized":"2026-02-25T15:19:26.319327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:48:29.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.343833+0000","last_change":"2026-02-25T15:13:41.920429+0000","last_active":"2026-02-25T15:19:25.343833+0000","last_peered":"2026-02-25T15:19:25.343833+0000","last_clean":"2026-02-25T15:19:25.343833+0000","last_became_active":"2026-02-25T15:13:41.918321+0000","last_became_peered":"2026-02-25T15:13:41.918321+0000","last_unstale":"2026-02-25T15:19:25.343833+0000","last_undegraded":"2026-02-25T15:19:25.343833+0000","last_fullsized":"2026-02-25T15:19:25.343833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:57:47.179868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.272670+0000","last_change":"2026-02-25T15:13:41.080682+0000","last_active":"2026-02-25T15:19:25.272670+0000","last_peered":"2026-02-25T15:19:25.272670+0000","last_clean":"2026-02-25T15:19:25.272670+0000","last_became_active":"2026-02-25T15:13:41.078571+0000","last_became_peered":"2026-02-25T15:13:41.078571+0000","last_unstale":"2026-02-25T15:19:25.272670+0000","last_undegraded":"2026-02-25T15:19:25.272670+0000","last_fullsized":"2026-02-25T15:19:25.272670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:59:53.550632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.283969+0000","last_change":"2026-02-25T15:13:41.031697+0000","last_active":"2026-02-25T15:19:25.283969+0000","last_peered":"2026-02-25T15:19:25.283969+0000","last_clean":"2026-02-25T15:19:25.283969+0000","last_became_active":"2026-02-25T15:13:41.027073+0000","last_became_peered":"2026-02-25T15:13:41.027073+0000","last_unstale":"2026-02-25T15:19:25.283969+0000","last_undegraded":"2026-02-25T15:19:25.283969+0000","last_fullsized":"2026-02-25T15:19:25.283969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:46:27.108833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.235782+0000","last_change":"2026-02-25T15:13:40.948864+0000","last_active":"2026-02-25T15:19:25.235782+0000","last_peered":"2026-02-25T15:19:25.235782+0000","last_clean":"2026-02-25T15:19:25.235782+0000","last_became_active":"2026-02-25T15:13:40.944589+0000","last_became_peered":"2026-02-25T15:13:40.944589+0000","last_unstale":"2026-02-25T15:19:25.235782+0000","last_undegraded":"2026-02-25T15:19:25.235782+0000","last_fullsized":"2026-02-25T15:19:25.235782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:57:01.500928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.308760+0000","last_change":"2026-02-25T15:13:42.005732+0000","last_active":"2026-02-25T15:19:26.308760+0000","last_peered":"2026-02-25T15:19:26.308760+0000","last_clean":"2026-02-25T15:19:26.308760+0000","last_became_active":"2026-02-25T15:13:42.003162+0000","last_became_peered":"2026-02-25T15:13:42.003162+0000","last_unstale":"2026-02-25T15:19:26.308760+0000","last_undegraded":"2026-02-25T15:19:26.308760+0000","last_fullsized":"2026-02-25T15:19:26.308760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:38:43.188701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.282230+0000","last_change":"2026-02-25T15:13:41.042732+0000","last_active":"2026-02-25T15:19:26.282230+0000","last_peered":"2026-02-25T15:19:26.282230+0000","last_clean":"2026-02-25T15:19:26.282230+0000","last_became_active":"2026-02-25T15:13:41.040468+0000","last_became_peered":"2026-02-25T15:13:41.040468+0000","last_unstale":"2026-02-25T15:19:26.282230+0000","last_undegraded":"2026-02-25T15:19:26.282230+0000","last_fullsized":"2026-02-25T15:19:26.282230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:14:52.942685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.352513+0000","last_change":"2026-02-25T15:13:40.464514+0000","last_active":"2026-02-25T15:19:25.352513+0000","last_peered":"2026-02-25T15:19:25.352513+0000","last_clean":"2026-02-25T15:19:25.352513+0000","last_became_active":"2026-02-25T15:13:40.462421+0000","last_became_peered":"2026-02-25T15:13:40.462421+0000","last_unstale":"2026-02-25T15:19:25.352513+0000","last_undegraded":"2026-02-25T15:19:25.352513+0000","last_fullsized":"2026-02-25T15:19:25.352513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:13:19.955826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.351051+0000","last_change":"2026-02-25T15:13:40.746985+0000","last_active":"2026-02-25T15:19:25.351051+0000","last_peered":"2026-02-25T15:19:25.351051+0000","last_clean":"2026-02-25T15:19:25.351051+0000","last_became_active":"2026-02-25T15:13:40.744228+0000","last_became_peered":"2026-02-25T15:13:40.744228+0000","last_unstale":"2026-02-25T15:19:25.351051+0000","last_undegraded":"2026-02-25T15:19:25.351051+0000","last_fullsized":"2026-02-25T15:19:25.351051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:17:18.195998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.1","version":"33'11","reported_seq":674,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.234406+0000","last_change":"2026-02-25T15:13:40.735103+0000","last_active":"2026-02-25T15:19:25.234406+0000","last_peered":"2026-02-25T15:19:25.234406+0000","last_clean":"2026-02-25T15:19:25.234406+0000","last_became_active":"2026-02-25T15:13:40.703448+0000","last_became_peered":"2026-02-25T15:13:40.703448+0000","last_unstale":"2026-02-25T15:19:25.234406+0000","last_undegraded":"2026-02-25T15:19:25.234406+0000","last_fullsized":"2026-02-25T15:19:25.234406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:12:02.614079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.586169+0000","last_change":"2026-02-25T15:13:41.235640+0000","last_active":"2026-02-25T15:19:21.586169+0000","last_peered":"2026-02-25T15:19:21.586169+0000","last_clean":"2026-02-25T15:19:21.586169+0000","last_became_active":"2026-02-25T15:13:41.233579+0000","last_became_peered":"2026-02-25T15:13:41.233579+0000","last_unstale":"2026-02-25T15:19:21.586169+0000","last_undegraded":"2026-02-25T15:19:21.586169+0000","last_fullsized":"2026-02-25T15:19:21.586169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:52:24.301222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.242167+0000","last_change":"2026-02-25T15:13:41.023468+0000","last_active":"2026-02-25T15:19:25.242167+0000","last_peered":"2026-02-25T15:19:25.242167+0000","last_clean":"2026-02-25T15:19:25.242167+0000","last_became_active":"2026-02-25T15:13:41.021310+0000","last_became_peered":"2026-02-25T15:13:41.021310+0000","last_unstale":"2026-02-25T15:19:25.242167+0000","last_undegraded":"2026-02-25T15:19:25.242167+0000","last_fullsized":"2026-02-25T15:19:25.242167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:59:17.205188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.278159+0000","last_change":"2026-02-25T15:13:40.703490+0000","last_active":"2026-02-25T15:19:25.278159+0000","last_peered":"2026-02-25T15:19:25.278159+0000","last_clean":"2026-02-25T15:19:25.278159+0000","last_became_active":"2026-02-25T15:13:40.701282+0000","last_became_peered":"2026-02-25T15:13:40.701282+0000","last_unstale":"2026-02-25T15:19:25.278159+0000","last_undegraded":"2026-02-25T15:19:25.278159+0000","last_fullsized":"2026-02-25T15:19:25.278159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:33:36.654692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,12],"acting":[5,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":663,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.316811+0000","last_change":"2026-02-25T15:13:02.846272+0000","last_active":"2026-02-25T15:19:26.316811+0000","last_peered":"2026-02-25T15:19:26.316811+0000","last_clean":"2026-02-25T15:19:26.316811+0000","last_became_active":"2026-02-25T15:13:01.240693+0000","last_became_peered":"2026-02-25T15:13:01.240693+0000","last_unstale":"2026-02-25T15:19:26.316811+0000","last_undegraded":"2026-02-25T15:19:26.316811+0000","last_fullsized":"2026-02-25T15:19:26.316811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:32:46.429234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068336521999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,15],"acting":[12,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":663,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.241263+0000","last_change":"2026-02-25T15:13:03.354671+0000","last_active":"2026-02-25T15:19:25.241263+0000","last_peered":"2026-02-25T15:19:25.241263+0000","last_clean":"2026-02-25T15:19:25.241263+0000","last_became_active":"2026-02-25T15:13:01.107596+0000","last_became_peered":"2026-02-25T15:13:01.107596+0000","last_unstale":"2026-02-25T15:19:25.241263+0000","last_undegraded":"2026-02-25T15:19:25.241263+0000","last_fullsized":"2026-02-25T15:19:25.241263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:21.484744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043275358999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":662,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.245972+0000","last_change":"2026-02-25T15:13:04.197397+0000","last_active":"2026-02-25T15:19:25.245972+0000","last_peered":"2026-02-25T15:19:25.245972+0000","last_clean":"2026-02-25T15:19:25.245972+0000","last_became_active":"2026-02-25T15:13:00.886357+0000","last_became_peered":"2026-02-25T15:13:00.886357+0000","last_unstale":"2026-02-25T15:19:25.245972+0000","last_undegraded":"2026-02-25T15:19:25.245972+0000","last_fullsized":"2026-02-25T15:19:25.245972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:21:14.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047817094999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":662,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.243478+0000","last_change":"2026-02-25T15:13:04.192793+0000","last_active":"2026-02-25T15:19:25.243478+0000","last_peered":"2026-02-25T15:19:25.243478+0000","last_clean":"2026-02-25T15:19:25.243478+0000","last_became_active":"2026-02-25T15:13:01.030043+0000","last_became_peered":"2026-02-25T15:13:01.030043+0000","last_unstale":"2026-02-25T15:19:25.243478+0000","last_undegraded":"2026-02-25T15:19:25.243478+0000","last_fullsized":"2026-02-25T15:19:25.243478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:56:20.078816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047341022000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14],"acting":[11,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"28'2","reported_seq":666,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.291712+0000","last_change":"2026-02-25T15:13:02.847201+0000","last_active":"2026-02-25T15:19:26.291712+0000","last_peered":"2026-02-25T15:19:26.291712+0000","last_clean":"2026-02-25T15:19:26.291712+0000","last_became_active":"2026-02-25T15:13:01.242716+0000","last_became_peered":"2026-02-25T15:13:01.242716+0000","last_unstale":"2026-02-25T15:19:26.291712+0000","last_undegraded":"2026-02-25T15:19:26.291712+0000","last_fullsized":"2026-02-25T15:19:26.291712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:42.867009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073362477999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,8],"acting":[12,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":663,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.249804+0000","last_change":"2026-02-25T15:13:03.340291+0000","last_active":"2026-02-25T15:19:25.249804+0000","last_peered":"2026-02-25T15:19:25.249804+0000","last_clean":"2026-02-25T15:19:25.249804+0000","last_became_active":"2026-02-25T15:13:01.167595+0000","last_became_peered":"2026-02-25T15:13:01.167595+0000","last_unstale":"2026-02-25T15:19:25.249804+0000","last_undegraded":"2026-02-25T15:19:25.249804+0000","last_fullsized":"2026-02-25T15:19:25.249804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:48:42.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030257392000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":666,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.349306+0000","last_change":"2026-02-25T15:13:03.344370+0000","last_active":"2026-02-25T15:19:25.349306+0000","last_peered":"2026-02-25T15:19:25.349306+0000","last_clean":"2026-02-25T15:19:25.349306+0000","last_became_active":"2026-02-25T15:13:01.165967+0000","last_became_peered":"2026-02-25T15:13:01.165967+0000","last_unstale":"2026-02-25T15:19:25.349306+0000","last_undegraded":"2026-02-25T15:19:25.349306+0000","last_fullsized":"2026-02-25T15:19:25.349306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:41:44.607565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030945777000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"26'1","reported_seq":665,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.294757+0000","last_change":"2026-02-25T15:13:02.837950+0000","last_active":"2026-02-25T15:19:26.294757+0000","last_peered":"2026-02-25T15:19:26.294757+0000","last_clean":"2026-02-25T15:19:26.294757+0000","last_became_active":"2026-02-25T15:13:01.049643+0000","last_became_peered":"2026-02-25T15:13:01.049643+0000","last_unstale":"2026-02-25T15:19:26.294757+0000","last_undegraded":"2026-02-25T15:19:26.294757+0000","last_fullsized":"2026-02-25T15:19:26.294757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:51:09.091771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059457101999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"1.0","version":"24'32","reported_seq":701,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.606180+0000","last_change":"2026-02-25T15:12:53.255197+0000","last_active":"2026-02-25T15:19:21.606180+0000","last_peered":"2026-02-25T15:19:21.606180+0000","last_clean":"2026-02-25T15:19:21.606180+0000","last_became_active":"2026-02-25T15:12:53.235995+0000","last_became_peered":"2026-02-25T15:12:53.235995+0000","last_unstale":"2026-02-25T15:19:21.606180+0000","last_undegraded":"2026-02-25T15:19:21.606180+0000","last_fullsized":"2026-02-25T15:19:21.606180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_clean_scrub_stamp":"2026-02-25T15:12:51.067937+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:13:12.776604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280592,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51904,"kb_used_data":6896,"kb_used_omap":4682,"kb_used_meta":40309,"kb_avail":94319936,"statfs":{"total":96636764160,"available":96583614464,"internally_reserved":0,"allocated":7061504,"data_stored":4488878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4795118,"internal_metadata":41276690},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280593,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220942,"internal_metadata":27369714},"hb_peers":[1,2,3,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280594,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4518007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218768,"internal_metadata":27371888},"hb_peers":[0,1,2,4,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":3023,"kb_used_meta":23920,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3096452,"internal_metadata":24494204},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313297,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":8641,"kb_used_meta":18302,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8848431,"internal_metadata":18742225},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33840,"kb_used_data":6880,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338000,"statfs":{"total":96636764160,"available":96602112000,"internally_reserved":0,"allocated":7045120,"data_stored":4479247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214678,"internal_metadata":27375978},"hb_peers":[1,3,4,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280593,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34292,"kb_used_data":7332,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94337548,"statfs":{"total":96636764160,"available":96601649152,"internally_reserved":0,"allocated":7507968,"data_stored":4938527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216439,"internal_metadata":27374217},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280593,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216025,"internal_metadata":27374631},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218373,"internal_metadata":27372283},"hb_peers":[0,1,2,4,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280593,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34364,"kb_used_data":7404,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337476,"statfs":{"total":96636764160,"available":96601575424,"internally_reserved":0,"allocated":7581696,"data_stored":4977273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218913,"internal_metadata":27371743},"hb_peers":[0,1,2,3,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280593,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":2927,"kb_used_meta":24016,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4517993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2997987,"internal_metadata":24592669},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280593,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4527526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218065,"internal_metadata":27372591},"hb_peers":[0,1,2,3,4,5,6,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280593,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4518007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218898,"internal_metadata":27371758},"hb_peers":[0,1,2,3,4,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280594,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33840,"kb_used_data":6880,"kb_used_omap":182,"kb_used_meta":26761,"kb_avail":94338000,"statfs":{"total":96636764160,"available":96602112000,"internally_reserved":0,"allocated":7045120,"data_stored":4479247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187370,"internal_metadata":27403286},"hb_peers":[0,1,2,3,4,5,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280594,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3092248,"internal_metadata":24498408},"hb_peers":[0,1,2,3,4,5,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280593,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138420,"internal_metadata":27452236},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:19:27.360 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T15:19:27.361 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:19:27.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.425+0000 7ffbcf583640 10 monclient: get_monmap_and_config 2026-02-25T15:19:27.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.425+0000 7ffbcf583640 10 monclient: build_initial_monmap 2026-02-25T15:19:27.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.425+0000 7ffbcf583640 10 monclient: monmap: 2026-02-25T15:19:27.429 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:27.429 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.429 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:27.426489+0000 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:27.426489+0000 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.425+0000 7ffbcf583640 1 Processor -- start 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 1 -- start start 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 10 monclient: init 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:27.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 10 monclient(hunting): picked mon.noname-b con 0x7ffbc8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 10 monclient(hunting): picked mon.noname-a con 0x7ffbc80b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 10 monclient(hunting): picked mon.noname-c con 0x7ffbc81626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc81655c0 con 0x7ffbc80b0410 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc80b12b0 con 0x7ffbc8058da0 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc80b1590 con 0x7ffbc81626a0 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.426+0000 7ffbcf583640 10 monclient(hunting): authenticate will time out at 3737.015583s 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.427+0000 7ffbccaf7640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ffbc80b0410 0x7ffbc8164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50124/0 (socket says 10.20.193.78:50124) 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.427+0000 7ffbccaf7640 1 -- 10.20.193.78:0/3861465214 learned_addr learned my addr 10.20.193.78:0/3861465214 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:27.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.427+0000 7ffbcd2f8640 1 --1- 10.20.193.78:0/3861465214 >> v1:10.20.193.155:6789/0 conn(0x7ffbc8058da0 0x7ffbc81647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:45890/0 (socket says 10.20.193.78:45890) 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903759670 0 0) 0x7ffbc81655c0 con 0x7ffbc80b0410 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): my global_id is 30762 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbb0003610 con 0x7ffbc80b0410 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966126971 0 0) 0x7ffbc80b12b0 con 0x7ffbc8058da0 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): my global_id is 30049 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc81655c0 con 0x7ffbc8058da0 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124850049 0 0) 0x7ffbc80b1590 con 0x7ffbc81626a0 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 10 monclient(hunting): my global_id is 27596 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.428+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc80b12b0 con 0x7ffbc81626a0 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1913260223 0 0) 0x7ffbb0003610 con 0x7ffbc80b0410 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 >> v1:10.20.193.167:6789/0 conn(0x7ffbc81626a0 legacy=0x7ffbc81c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 >> v1:10.20.193.155:6789/0 conn(0x7ffbc8058da0 legacy=0x7ffbc81647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 1 monclient: found mon.noname-a 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc80b1870 con 0x7ffbc80b0410 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 10 monclient: _finish_auth 0 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ffbbc002df0 con 0x7ffbc80b0410 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbb7fff640 10 monclient: dump: 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.441 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbcf583640 5 monclient: authenticate success, global_id 30762 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.430+0000 7ffbcf583640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffbbc002fc0 con 0x7ffbc80b0410 2026-02-25T15:19:27.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbb7fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbb7fff640 1 -- 10.20.193.78:0/3861465214 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ffbbc003400 con 0x7ffbc80b0410 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 4 set_mon_vals no callback set 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbb7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbb7fff640 10 monclient: dump: 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.443 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 10 monclient: shutdown 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 1 -- 10.20.193.78:0/3861465214 >> v1:10.20.193.78:6789/0 conn(0x7ffbc80b0410 legacy=0x7ffbc8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 1 -- 10.20.193.78:0/3861465214 shutdown_connections 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 1 -- 10.20.193.78:0/3861465214 >> 10.20.193.78:0/3861465214 conn(0x7ffbc80b65f0 msgr2=0x7ffbc80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 1 -- 10.20.193.78:0/3861465214 shutdown_connections 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 1 -- 10.20.193.78:0/3861465214 wait complete. 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 10 monclient: build_initial_monmap 2026-02-25T15:19:27.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 10 monclient: monmap: 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 1 librados: starting msgr at 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 1 librados: starting objecter 2026-02-25T15:19:27.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.431+0000 7ffbcf583640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 1 Processor -- start 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 1 -- start start 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 1 librados: setting wanted keys 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 1 librados: calling monclient init 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 10 monclient: init 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 10 monclient(hunting): picked mon.noname-b con 0x7ffbc8058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 10 monclient(hunting): picked mon.noname-c con 0x7ffbc80b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 10 monclient(hunting): picked mon.noname-a con 0x7ffbc81626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc814a1e0 con 0x7ffbc81626a0 2026-02-25T15:19:27.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc814a4c0 con 0x7ffbc8058da0 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc814a7a0 con 0x7ffbc80b0410 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcf583640 10 monclient(hunting): authenticate will time out at 3737.021437s 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcdaf9640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ffbc81626a0 0x7ffbc814d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50126/0 (socket says 10.20.193.78:50126) 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbcdaf9640 1 -- 10.20.193.78:0/3989432744 learned_addr learned my addr 10.20.193.78:0/3989432744 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbb5ffb640 10 client.?.objecter ms_handle_connect 0x7ffbc81626a0 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbb5ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbb5ffb640 10 client.?.objecter ms_handle_connect 0x7ffbc8058da0 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.432+0000 7ffbb5ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 client.?.objecter ms_handle_connect 0x7ffbc80b0410 2026-02-25T15:19:27.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821221006 0 0) 0x7ffbc814a1e0 con 0x7ffbc81626a0 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 monclient(hunting): my global_id is 30765 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb98003610 con 0x7ffbc81626a0 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909361313 0 0) 0x7ffbc814a4c0 con 0x7ffbc8058da0 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 10 monclient(hunting): my global_id is 30052 2026-02-25T15:19:27.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.433+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc814a1e0 con 0x7ffbc8058da0 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.434+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4079810141 0 0) 0x7ffbc814a7a0 con 0x7ffbc80b0410 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.434+0000 7ffbb5ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.434+0000 7ffbb5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.434+0000 7ffbb5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.434+0000 7ffbb5ffb640 10 monclient(hunting): my global_id is 27599 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.434+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc814a4c0 con 0x7ffbc80b0410 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.435+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 928446864 0 0) 0x7ffb98003610 con 0x7ffbc81626a0 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbc814a7a0 con 0x7ffbc81626a0 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ffbc40033c0 con 0x7ffbc81626a0 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:27.449 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.450 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2153618301 0 0) 0x7ffbc814a1e0 con 0x7ffbc8058da0 2026-02-25T15:19:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb98003610 con 0x7ffbc8058da0 2026-02-25T15:19:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ffbb80030b0 con 0x7ffbc8058da0 2026-02-25T15:19:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:27.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:27.452 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.452 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.452 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.452 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.452 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.452 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.453 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.453 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.453 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.453 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2132416780 0 0) 0x7ffbc814a4c0 con 0x7ffbc80b0410 2026-02-25T15:19:27.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbc814a1e0 con 0x7ffbc80b0410 2026-02-25T15:19:27.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ffbbc003310 con 0x7ffbc80b0410 2026-02-25T15:19:27.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:27.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.436+0000 7ffbb5ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:27.454 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.454 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.454 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.455 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.455 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.455 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.455 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.455 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.455 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.455 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3591692491 0 0) 0x7ffb98003610 con 0x7ffbc8058da0 2026-02-25T15:19:27.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 >> v1:10.20.193.167:6789/0 conn(0x7ffbc80b0410 legacy=0x7ffbc80a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 >> v1:10.20.193.78:6789/0 conn(0x7ffbc81626a0 legacy=0x7ffbc814d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:27.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 1 monclient: found mon.b 2026-02-25T15:19:27.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:27.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:27.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc805b820 con 0x7ffbc8058da0 2026-02-25T15:19:27.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:27.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:27.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbb5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:27.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 5 monclient: authenticate success, global_id 30052 2026-02-25T15:19:27.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 10 monclient: _renew_subs 2026-02-25T15:19:27.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:27.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc805bb00 con 0x7ffbc8058da0 2026-02-25T15:19:27.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 10 client.30052.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:27.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 10 monclient: _renew_subs 2026-02-25T15:19:27.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:27.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffbc805c910 con 0x7ffbc8058da0 2026-02-25T15:19:27.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.437+0000 7ffbcf583640 1 librados: init done 2026-02-25T15:19:27.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.438+0000 7ffbcf583640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.438+0000 7ffbcf583640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.438+0000 7ffbcf583640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:27.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.438+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc814a9e0 con 0x7ffbc8058da0 2026-02-25T15:19:27.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.442+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffbb80048d0 con 0x7ffbc8058da0 2026-02-25T15:19:27.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.442+0000 7ffbb5ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:27.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.442+0000 7ffbb77fe640 4 set_mon_vals no callback set 2026-02-25T15:19:27.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.445+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7ffbb8004c20 con 0x7ffbc8058da0 2026-02-25T15:19:27.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.445+0000 7ffbb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.445+0000 7ffbb5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:27.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.445+0000 7ffbb5ffb640 10 monclient: dump: 2026-02-25T15:19:27.465 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.465 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.465 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.465 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.465 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.465 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.446+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7ffbb801da90 con 0x7ffbc8058da0 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.446+0000 7ffbccaf7640 10 monclient: get_auth_request con 0x7ffb98077ec0 auth_method 0 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.446+0000 7ffbb5ffb640 10 client.30052.objecter ms_handle_connect 0x7ffb98077ec0 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.447+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(351..351 src has 1..351) ==== 8955+0+0 (unknown 1841964965 0 0) 0x7ffbb8093140 con 0x7ffbc8058da0 2026-02-25T15:19:27.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.447+0000 7ffbb5ffb640 10 client.30052.objecter ms_dispatch2 0x7ffbc8000b90 osd_map(351..351 src has 1..351) 2026-02-25T15:19:27.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.447+0000 7ffbb5ffb640 3 client.30052.objecter handle_osd_map got epochs [351,351] > 0 2026-02-25T15:19:27.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.447+0000 7ffbb5ffb640 3 client.30052.objecter handle_osd_map decoding full epoch 351 2026-02-25T15:19:27.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.447+0000 7ffbb5ffb640 20 client.30052.objecter dump_active .. 0 homeless 2026-02-25T15:19:27.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.529+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ffbc814a9e0 con 0x7ffbc8058da0 2026-02-25T15:19:27.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.529+0000 7ffbb5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.529+0000 7ffbb5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:27.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.631+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbc8162150 con 0x7ffb98077ec0 2026-02-25T15:19:27.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.632+0000 7ffbb5ffb640 1 -- 10.20.193.78:0/3989432744 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125438 (unknown 2965378022 0 1204392180) 0x7ffbc8162150 con 0x7ffb98077ec0 2026-02-25T15:19:27.636 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:19:27.637 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-25T15:19:27.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 10 librados: watch_flush enter 2026-02-25T15:19:27.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 10 librados: watch_flush exit 2026-02-25T15:19:27.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 20 client.30052.objecter shutdown clearing up homeless session... 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 10 client.30052.objecter successfully canceled tick 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 >> v1:10.20.193.78:6800/3497602169 conn(0x7ffb98077ec0 legacy=0x7ffb98098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 10 monclient: shutdown 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 >> v1:10.20.193.155:6789/0 conn(0x7ffbc8058da0 legacy=0x7ffbc805c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 shutdown_connections 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 >> 10.20.193.78:0/3989432744 conn(0x7ffbc80b65f0 msgr2=0x7ffbc8055a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 shutdown_connections 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 1 -- 10.20.193.78:0/3989432744 wait complete. 2026-02-25T15:19:27.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.633+0000 7ffbcf583640 1 librados: shutdown 2026-02-25T15:19:27.644 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2026-02-25T15:19:26.806845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":561260,"kb_used_data":111852,"kb_used_omap":24528,"kb_used_meta":424623,"kb_avail":1509388180,"statfs":{"total":1546188226560,"available":1545613496320,"internally_reserved":0,"allocated":114536448,"data_stored":73070621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25117127,"internal_metadata":434814521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":128,"apply_latency_ms":128,"commit_latency_ns":128000000,"apply_latency_ns":128000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000560"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.603903+0000","last_change":"2026-02-25T15:13:41.230819+0000","last_active":"2026-02-25T15:19:21.603903+0000","last_peered":"2026-02-25T15:19:21.603903+0000","last_clean":"2026-02-25T15:19:21.603903+0000","last_became_active":"2026-02-25T15:13:41.228177+0000","last_became_peered":"2026-02-25T15:13:41.228177+0000","last_unstale":"2026-02-25T15:19:21.603903+0000","last_undegraded":"2026-02-25T15:19:21.603903+0000","last_fullsized":"2026-02-25T15:19:21.603903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:49:00.862861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.588554+0000","last_change":"2026-02-25T15:13:41.573948+0000","last_active":"2026-02-25T15:19:21.588554+0000","last_peered":"2026-02-25T15:19:21.588554+0000","last_clean":"2026-02-25T15:19:21.588554+0000","last_became_active":"2026-02-25T15:13:41.568996+0000","last_became_peered":"2026-02-25T15:13:41.568996+0000","last_unstale":"2026-02-25T15:19:21.588554+0000","last_undegraded":"2026-02-25T15:19:21.588554+0000","last_fullsized":"2026-02-25T15:19:21.588554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:28:43.106179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.236151+0000","last_change":"2026-02-25T15:13:41.273148+0000","last_active":"2026-02-25T15:19:25.236151+0000","last_peered":"2026-02-25T15:19:25.236151+0000","last_clean":"2026-02-25T15:19:25.236151+0000","last_became_active":"2026-02-25T15:13:41.269950+0000","last_became_peered":"2026-02-25T15:13:41.269950+0000","last_unstale":"2026-02-25T15:19:25.236151+0000","last_undegraded":"2026-02-25T15:19:25.236151+0000","last_fullsized":"2026-02-25T15:19:25.236151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:33:46.151980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.286367+0000","last_change":"2026-02-25T15:13:40.992594+0000","last_active":"2026-02-25T15:19:25.286367+0000","last_peered":"2026-02-25T15:19:25.286367+0000","last_clean":"2026-02-25T15:19:25.286367+0000","last_became_active":"2026-02-25T15:13:40.989776+0000","last_became_peered":"2026-02-25T15:13:40.989776+0000","last_unstale":"2026-02-25T15:19:25.286367+0000","last_undegraded":"2026-02-25T15:19:25.286367+0000","last_fullsized":"2026-02-25T15:19:25.286367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:55:46.397970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.274734+0000","last_change":"2026-02-25T15:13:41.092568+0000","last_active":"2026-02-25T15:19:26.274734+0000","last_peered":"2026-02-25T15:19:26.274734+0000","last_clean":"2026-02-25T15:19:26.274734+0000","last_became_active":"2026-02-25T15:13:41.090430+0000","last_became_peered":"2026-02-25T15:13:41.090430+0000","last_unstale":"2026-02-25T15:19:26.274734+0000","last_undegraded":"2026-02-25T15:19:26.274734+0000","last_fullsized":"2026-02-25T15:19:26.274734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:14:22.171630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.268344+0000","last_change":"2026-02-25T15:13:41.057696+0000","last_active":"2026-02-25T15:19:26.268344+0000","last_peered":"2026-02-25T15:19:26.268344+0000","last_clean":"2026-02-25T15:19:26.268344+0000","last_became_active":"2026-02-25T15:13:41.036970+0000","last_became_peered":"2026-02-25T15:13:41.036970+0000","last_unstale":"2026-02-25T15:19:26.268344+0000","last_undegraded":"2026-02-25T15:19:26.268344+0000","last_fullsized":"2026-02-25T15:19:26.268344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:39:06.670127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.239251+0000","last_change":"2026-02-25T15:13:41.099282+0000","last_active":"2026-02-25T15:19:25.239251+0000","last_peered":"2026-02-25T15:19:25.239251+0000","last_clean":"2026-02-25T15:19:25.239251+0000","last_became_active":"2026-02-25T15:13:41.097058+0000","last_became_peered":"2026-02-25T15:13:41.097058+0000","last_unstale":"2026-02-25T15:19:25.239251+0000","last_undegraded":"2026-02-25T15:19:25.239251+0000","last_fullsized":"2026-02-25T15:19:25.239251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:45:41.954587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":647,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.288531+0000","last_change":"2026-02-25T15:13:40.983728+0000","last_active":"2026-02-25T15:19:25.288531+0000","last_peered":"2026-02-25T15:19:25.288531+0000","last_clean":"2026-02-25T15:19:25.288531+0000","last_became_active":"2026-02-25T15:13:40.967270+0000","last_became_peered":"2026-02-25T15:13:40.967270+0000","last_unstale":"2026-02-25T15:19:25.288531+0000","last_undegraded":"2026-02-25T15:19:25.288531+0000","last_fullsized":"2026-02-25T15:19:25.288531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:08:51.542526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.308023+0000","last_change":"2026-02-25T15:13:42.531762+0000","last_active":"2026-02-25T15:19:26.308023+0000","last_peered":"2026-02-25T15:19:26.308023+0000","last_clean":"2026-02-25T15:19:26.308023+0000","last_became_active":"2026-02-25T15:13:42.528480+0000","last_became_peered":"2026-02-25T15:13:42.528480+0000","last_unstale":"2026-02-25T15:19:26.308023+0000","last_undegraded":"2026-02-25T15:19:26.308023+0000","last_fullsized":"2026-02-25T15:19:26.308023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:29:51.951525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.280073+0000","last_change":"2026-02-25T15:13:40.710531+0000","last_active":"2026-02-25T15:19:25.280073+0000","last_peered":"2026-02-25T15:19:25.280073+0000","last_clean":"2026-02-25T15:19:25.280073+0000","last_became_active":"2026-02-25T15:13:40.708195+0000","last_became_peered":"2026-02-25T15:13:40.708195+0000","last_unstale":"2026-02-25T15:19:25.280073+0000","last_undegraded":"2026-02-25T15:19:25.280073+0000","last_fullsized":"2026-02-25T15:19:25.280073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:38:22.786132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.237514+0000","last_change":"2026-02-25T15:13:41.101698+0000","last_active":"2026-02-25T15:19:25.237514+0000","last_peered":"2026-02-25T15:19:25.237514+0000","last_clean":"2026-02-25T15:19:25.237514+0000","last_became_active":"2026-02-25T15:13:41.096638+0000","last_became_peered":"2026-02-25T15:13:41.096638+0000","last_unstale":"2026-02-25T15:19:25.237514+0000","last_undegraded":"2026-02-25T15:19:25.237514+0000","last_fullsized":"2026-02-25T15:19:25.237514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:46:32.563058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.591024+0000","last_change":"2026-02-25T15:13:40.931228+0000","last_active":"2026-02-25T15:19:21.591024+0000","last_peered":"2026-02-25T15:19:21.591024+0000","last_clean":"2026-02-25T15:19:21.591024+0000","last_became_active":"2026-02-25T15:13:40.929107+0000","last_became_peered":"2026-02-25T15:13:40.929107+0000","last_unstale":"2026-02-25T15:19:21.591024+0000","last_undegraded":"2026-02-25T15:19:21.591024+0000","last_fullsized":"2026-02-25T15:19:21.591024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:17:18.195998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":641,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.269130+0000","last_change":"2026-02-25T15:13:41.276463+0000","last_active":"2026-02-25T15:19:25.269130+0000","last_peered":"2026-02-25T15:19:25.269130+0000","last_clean":"2026-02-25T15:19:25.269130+0000","last_became_active":"2026-02-25T15:13:41.271609+0000","last_became_peered":"2026-02-25T15:13:41.271609+0000","last_unstale":"2026-02-25T15:19:25.269130+0000","last_undegraded":"2026-02-25T15:19:25.269130+0000","last_fullsized":"2026-02-25T15:19:25.269130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:52:28.798855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.228818+0000","last_change":"2026-02-25T15:13:40.970698+0000","last_active":"2026-02-25T15:19:25.228818+0000","last_peered":"2026-02-25T15:19:25.228818+0000","last_clean":"2026-02-25T15:19:25.228818+0000","last_became_active":"2026-02-25T15:13:40.968637+0000","last_became_peered":"2026-02-25T15:13:40.968637+0000","last_unstale":"2026-02-25T15:19:25.228818+0000","last_undegraded":"2026-02-25T15:19:25.228818+0000","last_fullsized":"2026-02-25T15:19:25.228818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:43:07.137572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":640,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.683636+0000","last_change":"2026-02-25T15:13:40.965092+0000","last_active":"2026-02-25T15:19:21.683636+0000","last_peered":"2026-02-25T15:19:21.683636+0000","last_clean":"2026-02-25T15:19:21.683636+0000","last_became_active":"2026-02-25T15:13:40.949974+0000","last_became_peered":"2026-02-25T15:13:40.949974+0000","last_unstale":"2026-02-25T15:19:21.683636+0000","last_undegraded":"2026-02-25T15:19:21.683636+0000","last_fullsized":"2026-02-25T15:19:21.683636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:14:03.541451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":647,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.284795+0000","last_change":"2026-02-25T15:13:41.003202+0000","last_active":"2026-02-25T15:19:25.284795+0000","last_peered":"2026-02-25T15:19:25.284795+0000","last_clean":"2026-02-25T15:19:25.284795+0000","last_became_active":"2026-02-25T15:13:40.988676+0000","last_became_peered":"2026-02-25T15:13:40.988676+0000","last_unstale":"2026-02-25T15:19:25.284795+0000","last_undegraded":"2026-02-25T15:19:25.284795+0000","last_fullsized":"2026-02-25T15:19:25.284795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:24:11.988588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.223776+0000","last_change":"2026-02-25T15:13:40.749992+0000","last_active":"2026-02-25T15:19:25.223776+0000","last_peered":"2026-02-25T15:19:25.223776+0000","last_clean":"2026-02-25T15:19:25.223776+0000","last_became_active":"2026-02-25T15:13:40.743919+0000","last_became_peered":"2026-02-25T15:13:40.743919+0000","last_unstale":"2026-02-25T15:19:25.223776+0000","last_undegraded":"2026-02-25T15:19:25.223776+0000","last_fullsized":"2026-02-25T15:19:25.223776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:26:24.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.346113+0000","last_change":"2026-02-25T15:13:41.344196+0000","last_active":"2026-02-25T15:19:25.346113+0000","last_peered":"2026-02-25T15:19:25.346113+0000","last_clean":"2026-02-25T15:19:25.346113+0000","last_became_active":"2026-02-25T15:13:41.340878+0000","last_became_peered":"2026-02-25T15:13:41.340878+0000","last_unstale":"2026-02-25T15:19:25.346113+0000","last_undegraded":"2026-02-25T15:19:25.346113+0000","last_fullsized":"2026-02-25T15:19:25.346113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:16:19.205261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.262539+0000","last_change":"2026-02-25T15:13:40.966222+0000","last_active":"2026-02-25T15:19:25.262539+0000","last_peered":"2026-02-25T15:19:25.262539+0000","last_clean":"2026-02-25T15:19:25.262539+0000","last_became_active":"2026-02-25T15:13:40.959639+0000","last_became_peered":"2026-02-25T15:13:40.959639+0000","last_unstale":"2026-02-25T15:19:25.262539+0000","last_undegraded":"2026-02-25T15:19:25.262539+0000","last_fullsized":"2026-02-25T15:19:25.262539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:00:51.139281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.319327+0000","last_change":"2026-02-25T15:13:41.106488+0000","last_active":"2026-02-25T15:19:26.319327+0000","last_peered":"2026-02-25T15:19:26.319327+0000","last_clean":"2026-02-25T15:19:26.319327+0000","last_became_active":"2026-02-25T15:13:41.104041+0000","last_became_peered":"2026-02-25T15:13:41.104041+0000","last_unstale":"2026-02-25T15:19:26.319327+0000","last_undegraded":"2026-02-25T15:19:26.319327+0000","last_fullsized":"2026-02-25T15:19:26.319327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:48:29.577344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.343833+0000","last_change":"2026-02-25T15:13:41.920429+0000","last_active":"2026-02-25T15:19:25.343833+0000","last_peered":"2026-02-25T15:19:25.343833+0000","last_clean":"2026-02-25T15:19:25.343833+0000","last_became_active":"2026-02-25T15:13:41.918321+0000","last_became_peered":"2026-02-25T15:13:41.918321+0000","last_unstale":"2026-02-25T15:19:25.343833+0000","last_undegraded":"2026-02-25T15:19:25.343833+0000","last_fullsized":"2026-02-25T15:19:25.343833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:57:47.179868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.272670+0000","last_change":"2026-02-25T15:13:41.080682+0000","last_active":"2026-02-25T15:19:25.272670+0000","last_peered":"2026-02-25T15:19:25.272670+0000","last_clean":"2026-02-25T15:19:25.272670+0000","last_became_active":"2026-02-25T15:13:41.078571+0000","last_became_peered":"2026-02-25T15:13:41.078571+0000","last_unstale":"2026-02-25T15:19:25.272670+0000","last_undegraded":"2026-02-25T15:19:25.272670+0000","last_fullsized":"2026-02-25T15:19:25.272670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:59:53.550632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":645,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.283969+0000","last_change":"2026-02-25T15:13:41.031697+0000","last_active":"2026-02-25T15:19:25.283969+0000","last_peered":"2026-02-25T15:19:25.283969+0000","last_clean":"2026-02-25T15:19:25.283969+0000","last_became_active":"2026-02-25T15:13:41.027073+0000","last_became_peered":"2026-02-25T15:13:41.027073+0000","last_unstale":"2026-02-25T15:19:25.283969+0000","last_undegraded":"2026-02-25T15:19:25.283969+0000","last_fullsized":"2026-02-25T15:19:25.283969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:46:27.108833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.235782+0000","last_change":"2026-02-25T15:13:40.948864+0000","last_active":"2026-02-25T15:19:25.235782+0000","last_peered":"2026-02-25T15:19:25.235782+0000","last_clean":"2026-02-25T15:19:25.235782+0000","last_became_active":"2026-02-25T15:13:40.944589+0000","last_became_peered":"2026-02-25T15:13:40.944589+0000","last_unstale":"2026-02-25T15:19:25.235782+0000","last_undegraded":"2026-02-25T15:19:25.235782+0000","last_fullsized":"2026-02-25T15:19:25.235782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:57:01.500928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":645,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.308760+0000","last_change":"2026-02-25T15:13:42.005732+0000","last_active":"2026-02-25T15:19:26.308760+0000","last_peered":"2026-02-25T15:19:26.308760+0000","last_clean":"2026-02-25T15:19:26.308760+0000","last_became_active":"2026-02-25T15:13:42.003162+0000","last_became_peered":"2026-02-25T15:13:42.003162+0000","last_unstale":"2026-02-25T15:19:26.308760+0000","last_undegraded":"2026-02-25T15:19:26.308760+0000","last_fullsized":"2026-02-25T15:19:26.308760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:38:43.188701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":646,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.282230+0000","last_change":"2026-02-25T15:13:41.042732+0000","last_active":"2026-02-25T15:19:26.282230+0000","last_peered":"2026-02-25T15:19:26.282230+0000","last_clean":"2026-02-25T15:19:26.282230+0000","last_became_active":"2026-02-25T15:13:41.040468+0000","last_became_peered":"2026-02-25T15:13:41.040468+0000","last_unstale":"2026-02-25T15:19:26.282230+0000","last_undegraded":"2026-02-25T15:19:26.282230+0000","last_fullsized":"2026-02-25T15:19:26.282230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:14:52.942685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.352513+0000","last_change":"2026-02-25T15:13:40.464514+0000","last_active":"2026-02-25T15:19:25.352513+0000","last_peered":"2026-02-25T15:19:25.352513+0000","last_clean":"2026-02-25T15:19:25.352513+0000","last_became_active":"2026-02-25T15:13:40.462421+0000","last_became_peered":"2026-02-25T15:13:40.462421+0000","last_unstale":"2026-02-25T15:19:25.352513+0000","last_undegraded":"2026-02-25T15:19:25.352513+0000","last_fullsized":"2026-02-25T15:19:25.352513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:13:19.955826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":648,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.351051+0000","last_change":"2026-02-25T15:13:40.746985+0000","last_active":"2026-02-25T15:19:25.351051+0000","last_peered":"2026-02-25T15:19:25.351051+0000","last_clean":"2026-02-25T15:19:25.351051+0000","last_became_active":"2026-02-25T15:13:40.744228+0000","last_became_peered":"2026-02-25T15:13:40.744228+0000","last_unstale":"2026-02-25T15:19:25.351051+0000","last_undegraded":"2026-02-25T15:19:25.351051+0000","last_fullsized":"2026-02-25T15:19:25.351051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:17:18.195998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.1","version":"33'11","reported_seq":674,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.234406+0000","last_change":"2026-02-25T15:13:40.735103+0000","last_active":"2026-02-25T15:19:25.234406+0000","last_peered":"2026-02-25T15:19:25.234406+0000","last_clean":"2026-02-25T15:19:25.234406+0000","last_became_active":"2026-02-25T15:13:40.703448+0000","last_became_peered":"2026-02-25T15:13:40.703448+0000","last_unstale":"2026-02-25T15:19:25.234406+0000","last_undegraded":"2026-02-25T15:19:25.234406+0000","last_fullsized":"2026-02-25T15:19:25.234406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:12:02.614079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.586169+0000","last_change":"2026-02-25T15:13:41.235640+0000","last_active":"2026-02-25T15:19:21.586169+0000","last_peered":"2026-02-25T15:19:21.586169+0000","last_clean":"2026-02-25T15:19:21.586169+0000","last_became_active":"2026-02-25T15:13:41.233579+0000","last_became_peered":"2026-02-25T15:13:41.233579+0000","last_unstale":"2026-02-25T15:19:21.586169+0000","last_undegraded":"2026-02-25T15:19:21.586169+0000","last_fullsized":"2026-02-25T15:19:21.586169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:52:24.301222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.242167+0000","last_change":"2026-02-25T15:13:41.023468+0000","last_active":"2026-02-25T15:19:25.242167+0000","last_peered":"2026-02-25T15:19:25.242167+0000","last_clean":"2026-02-25T15:19:25.242167+0000","last_became_active":"2026-02-25T15:13:41.021310+0000","last_became_peered":"2026-02-25T15:13:41.021310+0000","last_unstale":"2026-02-25T15:19:25.242167+0000","last_undegraded":"2026-02-25T15:19:25.242167+0000","last_fullsized":"2026-02-25T15:19:25.242167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:59:17.205188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":646,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.278159+0000","last_change":"2026-02-25T15:13:40.703490+0000","last_active":"2026-02-25T15:19:25.278159+0000","last_peered":"2026-02-25T15:19:25.278159+0000","last_clean":"2026-02-25T15:19:25.278159+0000","last_became_active":"2026-02-25T15:13:40.701282+0000","last_became_peered":"2026-02-25T15:13:40.701282+0000","last_unstale":"2026-02-25T15:19:25.278159+0000","last_undegraded":"2026-02-25T15:19:25.278159+0000","last_fullsized":"2026-02-25T15:19:25.278159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:33:36.654692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,12],"acting":[5,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":663,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.316811+0000","last_change":"2026-02-25T15:13:02.846272+0000","last_active":"2026-02-25T15:19:26.316811+0000","last_peered":"2026-02-25T15:19:26.316811+0000","last_clean":"2026-02-25T15:19:26.316811+0000","last_became_active":"2026-02-25T15:13:01.240693+0000","last_became_peered":"2026-02-25T15:13:01.240693+0000","last_unstale":"2026-02-25T15:19:26.316811+0000","last_undegraded":"2026-02-25T15:19:26.316811+0000","last_fullsized":"2026-02-25T15:19:26.316811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:32:46.429234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068336521999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,15],"acting":[12,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":663,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.241263+0000","last_change":"2026-02-25T15:13:03.354671+0000","last_active":"2026-02-25T15:19:25.241263+0000","last_peered":"2026-02-25T15:19:25.241263+0000","last_clean":"2026-02-25T15:19:25.241263+0000","last_became_active":"2026-02-25T15:13:01.107596+0000","last_became_peered":"2026-02-25T15:13:01.107596+0000","last_unstale":"2026-02-25T15:19:25.241263+0000","last_undegraded":"2026-02-25T15:19:25.241263+0000","last_fullsized":"2026-02-25T15:19:25.241263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:21.484744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043275358999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":662,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.245972+0000","last_change":"2026-02-25T15:13:04.197397+0000","last_active":"2026-02-25T15:19:25.245972+0000","last_peered":"2026-02-25T15:19:25.245972+0000","last_clean":"2026-02-25T15:19:25.245972+0000","last_became_active":"2026-02-25T15:13:00.886357+0000","last_became_peered":"2026-02-25T15:13:00.886357+0000","last_unstale":"2026-02-25T15:19:25.245972+0000","last_undegraded":"2026-02-25T15:19:25.245972+0000","last_fullsized":"2026-02-25T15:19:25.245972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:21:14.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047817094999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":662,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.243478+0000","last_change":"2026-02-25T15:13:04.192793+0000","last_active":"2026-02-25T15:19:25.243478+0000","last_peered":"2026-02-25T15:19:25.243478+0000","last_clean":"2026-02-25T15:19:25.243478+0000","last_became_active":"2026-02-25T15:13:01.030043+0000","last_became_peered":"2026-02-25T15:13:01.030043+0000","last_unstale":"2026-02-25T15:19:25.243478+0000","last_undegraded":"2026-02-25T15:19:25.243478+0000","last_fullsized":"2026-02-25T15:19:25.243478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:56:20.078816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047341022000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14],"acting":[11,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"28'2","reported_seq":666,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.291712+0000","last_change":"2026-02-25T15:13:02.847201+0000","last_active":"2026-02-25T15:19:26.291712+0000","last_peered":"2026-02-25T15:19:26.291712+0000","last_clean":"2026-02-25T15:19:26.291712+0000","last_became_active":"2026-02-25T15:13:01.242716+0000","last_became_peered":"2026-02-25T15:13:01.242716+0000","last_unstale":"2026-02-25T15:19:26.291712+0000","last_undegraded":"2026-02-25T15:19:26.291712+0000","last_fullsized":"2026-02-25T15:19:26.291712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:42.867009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073362477999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,8],"acting":[12,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":663,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.249804+0000","last_change":"2026-02-25T15:13:03.340291+0000","last_active":"2026-02-25T15:19:25.249804+0000","last_peered":"2026-02-25T15:19:25.249804+0000","last_clean":"2026-02-25T15:19:25.249804+0000","last_became_active":"2026-02-25T15:13:01.167595+0000","last_became_peered":"2026-02-25T15:13:01.167595+0000","last_unstale":"2026-02-25T15:19:25.249804+0000","last_undegraded":"2026-02-25T15:19:25.249804+0000","last_fullsized":"2026-02-25T15:19:25.249804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:48:42.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030257392000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":666,"reported_epoch":350,"state":"active+clean","last_fresh":"2026-02-25T15:19:25.349306+0000","last_change":"2026-02-25T15:13:03.344370+0000","last_active":"2026-02-25T15:19:25.349306+0000","last_peered":"2026-02-25T15:19:25.349306+0000","last_clean":"2026-02-25T15:19:25.349306+0000","last_became_active":"2026-02-25T15:13:01.165967+0000","last_became_peered":"2026-02-25T15:13:01.165967+0000","last_unstale":"2026-02-25T15:19:25.349306+0000","last_undegraded":"2026-02-25T15:19:25.349306+0000","last_fullsized":"2026-02-25T15:19:25.349306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:41:44.607565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030945777000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"26'1","reported_seq":665,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-25T15:19:26.294757+0000","last_change":"2026-02-25T15:13:02.837950+0000","last_active":"2026-02-25T15:19:26.294757+0000","last_peered":"2026-02-25T15:19:26.294757+0000","last_clean":"2026-02-25T15:19:26.294757+0000","last_became_active":"2026-02-25T15:13:01.049643+0000","last_became_peered":"2026-02-25T15:13:01.049643+0000","last_unstale":"2026-02-25T15:19:26.294757+0000","last_undegraded":"2026-02-25T15:19:26.294757+0000","last_fullsized":"2026-02-25T15:19:26.294757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:51:09.091771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059457101999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"1.0","version":"24'32","reported_seq":701,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-25T15:19:21.606180+0000","last_change":"2026-02-25T15:12:53.255197+0000","last_active":"2026-02-25T15:19:21.606180+0000","last_peered":"2026-02-25T15:19:21.606180+0000","last_clean":"2026-02-25T15:19:21.606180+0000","last_became_active":"2026-02-25T15:12:53.235995+0000","last_became_peered":"2026-02-25T15:12:53.235995+0000","last_unstale":"2026-02-25T15:19:21.606180+0000","last_undegraded":"2026-02-25T15:19:21.606180+0000","last_fullsized":"2026-02-25T15:19:21.606180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:51.067937+0000","last_clean_scrub_stamp":"2026-02-25T15:12:51.067937+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:13:12.776604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280592,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51904,"kb_used_data":6896,"kb_used_omap":4682,"kb_used_meta":40309,"kb_avail":94319936,"statfs":{"total":96636764160,"available":96583614464,"internally_reserved":0,"allocated":7061504,"data_stored":4488878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4795118,"internal_metadata":41276690},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280593,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220942,"internal_metadata":27369714},"hb_peers":[1,2,3,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280594,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4518007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218768,"internal_metadata":27371888},"hb_peers":[0,1,2,4,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":3023,"kb_used_meta":23920,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3096452,"internal_metadata":24494204},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313297,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":8641,"kb_used_meta":18302,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8848431,"internal_metadata":18742225},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33840,"kb_used_data":6880,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338000,"statfs":{"total":96636764160,"available":96602112000,"internally_reserved":0,"allocated":7045120,"data_stored":4479247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214678,"internal_metadata":27375978},"hb_peers":[1,3,4,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280593,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34292,"kb_used_data":7332,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94337548,"statfs":{"total":96636764160,"available":96601649152,"internally_reserved":0,"allocated":7507968,"data_stored":4938527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216439,"internal_metadata":27374217},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280593,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216025,"internal_metadata":27374631},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218373,"internal_metadata":27372283},"hb_peers":[0,1,2,4,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280593,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34364,"kb_used_data":7404,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337476,"statfs":{"total":96636764160,"available":96601575424,"internally_reserved":0,"allocated":7581696,"data_stored":4977273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218913,"internal_metadata":27371743},"hb_peers":[0,1,2,3,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280593,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":2927,"kb_used_meta":24016,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4517993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2997987,"internal_metadata":24592669},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280593,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4527526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218065,"internal_metadata":27372591},"hb_peers":[0,1,2,3,4,5,6,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280593,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":6952,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":7118848,"data_stored":4518007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218898,"internal_metadata":27371758},"hb_peers":[0,1,2,3,4,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280594,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33840,"kb_used_data":6880,"kb_used_omap":182,"kb_used_meta":26761,"kb_avail":94338000,"statfs":{"total":96636764160,"available":96602112000,"internally_reserved":0,"allocated":7045120,"data_stored":4479247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187370,"internal_metadata":27403286},"hb_peers":[0,1,2,3,4,5,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280594,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3092248,"internal_metadata":24498408},"hb_peers":[0,1,2,3,4,5,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280593,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33908,"kb_used_data":6948,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94337932,"statfs":{"total":96636764160,"available":96602042368,"internally_reserved":0,"allocated":7114752,"data_stored":4517988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138420,"internal_metadata":27452236},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:19:27.647 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T15:19:27.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.710+0000 7f2b41846640 10 monclient: get_monmap_and_config 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.710+0000 7f2b41846640 10 monclient: build_initial_monmap 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient: monmap: 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:27.711913+0000 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:27.711913+0000 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:27.714 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:27.715 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:27.715 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 1 Processor -- start 2026-02-25T15:19:27.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 1 -- start start 2026-02-25T15:19:27.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient: init 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient(hunting): picked mon.noname-c con 0x7f2b3c058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient(hunting): picked mon.noname-a con 0x7f2b3c0b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient(hunting): picked mon.noname-b con 0x7f2b3c1626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b3c1655c0 con 0x7f2b3c0b0410 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b3c0b12b0 con 0x7f2b3c1626a0 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b3c0b1590 con 0x7f2b3c058da0 2026-02-25T15:19:27.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.711+0000 7f2b41846640 10 monclient(hunting): authenticate will time out at 3737.300995s 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.712+0000 7f2b3affd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f2b3c058da0 0x7f2b3c1647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47618/0 (socket says 10.20.193.78:47618) 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.712+0000 7f2b3affd640 1 -- 10.20.193.78:0/3646171626 learned_addr learned my addr 10.20.193.78:0/3646171626 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773194240 0 0) 0x7f2b3c0b1590 con 0x7f2b3c058da0 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): my global_id is 27602 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b28003610 con 0x7f2b3c058da0 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1055744164 0 0) 0x7f2b3c1655c0 con 0x7f2b3c0b0410 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): my global_id is 30768 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b3c0b1590 con 0x7f2b3c0b0410 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069198603 0 0) 0x7f2b3c0b12b0 con 0x7f2b3c1626a0 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 10 monclient(hunting): my global_id is 30055 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.713+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b3c1655c0 con 0x7f2b3c1626a0 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2571128965 0 0) 0x7f2b28003610 con 0x7f2b3c058da0 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 >> v1:10.20.193.155:6789/0 conn(0x7f2b3c1626a0 legacy=0x7f2b3c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 >> v1:10.20.193.78:6789/0 conn(0x7f2b3c0b0410 legacy=0x7f2b3c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 1 monclient: found mon.noname-c 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3c0b1870 con 0x7f2b3c058da0 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2b30002df0 con 0x7f2b3c058da0 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b39ffb640 10 monclient: dump: 2026-02-25T15:19:27.724 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b41846640 5 monclient: authenticate success, global_id 27602 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.715+0000 7f2b41846640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:27.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b30002fc0 con 0x7f2b3c058da0 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b39ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b39ffb640 1 -- 10.20.193.78:0/3646171626 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2b30003400 con 0x7f2b3c058da0 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 4 set_mon_vals no callback set 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b39ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b39ffb640 10 monclient: dump: 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.726 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 10 monclient: shutdown 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 1 -- 10.20.193.78:0/3646171626 >> v1:10.20.193.167:6789/0 conn(0x7f2b3c058da0 legacy=0x7f2b3c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 1 -- 10.20.193.78:0/3646171626 shutdown_connections 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 1 -- 10.20.193.78:0/3646171626 >> 10.20.193.78:0/3646171626 conn(0x7f2b3c0b65f0 msgr2=0x7f2b3c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 1 -- 10.20.193.78:0/3646171626 shutdown_connections 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 1 -- 10.20.193.78:0/3646171626 wait complete. 2026-02-25T15:19:27.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 10 monclient: build_initial_monmap 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 10 monclient: monmap: 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 1 librados: starting msgr at 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.716+0000 7f2b41846640 1 librados: starting objecter 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 1 Processor -- start 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 1 -- start start 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 1 librados: setting wanted keys 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 1 librados: calling monclient init 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 10 monclient: init 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:27.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 10 monclient(hunting): picked mon.noname-a con 0x7f2b3c058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 10 monclient(hunting): picked mon.noname-c con 0x7f2b3c0b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 10 monclient(hunting): picked mon.noname-b con 0x7f2b3c1626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b3c1fbdf0 con 0x7f2b3c058da0 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b3c0ae250 con 0x7f2b3c1626a0 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b3c0ae530 con 0x7f2b3c0b0410 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b41846640 10 monclient(hunting): authenticate will time out at 3737.306534s 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b3affd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f2b3c058da0 0x7f2b3c132a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50146/0 (socket says 10.20.193.78:50146) 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b3affd640 1 -- 10.20.193.78:0/2474831110 learned_addr learned my addr 10.20.193.78:0/2474831110 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b13fff640 10 client.?.objecter ms_handle_connect 0x7f2b3c058da0 2026-02-25T15:19:27.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.717+0000 7f2b13fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 client.?.objecter ms_handle_connect 0x7f2b3c0b0410 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 client.?.objecter ms_handle_connect 0x7f2b3c1626a0 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060100940 0 0) 0x7f2b3c0ae530 con 0x7f2b3c0b0410 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 monclient(hunting): my global_id is 27605 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b0c003610 con 0x7f2b3c0b0410 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984117969 0 0) 0x7f2b3c1fbdf0 con 0x7f2b3c058da0 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 10 monclient(hunting): my global_id is 30771 2026-02-25T15:19:27.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.718+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b3c0ae530 con 0x7f2b3c058da0 2026-02-25T15:19:27.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.719+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997780334 0 0) 0x7f2b3c0ae250 con 0x7f2b3c1626a0 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.719+0000 7f2b13fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.719+0000 7f2b13fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.719+0000 7f2b13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.719+0000 7f2b13fff640 10 monclient(hunting): my global_id is 30058 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.719+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b3c1fbdf0 con 0x7f2b3c1626a0 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 628340281 0 0) 0x7f2b0c003610 con 0x7f2b3c0b0410 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b3c0ae250 con 0x7f2b3c0b0410 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2b240030b0 con 0x7f2b3c0b0410 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 10 monclient(hunting): dump: 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4202493598 0 0) 0x7f2b3c0ae530 con 0x7f2b3c058da0 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b0c003610 con 0x7f2b3c058da0 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2b30003310 con 0x7f2b3c058da0 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.721+0000 7f2b13fff640 10 monclient(hunting): dump: 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.737 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3849632165 0 0) 0x7f2b3c1fbdf0 con 0x7f2b3c1626a0 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b3c0ae530 con 0x7f2b3c1626a0 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2b2c003330 con 0x7f2b3c1626a0 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:27.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 10 monclient(hunting): dump: 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 908180985 0 0) 0x7f2b3c0ae250 con 0x7f2b3c0b0410 2026-02-25T15:19:27.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 >> v1:10.20.193.155:6789/0 conn(0x7f2b3c1626a0 legacy=0x7f2b3c163030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 >> v1:10.20.193.78:6789/0 conn(0x7f2b3c058da0 legacy=0x7f2b3c132a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 1 monclient: found mon.c 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3c0ae810 con 0x7f2b3c0b0410 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 10 monclient: _finish_auth 0 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 5 monclient: authenticate success, global_id 27605 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 10 monclient: _renew_subs 2026-02-25T15:19:27.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3c0aeaf0 con 0x7f2b3c0b0410 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 10 client.27605.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 10 monclient: _renew_subs 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b3c1fe610 con 0x7f2b3c0b0410 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.722+0000 7f2b41846640 1 librados: init done 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.723+0000 7f2b41846640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.723+0000 7f2b41846640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.723+0000 7f2b41846640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.723+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3c0b6e40 con 0x7f2b3c0b0410 2026-02-25T15:19:27.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.814+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b240036b0 con 0x7f2b3c0b0410 2026-02-25T15:19:27.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.814+0000 7f2b13fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:27.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.814+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2b24003a00 con 0x7f2b3c0b0410 2026-02-25T15:19:27.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.814+0000 7f2b13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:27.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.814+0000 7f2b13fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:27.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.814+0000 7f2b397fa640 4 set_mon_vals no callback set 2026-02-25T15:19:27.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.814+0000 7f2b13fff640 10 monclient: dump: 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:27.818 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:27.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.815+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f2b2401c870 con 0x7f2b3c0b0410 2026-02-25T15:19:27.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.815+0000 7f2b3affd640 10 monclient: get_auth_request con 0x7f2b0c077e70 auth_method 0 2026-02-25T15:19:27.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.815+0000 7f2b13fff640 10 client.27605.objecter ms_handle_connect 0x7f2b0c077e70 2026-02-25T15:19:27.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.817+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(351..351 src has 1..351) ==== 8955+0+0 (unknown 1841964965 0 0) 0x7f2b24091fb0 con 0x7f2b3c0b0410 2026-02-25T15:19:27.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.817+0000 7f2b13fff640 10 client.27605.objecter ms_dispatch2 0x7f2b3c000b90 osd_map(351..351 src has 1..351) 2026-02-25T15:19:27.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.817+0000 7f2b13fff640 3 client.27605.objecter handle_osd_map got epochs [351,351] > 0 2026-02-25T15:19:27.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.817+0000 7f2b13fff640 3 client.27605.objecter handle_osd_map decoding full epoch 351 2026-02-25T15:19:27.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.817+0000 7f2b13fff640 20 client.27605.objecter dump_active .. 0 homeless 2026-02-25T15:19:27.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.818+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2b2405c9e0 con 0x7f2b3c0b0410 2026-02-25T15:19:27.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.818+0000 7f2b13fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:27.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.818+0000 7f2b13fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:27.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.922+0000 7f2b41846640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:19:27.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.922+0000 7f2b41846640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:19:27.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.922+0000 7f2b41846640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:27.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.922+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b3c0b6b60 con 0x7f2b3c0b0410 2026-02-25T15:19:27.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.944+0000 7f2b13fff640 1 -- 10.20.193.78:0/2474831110 <== mon.2 v1:10.20.193.167:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v351) ==== 74+0+23459 (unknown 4216274566 0 3279980262) 0x7f2b2405c2e0 con 0x7f2b3c0b0410 2026-02-25T15:19:27.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.944+0000 7f2b13fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:19:27.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.944+0000 7f2b13fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:19:27.946 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:19:27.947 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":351,"fsid":"609bd52f-adc3-49d3-9ae3-11e4ae0954b8","created":"2026-02-25T15:12:18.044327+0000","modified":"2026-02-25T15:19:26.208978+0000","last_up_change":"2026-02-25T15:12:51.067937+0000","last_in_change":"2026-02-25T15:12:24.570919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":105,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T15:12:50.860144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T15:12:59.489971+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":28,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-25T15:13:37.439697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"103f8616-97cb-41dd-a0f9-f0b0e45afa16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":3604255984}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":3604255984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":3604255984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":3604255984}]},"public_addr":"10.20.193.78:6801/3604255984","cluster_addr":"10.20.193.78:6802/3604255984","heartbeat_back_addr":"10.20.193.78:6804/3604255984","heartbeat_front_addr":"10.20.193.78:6803/3604255984","state":["exists","up"]},{"osd":1,"uuid":"38bba215-85ca-4c94-b874-04b5b8c9e3b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6812","nonce":2301996681}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6813","nonce":2301996681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6815","nonce":2301996681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6814","nonce":2301996681}]},"public_addr":"10.20.193.155:6812/2301996681","cluster_addr":"10.20.193.155:6813/2301996681","heartbeat_back_addr":"10.20.193.155:6815/2301996681","heartbeat_front_addr":"10.20.193.155:6814/2301996681","state":["exists","up"]},{"osd":2,"uuid":"c52b2aaa-ad6c-4538-aec9-721e83f3b87b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6808","nonce":3985671893}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6809","nonce":3985671893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6811","nonce":3985671893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6810","nonce":3985671893}]},"public_addr":"10.20.193.167:6808/3985671893","cluster_addr":"10.20.193.167:6809/3985671893","heartbeat_back_addr":"10.20.193.167:6811/3985671893","heartbeat_front_addr":"10.20.193.167:6810/3985671893","state":["exists","up"]},{"osd":3,"uuid":"d07f6908-52a2-4d9f-b23f-16cd4124aeeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6804","nonce":3507256265}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6805","nonce":3507256265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6807","nonce":3507256265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6806","nonce":3507256265}]},"public_addr":"10.20.193.174:6804/3507256265","cluster_addr":"10.20.193.174:6805/3507256265","heartbeat_back_addr":"10.20.193.174:6807/3507256265","heartbeat_front_addr":"10.20.193.174:6806/3507256265","state":["exists","up"]},{"osd":4,"uuid":"432be5b2-4fae-4259-ba4e-f5c9383c02d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":2928350245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":2928350245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2928350245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":2928350245}]},"public_addr":"10.20.193.78:6805/2928350245","cluster_addr":"10.20.193.78:6806/2928350245","heartbeat_back_addr":"10.20.193.78:6808/2928350245","heartbeat_front_addr":"10.20.193.78:6807/2928350245","state":["exists","up"]},{"osd":5,"uuid":"0e76930a-01c4-4f57-ad02-e0e515ea5337","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6804","nonce":3530698425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6806","nonce":3530698425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6808","nonce":3530698425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6807","nonce":3530698425}]},"public_addr":"10.20.193.155:6804/3530698425","cluster_addr":"10.20.193.155:6806/3530698425","heartbeat_back_addr":"10.20.193.155:6808/3530698425","heartbeat_front_addr":"10.20.193.155:6807/3530698425","state":["exists","up"]},{"osd":6,"uuid":"cc9df2ee-02c5-41ab-9841-4bcc3839e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6812","nonce":762620751}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6813","nonce":762620751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6815","nonce":762620751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6814","nonce":762620751}]},"public_addr":"10.20.193.167:6812/762620751","cluster_addr":"10.20.193.167:6813/762620751","heartbeat_back_addr":"10.20.193.167:6815/762620751","heartbeat_front_addr":"10.20.193.167:6814/762620751","state":["exists","up"]},{"osd":7,"uuid":"9b16da96-8cc4-4b91-91cb-2ca1e6917bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6809","nonce":463709274}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6811","nonce":463709274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6815","nonce":463709274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6813","nonce":463709274}]},"public_addr":"10.20.193.174:6809/463709274","cluster_addr":"10.20.193.174:6811/463709274","heartbeat_back_addr":"10.20.193.174:6815/463709274","heartbeat_front_addr":"10.20.193.174:6813/463709274","state":["exists","up"]},{"osd":8,"uuid":"fdbfc988-e822-416b-a4a9-8479496b0a22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":1740746686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":1740746686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":1740746686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":1740746686}]},"public_addr":"10.20.193.78:6810/1740746686","cluster_addr":"10.20.193.78:6812/1740746686","heartbeat_back_addr":"10.20.193.78:6816/1740746686","heartbeat_front_addr":"10.20.193.78:6814/1740746686","state":["exists","up"]},{"osd":9,"uuid":"c884aa7f-435f-41f7-863d-36e4bdf73113","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6805","nonce":976780597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6809","nonce":976780597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6811","nonce":976780597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6810","nonce":976780597}]},"public_addr":"10.20.193.155:6805/976780597","cluster_addr":"10.20.193.155:6809/976780597","heartbeat_back_addr":"10.20.193.155:6811/976780597","heartbeat_front_addr":"10.20.193.155:6810/976780597","state":["exists","up"]},{"osd":10,"uuid":"8fd183a2-7025-4c41-813e-e5fa260d532c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6804","nonce":601461155}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6805","nonce":601461155}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6807","nonce":601461155}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6806","nonce":601461155}]},"public_addr":"10.20.193.167:6804/601461155","cluster_addr":"10.20.193.167:6805/601461155","heartbeat_back_addr":"10.20.193.167:6807/601461155","heartbeat_front_addr":"10.20.193.167:6806/601461155","state":["exists","up"]},{"osd":11,"uuid":"5102cdb4-cabf-4bf2-a0ff-fc6e20018bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6800","nonce":1887691036}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6801","nonce":1887691036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6803","nonce":1887691036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6802","nonce":1887691036}]},"public_addr":"10.20.193.174:6800/1887691036","cluster_addr":"10.20.193.174:6801/1887691036","heartbeat_back_addr":"10.20.193.174:6803/1887691036","heartbeat_front_addr":"10.20.193.174:6802/1887691036","state":["exists","up"]},{"osd":12,"uuid":"3491fb62-65cb-4eef-a6d6-83faec6f22dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3800864779}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3800864779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":3800864779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":3800864779}]},"public_addr":"10.20.193.78:6809/3800864779","cluster_addr":"10.20.193.78:6811/3800864779","heartbeat_back_addr":"10.20.193.78:6815/3800864779","heartbeat_front_addr":"10.20.193.78:6813/3800864779","state":["exists","up"]},{"osd":13,"uuid":"dc55bcec-89ee-4aa0-b54c-86770272f179","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":346,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6800","nonce":4105183277}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6801","nonce":4105183277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6803","nonce":4105183277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.155:6802","nonce":4105183277}]},"public_addr":"10.20.193.155:6800/4105183277","cluster_addr":"10.20.193.155:6801/4105183277","heartbeat_back_addr":"10.20.193.155:6803/4105183277","heartbeat_front_addr":"10.20.193.155:6802/4105183277","state":["exists","up"]},{"osd":14,"uuid":"18e46ea0-0a65-4b4d-af19-79bacdd9a385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6800","nonce":376081176}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6801","nonce":376081176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6803","nonce":376081176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.167:6802","nonce":376081176}]},"public_addr":"10.20.193.167:6800/376081176","cluster_addr":"10.20.193.167:6801/376081176","heartbeat_back_addr":"10.20.193.167:6803/376081176","heartbeat_front_addr":"10.20.193.167:6802/376081176","state":["exists","up"]},{"osd":15,"uuid":"2dad930d-8547-4360-a38d-cc0d02d6d263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":349,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6808","nonce":2760611848}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6810","nonce":2760611848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6814","nonce":2760611848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.174:6812","nonce":2760611848}]},"public_addr":"10.20.193.174:6808/2760611848","cluster_addr":"10.20.193.174:6810/2760611848","heartbeat_back_addr":"10.20.193.174:6814/2760611848","heartbeat_front_addr":"10.20.193.174:6812/2760611848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.914877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.866863+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.870323+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.920826+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.103405+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.622662+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.967538+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.005082+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.055253+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.755804+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.863220+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.094171+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:49.145637+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.608452+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.864615+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:12:48.980094+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":2,"length":5}]},{"pool":21,"snaps":[{"begin":1,"length":1}]},{"pool":22,"snaps":[{"begin":2,"length":3}]},{"pool":59,"snaps":[{"begin":1,"length":1}]},{"pool":88,"snaps":[{"begin":7,"length":2}]},{"pool":92,"snaps":[{"begin":1,"length":1}]},{"pool":112,"snaps":[{"begin":1,"length":2}]},{"pool":127,"snaps":[{"begin":3,"length":1}]},{"pool":136,"snaps":[{"begin":2,"length":2}]},{"pool":139,"snaps":[{"begin":1,"length":4}]},{"pool":149,"snaps":[{"begin":2,"length":3}]},{"pool":158,"snaps":[{"begin":2,"length":2}]},{"pool":164,"snaps":[{"begin":2,"length":4}]},{"pool":176,"snaps":[{"begin":2,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":4}]},{"pool":193,"snaps":[{"begin":4,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:19:27.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.944+0000 7f2b41846640 10 librados: watch_flush enter 2026-02-25T15:19:27.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 10 librados: watch_flush exit 2026-02-25T15:19:27.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 20 client.27605.objecter shutdown clearing up homeless session... 2026-02-25T15:19:27.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 10 client.27605.objecter successfully canceled tick 2026-02-25T15:19:27.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 >> v1:10.20.193.78:6800/3497602169 conn(0x7f2b0c077e70 legacy=0x7f2b0c098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 10 monclient: shutdown 2026-02-25T15:19:27.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:27.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 >> v1:10.20.193.167:6789/0 conn(0x7f2b3c0b0410 legacy=0x7f2b3c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:27.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 shutdown_connections 2026-02-25T15:19:27.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 >> 10.20.193.78:0/2474831110 conn(0x7f2b3c0b65f0 msgr2=0x7f2b3c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:27.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 shutdown_connections 2026-02-25T15:19:27.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 1 -- 10.20.193.78:0/2474831110 wait complete. 2026-02-25T15:19:27.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:27.945+0000 7f2b41846640 1 librados: shutdown 2026-02-25T15:19:28.959 INFO:tasks.ceph:Scrubbing osd.0 2026-02-25T15:19:28.959 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:29.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.028+0000 7fe1ddabf640 10 monclient: get_monmap_and_config 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.028+0000 7fe1ddabf640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.028+0000 7fe1ddabf640 10 monclient: monmap: 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:29.029453+0000 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:29.029453+0000 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.031 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.032 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.032 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.032 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 1 Processor -- start 2026-02-25T15:19:29.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 1 -- start start 2026-02-25T15:19:29.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 10 monclient: init 2026-02-25T15:19:29.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 10 monclient(hunting): picked mon.noname-c con 0x7fe1d815d1c0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 10 monclient(hunting): picked mon.noname-a con 0x7fe1d80b8330 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 10 monclient(hunting): picked mon.noname-b con 0x7fe1d80b5d10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d815d590 con 0x7fe1d80b8330 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d8052650 con 0x7fe1d80b5d10 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d8163ec0 con 0x7fe1d815d1c0 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.029+0000 7fe1ddabf640 10 monclient(hunting): authenticate will time out at 3738.618675s 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.030+0000 7fe1d77fe640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fe1d815d1c0 0x7fe1d8059d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47636/0 (socket says 10.20.193.78:47636) 2026-02-25T15:19:29.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.030+0000 7fe1d77fe640 1 -- 10.20.193.78:0/3704481753 learned_addr learned my addr 10.20.193.78:0/3704481753 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802928915 0 0) 0x7fe1d8163ec0 con 0x7fe1d815d1c0 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): my global_id is 27608 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1bc003610 con 0x7fe1d815d1c0 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579374179 0 0) 0x7fe1d815d590 con 0x7fe1d80b8330 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): my global_id is 30774 2026-02-25T15:19:29.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d8163ec0 con 0x7fe1d80b8330 2026-02-25T15:19:29.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313778340 0 0) 0x7fe1d8052650 con 0x7fe1d80b5d10 2026-02-25T15:19:29.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 10 monclient(hunting): my global_id is 30061 2026-02-25T15:19:29.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.031+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d815d590 con 0x7fe1d80b5d10 2026-02-25T15:19:29.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4093343129 0 0) 0x7fe1bc003610 con 0x7fe1d815d1c0 2026-02-25T15:19:29.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 >> v1:10.20.193.155:6789/0 conn(0x7fe1d80b5d10 legacy=0x7fe1d81c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 >> v1:10.20.193.78:6789/0 conn(0x7fe1d80b8330 legacy=0x7fe1d805a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 1 monclient: found mon.noname-c 2026-02-25T15:19:29.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d8057a50 con 0x7fe1d815d1c0 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1c4002df0 con 0x7fe1d815d1c0 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1d67fc640 10 monclient: dump: 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.043 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1ddabf640 5 monclient: authenticate success, global_id 27608 2026-02-25T15:19:29.044 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.033+0000 7fe1ddabf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1c4002fc0 con 0x7fe1d815d1c0 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1d67fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1d67fc640 1 -- 10.20.193.78:0/3704481753 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1c4003400 con 0x7fe1d815d1c0 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1d67fc640 10 monclient: dump: 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.045 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 4 set_mon_vals no callback set 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 10 monclient: shutdown 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 1 -- 10.20.193.78:0/3704481753 >> v1:10.20.193.167:6789/0 conn(0x7fe1d815d1c0 legacy=0x7fe1d8059d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 1 -- 10.20.193.78:0/3704481753 shutdown_connections 2026-02-25T15:19:29.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 1 -- 10.20.193.78:0/3704481753 >> 10.20.193.78:0/3704481753 conn(0x7fe1d80b5200 msgr2=0x7fe1d80b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 1 -- 10.20.193.78:0/3704481753 shutdown_connections 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.034+0000 7fe1ddabf640 1 -- 10.20.193.78:0/3704481753 wait complete. 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 10 monclient: monmap: 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.047 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 1 librados: starting msgr at 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 1 librados: starting objecter 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 1 Processor -- start 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 1 -- start start 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 1 librados: setting wanted keys 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 1 librados: calling monclient init 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.035+0000 7fe1ddabf640 10 monclient: init 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 10 monclient(hunting): picked mon.noname-b con 0x7fe1d80b5d10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 10 monclient(hunting): picked mon.noname-c con 0x7fe1d80b8330 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 10 monclient(hunting): picked mon.noname-a con 0x7fe1d815d1c0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d8133d90 con 0x7fe1d815d1c0 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d8134030 con 0x7fe1d80b5d10 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d8134310 con 0x7fe1d80b8330 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1ddabf640 10 monclient(hunting): authenticate will time out at 3738.625159s 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1d6ffd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fe1d80b8330 0x7fe1d8059180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47652/0 (socket says 10.20.193.78:47652) 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1d6ffd640 1 -- 10.20.193.78:0/1672710223 learned_addr learned my addr 10.20.193.78:0/1672710223 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1b3fff640 10 client.?.objecter ms_handle_connect 0x7fe1d815d1c0 2026-02-25T15:19:29.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1b3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1b3fff640 10 client.?.objecter ms_handle_connect 0x7fe1d80b8330 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.036+0000 7fe1b3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 client.?.objecter ms_handle_connect 0x7fe1d80b5d10 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216973241 0 0) 0x7fe1d8133d90 con 0x7fe1d815d1c0 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 monclient(hunting): my global_id is 30777 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1a8003610 con 0x7fe1d815d1c0 2026-02-25T15:19:29.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395610526 0 0) 0x7fe1d8134310 con 0x7fe1d80b8330 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 10 monclient(hunting): my global_id is 27611 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.037+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d8133d90 con 0x7fe1d80b8330 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.038+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028897373 0 0) 0x7fe1d8134030 con 0x7fe1d80b5d10 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.038+0000 7fe1b3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.038+0000 7fe1b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.038+0000 7fe1b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.038+0000 7fe1b3fff640 10 monclient(hunting): my global_id is 30064 2026-02-25T15:19:29.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.038+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d8134310 con 0x7fe1d80b5d10 2026-02-25T15:19:29.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 170103294 0 0) 0x7fe1d8133d90 con 0x7fe1d80b8330 2026-02-25T15:19:29.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1d8134030 con 0x7fe1d80b8330 2026-02-25T15:19:29.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1c8003140 con 0x7fe1d80b8330 2026-02-25T15:19:29.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:29.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): dump: 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:29.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1256330374 0 0) 0x7fe1a8003610 con 0x7fe1d815d1c0 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1d8133d90 con 0x7fe1d815d1c0 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1cc003410 con 0x7fe1d815d1c0 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): dump: 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.058 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1483305414 0 0) 0x7fe1d8134310 con 0x7fe1d80b5d10 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1a8003610 con 0x7fe1d80b5d10 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1c4003310 con 0x7fe1d80b5d10 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.040+0000 7fe1b3fff640 10 monclient(hunting): dump: 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.059 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2783157453 0 0) 0x7fe1d8134030 con 0x7fe1d80b8330 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 >> v1:10.20.193.155:6789/0 conn(0x7fe1d80b5d10 legacy=0x7fe1d81374d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 >> v1:10.20.193.78:6789/0 conn(0x7fe1d815d1c0 legacy=0x7fe1d8124e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 1 monclient: found mon.c 2026-02-25T15:19:29.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d81345f0 con 0x7fe1d80b8330 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1ddabf640 5 monclient: authenticate success, global_id 27611 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1ddabf640 10 monclient: _renew_subs 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1ddabf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.041+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d81348d0 con 0x7fe1d80b8330 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 10 client.27611.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 10 monclient: _renew_subs 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe1d8134e90 con 0x7fe1d80b8330 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 1 librados: init done 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 10 client.27611.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 15 client.27611.objecter _session_command_op_assign -1 1 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 20 client.27611.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 10 client.27611.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.042+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe1d8163210 con 0x7fe1d80b8330 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.050+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1d8163210 con 0x7fe1d80b8330 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.050+0000 7fe1b3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.050+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1c80039b0 con 0x7fe1d80b8330 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.050+0000 7fe1b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.050+0000 7fe1b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:29.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.050+0000 7fe1b3fff640 10 monclient: dump: 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.050+0000 7fe1d5ffb640 4 set_mon_vals no callback set 2026-02-25T15:19:29.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.051+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fe1c8003bc0 con 0x7fe1d80b8330 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.051+0000 7fe1d77fe640 10 monclient: get_auth_request con 0x7fe1a8077eb0 auth_method 0 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.051+0000 7fe1b3fff640 10 client.27611.objecter ms_handle_connect 0x7fe1a8077eb0 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.052+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fe1c80039b0 con 0x7fe1d80b8330 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.052+0000 7fe1b3fff640 10 client.27611.objecter ms_dispatch2 0x7fe1d8000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.052+0000 7fe1b3fff640 3 client.27611.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.052+0000 7fe1b3fff640 3 client.27611.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 10 client.27611.objecter checking command 1 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 20 client.27611.objecter _get_session s=0x7fe1a80a2160 osd=0 3 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 20 client.27611.objecter put_session s=0x7fe1a80a2160 osd=0 3 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 15 client.27611.objecter _session_command_op_remove -1 1 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 20 client.27611.objecter _get_session s=0x7fe1a80a2160 osd=0 3 2026-02-25T15:19:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 20 client.27611.objecter get_session s=0x7fe1a80a2160 osd=0 3 2026-02-25T15:19:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 15 client.27611.objecter _session_command_op_assign 0 1 2026-02-25T15:19:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 20 client.27611.objecter put_session s=0x7fe1a80a2160 osd=0 4 2026-02-25T15:19:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 10 client.27611.objecter _send_command 1 2026-02-25T15:19:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.78:6801/3604255984 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1a80c4470 con 0x7fe1a80a2810 2026-02-25T15:19:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 20 client.27611.objecter dump_active .. 0 homeless 2026-02-25T15:19:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7fe1c8059700 con 0x7fe1d80b8330 2026-02-25T15:19:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1b3fff640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.053+0000 7fe1d7fff640 10 monclient: get_auth_request con 0x7fe1a80a2810 auth_method 0 2026-02-25T15:19:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.054+0000 7fe1b3fff640 10 client.27611.objecter ms_handle_connect 0x7fe1a80a2810 2026-02-25T15:19:29.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.064+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== osd.0 v1:10.20.193.78:6801/3604255984 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe1a80c4470 con 0x7fe1a80a2810 2026-02-25T15:19:29.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.064+0000 7fe1b3fff640 10 client.27611.objecter ms_dispatch2 0x7fe1d8000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:29.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.064+0000 7fe1b3fff640 10 client.27611.objecter _finish_command 1 = system:0 2026-02-25T15:19:29.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.064+0000 7fe1b3fff640 20 client.27611.objecter put_session s=0x7fe1a80a2160 osd=0 4 2026-02-25T15:19:29.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.064+0000 7fe1b3fff640 15 client.27611.objecter _session_command_op_remove 0 1 2026-02-25T15:19:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 10 client.27611.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 15 client.27611.objecter _session_command_op_assign -1 2 2026-02-25T15:19:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 20 client.27611.objecter _get_session s=0x7fe1a80a2160 osd=0 3 2026-02-25T15:19:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 20 client.27611.objecter put_session s=0x7fe1a80a2160 osd=0 3 2026-02-25T15:19:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 20 client.27611.objecter _get_session s=0x7fe1a80a2160 osd=0 3 2026-02-25T15:19:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 15 client.27611.objecter _session_command_op_remove -1 2 2026-02-25T15:19:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 20 client.27611.objecter get_session s=0x7fe1a80a2160 osd=0 3 2026-02-25T15:19:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 15 client.27611.objecter _session_command_op_assign 0 2 2026-02-25T15:19:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 20 client.27611.objecter put_session s=0x7fe1a80a2160 osd=0 4 2026-02-25T15:19:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 10 client.27611.objecter _send_command 2 2026-02-25T15:19:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.071+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 --> v1:10.20.193.78:6801/3604255984 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe1d805ab40 con 0x7fe1a80a2810 2026-02-25T15:19:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.078+0000 7fe1b3fff640 1 -- 10.20.193.78:0/1672710223 <== osd.0 v1:10.20.193.78:6801/3604255984 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe1d805ab40 con 0x7fe1a80a2810 2026-02-25T15:19:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.078+0000 7fe1b3fff640 10 client.27611.objecter ms_dispatch2 0x7fe1d8000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.078+0000 7fe1b3fff640 10 client.27611.objecter _finish_command 2 = system:0 2026-02-25T15:19:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.078+0000 7fe1b3fff640 20 client.27611.objecter put_session s=0x7fe1a80a2160 osd=0 4 2026-02-25T15:19:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.078+0000 7fe1b3fff640 15 client.27611.objecter _session_command_op_remove 0 2 2026-02-25T15:19:29.082 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:29.082 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:29.082 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 10 librados: watch_flush enter 2026-02-25T15:19:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 10 librados: watch_flush exit 2026-02-25T15:19:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 10 client.27611.objecter close_session for osd.0 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 >> v1:10.20.193.78:6801/3604255984 conn(0x7fe1a80a2810 legacy=0x7fe1a80c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 20 client.27611.objecter put_session s=0x7fe1a80a2160 osd=0 1 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 20 client.27611.objecter shutdown clearing up homeless session... 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 10 client.27611.objecter successfully canceled tick 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 >> v1:10.20.193.78:6800/3497602169 conn(0x7fe1a8077eb0 legacy=0x7fe1a8098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 10 monclient: shutdown 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 >> v1:10.20.193.167:6789/0 conn(0x7fe1d80b8330 legacy=0x7fe1d8059180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1d7fff640 1 -- 10.20.193.78:0/1672710223 reap_dead start 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 shutdown_connections 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 >> 10.20.193.78:0/1672710223 conn(0x7fe1d80b5200 msgr2=0x7fe1d80b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 shutdown_connections 2026-02-25T15:19:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 1 -- 10.20.193.78:0/1672710223 wait complete. 2026-02-25T15:19:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.079+0000 7fe1ddabf640 1 librados: shutdown 2026-02-25T15:19:29.089 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-25T15:19:29.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.154+0000 7fbbc5733640 10 monclient: get_monmap_and_config 2026-02-25T15:19:29.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.154+0000 7fbbc5733640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.154+0000 7fbbc5733640 10 monclient: monmap: 2026-02-25T15:19:29.156 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:29.155015+0000 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:29.155015+0000 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.157 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.154+0000 7fbbc5733640 1 Processor -- start 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.154+0000 7fbbc5733640 1 -- start start 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.154+0000 7fbbc5733640 10 monclient: init 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 10 monclient(hunting): picked mon.noname-a con 0x7fbbc0157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 10 monclient(hunting): picked mon.noname-b con 0x7fbbc0157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 10 monclient(hunting): picked mon.noname-c con 0x7fbbc0164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc005de70 con 0x7fbbc0157780 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc0055b20 con 0x7fbbc0157b50 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc0055e00 con 0x7fbbc0164d00 2026-02-25T15:19:29.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbc5733640 10 monclient(hunting): authenticate will time out at 3738.744101s 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbbeffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbbc0157780 0x7fbbc0056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50166/0 (socket says 10.20.193.78:50166) 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.155+0000 7fbbbeffd640 1 -- 10.20.193.78:0/3119509899 learned_addr learned my addr 10.20.193.78:0/3119509899 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207201176 0 0) 0x7fbbc005de70 con 0x7fbbc0157780 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): my global_id is 30780 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbac003610 con 0x7fbbc0157780 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839113758 0 0) 0x7fbbc0055b20 con 0x7fbbc0157b50 2026-02-25T15:19:29.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): my global_id is 30067 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc005de70 con 0x7fbbc0157b50 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349428187 0 0) 0x7fbbc0055e00 con 0x7fbbc0164d00 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 10 monclient(hunting): my global_id is 27614 2026-02-25T15:19:29.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.156+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc0055b20 con 0x7fbbc0164d00 2026-02-25T15:19:29.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3150542796 0 0) 0x7fbbc005de70 con 0x7fbbc0157b50 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 >> v1:10.20.193.167:6789/0 conn(0x7fbbc0164d00 legacy=0x7fbbc01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 >> v1:10.20.193.78:6789/0 conn(0x7fbbc0157780 legacy=0x7fbbc0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 1 monclient: found mon.noname-b 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc00560e0 con 0x7fbbc0157b50 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbba8002df0 con 0x7fbbc0157b50 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbbdffb640 10 monclient: dump: 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.171 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbc5733640 5 monclient: authenticate success, global_id 30067 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.158+0000 7fbbc5733640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbba8002fc0 con 0x7fbbc0157b50 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbbdffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbbdffb640 1 -- 10.20.193.78:0/3119509899 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbba8003400 con 0x7fbbc0157b50 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 4 set_mon_vals no callback set 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbbdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbbdffb640 10 monclient: dump: 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 10 monclient: shutdown 2026-02-25T15:19:29.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 1 -- 10.20.193.78:0/3119509899 >> v1:10.20.193.155:6789/0 conn(0x7fbbc0157b50 legacy=0x7fbbc01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 1 -- 10.20.193.78:0/3119509899 shutdown_connections 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 1 -- 10.20.193.78:0/3119509899 >> 10.20.193.78:0/3119509899 conn(0x7fbbc00b2ef0 msgr2=0x7fbbc00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 1 -- 10.20.193.78:0/3119509899 shutdown_connections 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 1 -- 10.20.193.78:0/3119509899 wait complete. 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.159+0000 7fbbc5733640 10 monclient: monmap: 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:29.174 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 librados: starting msgr at 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 librados: starting objecter 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 Processor -- start 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 -- start start 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 librados: setting wanted keys 2026-02-25T15:19:29.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 librados: calling monclient init 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 10 monclient: init 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 10 monclient(hunting): picked mon.noname-c con 0x7fbbc0157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 10 monclient(hunting): picked mon.noname-a con 0x7fbbc0157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 10 monclient(hunting): picked mon.noname-b con 0x7fbbc0164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc0143f90 con 0x7fbbc0157b50 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc0144200 con 0x7fbbc0164d00 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc01444e0 con 0x7fbbc0157780 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbc5733640 10 monclient(hunting): authenticate will time out at 3738.749630s 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbbe7fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbbc0157b50 0x7fbbc00a0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50174/0 (socket says 10.20.193.78:50174) 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.160+0000 7fbbbe7fc640 1 -- 10.20.193.78:0/123855261 learned_addr learned my addr 10.20.193.78:0/123855261 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.161+0000 7fbb9f7fe640 10 client.?.objecter ms_handle_connect 0x7fbbc0157b50 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.161+0000 7fbb9f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.161+0000 7fbb9f7fe640 10 client.?.objecter ms_handle_connect 0x7fbbc0164d00 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.161+0000 7fbb9f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.161+0000 7fbb9f7fe640 10 client.?.objecter ms_handle_connect 0x7fbbc0157780 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.161+0000 7fbb9f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720103613 0 0) 0x7fbbc0143f90 con 0x7fbbc0157b50 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): my global_id is 30783 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb8c003610 con 0x7fbbc0157b50 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306424574 0 0) 0x7fbbc01444e0 con 0x7fbbc0157780 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): my global_id is 27617 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc0143f90 con 0x7fbbc0157780 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577627936 0 0) 0x7fbbc0144200 con 0x7fbbc0164d00 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 10 monclient(hunting): my global_id is 30070 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.162+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc01444e0 con 0x7fbbc0164d00 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 120607021 0 0) 0x7fbbc0143f90 con 0x7fbbc0157780 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbc0144200 con 0x7fbbc0157780 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbbb40030b0 con 0x7fbbc0157780 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.179 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 461520577 0 0) 0x7fbb8c003610 con 0x7fbbc0157b50 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbc0143f90 con 0x7fbbc0157b50 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbba8003390 con 0x7fbbc0157b50 2026-02-25T15:19:29.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.164+0000 7fbb9f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.165+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2740331860 0 0) 0x7fbbc01444e0 con 0x7fbbc0164d00 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.165+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb8c003610 con 0x7fbbc0164d00 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.165+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbbb0003330 con 0x7fbbc0164d00 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.165+0000 7fbb9f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.165+0000 7fbb9f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.165+0000 7fbb9f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.182 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2423664670 0 0) 0x7fbbc0143f90 con 0x7fbbc0157b50 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 >> v1:10.20.193.167:6789/0 conn(0x7fbbc0157780 legacy=0x7fbbc0156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 >> v1:10.20.193.155:6789/0 conn(0x7fbbc0164d00 legacy=0x7fbbc00af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 1 monclient: found mon.a 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc01447c0 con 0x7fbbc0157b50 2026-02-25T15:19:29.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbb9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 5 monclient: authenticate success, global_id 30783 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 10 monclient: _renew_subs 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc0144aa0 con 0x7fbbc0157b50 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 10 client.30783.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 10 monclient: _renew_subs 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbbc00a0040 con 0x7fbbc0157b50 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.166+0000 7fbbc5733640 1 librados: init done 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.167+0000 7fbbc5733640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.167+0000 7fbbc5733640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.167+0000 7fbbc5733640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:29.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.167+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc0165740 con 0x7fbbc0157b50 2026-02-25T15:19:29.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.174+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbba8002f50 con 0x7fbbc0157b50 2026-02-25T15:19:29.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.174+0000 7fbb9f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.174+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fbba8003b00 con 0x7fbbc0157b50 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.174+0000 7fbb9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.174+0000 7fbb9f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.174+0000 7fbb9f7fe640 10 monclient: dump: 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.187 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.174+0000 7fbbbd7fa640 4 set_mon_vals no callback set 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.175+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fbba8003ce0 con 0x7fbbc0157b50 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.175+0000 7fbbbeffd640 10 monclient: get_auth_request con 0x7fbb8c077ee0 auth_method 0 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.175+0000 7fbb9f7fe640 10 client.30783.objecter ms_handle_connect 0x7fbb8c077ee0 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.176+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fbba80593c0 con 0x7fbbc0157b50 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.176+0000 7fbb9f7fe640 10 client.30783.objecter ms_dispatch2 0x7fbbc0000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.176+0000 7fbb9f7fe640 3 client.30783.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.176+0000 7fbb9f7fe640 3 client.30783.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:29.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.176+0000 7fbb9f7fe640 20 client.30783.objecter dump_active .. 0 homeless 2026-02-25T15:19:29.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.264+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fbbc0165740 con 0x7fbbc0157b50 2026-02-25T15:19:29.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.264+0000 7fbb9f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.264+0000 7fbb9f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:29.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.375+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fbbc005e250 con 0x7fbb8c077ee0 2026-02-25T15:19:29.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.375+0000 7fbb9f7fe640 1 -- 10.20.193.78:0/123855261 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fbbc005e250 con 0x7fbb8c077ee0 2026-02-25T15:19:29.378 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 0 to deep-scrub 2026-02-25T15:19:29.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 10 librados: watch_flush enter 2026-02-25T15:19:29.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 10 librados: watch_flush exit 2026-02-25T15:19:29.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 20 client.30783.objecter shutdown clearing up homeless session... 2026-02-25T15:19:29.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 10 client.30783.objecter successfully canceled tick 2026-02-25T15:19:29.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 >> v1:10.20.193.78:6800/3497602169 conn(0x7fbb8c077ee0 legacy=0x7fbb8c098390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 10 monclient: shutdown 2026-02-25T15:19:29.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 >> v1:10.20.193.78:6789/0 conn(0x7fbbc0157b50 legacy=0x7fbbc00a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 shutdown_connections 2026-02-25T15:19:29.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 >> 10.20.193.78:0/123855261 conn(0x7fbbc00b2ef0 msgr2=0x7fbbc00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 shutdown_connections 2026-02-25T15:19:29.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 1 -- 10.20.193.78:0/123855261 wait complete. 2026-02-25T15:19:29.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.377+0000 7fbbc5733640 1 librados: shutdown 2026-02-25T15:19:29.388 INFO:tasks.ceph:Scrubbing osd.4 2026-02-25T15:19:29.388 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:29.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.455+0000 7f70e1173640 10 monclient: get_monmap_and_config 2026-02-25T15:19:29.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.455+0000 7f70e1173640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.456+0000 7f70e1173640 10 monclient: monmap: 2026-02-25T15:19:29.458 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:29.456921+0000 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:29.456921+0000 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.459 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.456+0000 7f70e1173640 1 Processor -- start 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.456+0000 7f70e1173640 1 -- start start 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.456+0000 7f70e1173640 10 monclient: init 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 10 monclient(hunting): picked mon.noname-b con 0x7f70dc0b9c00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 10 monclient(hunting): picked mon.noname-a con 0x7f70dc167600 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 10 monclient(hunting): picked mon.noname-c con 0x7f70dc0b9fd0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70dc163ad0 con 0x7f70dc167600 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70dc163d90 con 0x7f70dc0b9c00 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70dc164070 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70e1173640 10 monclient(hunting): authenticate will time out at 3739.046314s 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70da575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f70dc167600 0x7f70dc1633c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50178/0 (socket says 10.20.193.78:50178) 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.457+0000 7f70da575640 1 -- 10.20.193.78:0/748868777 learned_addr learned my addr 10.20.193.78:0/748868777 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2561457190 0 0) 0x7f70dc163d90 con 0x7f70dc0b9c00 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): my global_id is 30073 2026-02-25T15:19:29.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c8003610 con 0x7f70dc0b9c00 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 440880179 0 0) 0x7f70dc163ad0 con 0x7f70dc167600 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): my global_id is 30786 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70dc163d90 con 0x7f70dc167600 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778081850 0 0) 0x7f70dc164070 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 10 monclient(hunting): my global_id is 27620 2026-02-25T15:19:29.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.459+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70dc163ad0 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1213543240 0 0) 0x7f70c8003610 con 0x7f70dc0b9c00 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 >> v1:10.20.193.167:6789/0 conn(0x7f70dc0b9fd0 legacy=0x7f70dc058190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 >> v1:10.20.193.78:6789/0 conn(0x7f70dc167600 legacy=0x7f70dc1633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 1 monclient: found mon.noname-b 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70dc0576b0 con 0x7f70dc0b9c00 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70e1173640 5 monclient: authenticate success, global_id 30073 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70e1173640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f70d0002df0 con 0x7f70dc0b9c00 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70d9d74640 10 monclient: dump: 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.471 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.460+0000 7f70e1173640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.461+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70d0003040 con 0x7f70dc0b9c00 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.461+0000 7f70d9d74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.461+0000 7f70d9d74640 1 -- 10.20.193.78:0/748868777 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f70d0003440 con 0x7f70dc0b9c00 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.461+0000 7f70d9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.461+0000 7f70d9d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.461+0000 7f70d9d74640 10 monclient: dump: 2026-02-25T15:19:29.472 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.461+0000 7f70e1173640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.461+0000 7f70e1173640 4 set_mon_vals no callback set 2026-02-25T15:19:29.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 10 monclient: shutdown 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 -- 10.20.193.78:0/748868777 >> v1:10.20.193.155:6789/0 conn(0x7f70dc0b9c00 legacy=0x7f70dc055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 -- 10.20.193.78:0/748868777 shutdown_connections 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 -- 10.20.193.78:0/748868777 >> 10.20.193.78:0/748868777 conn(0x7f70dc0b7500 msgr2=0x7f70dc0b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 -- 10.20.193.78:0/748868777 shutdown_connections 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 -- 10.20.193.78:0/748868777 wait complete. 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 10 monclient: monmap: 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:29.474 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 librados: starting msgr at 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 librados: starting objecter 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 Processor -- start 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 -- start start 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 librados: setting wanted keys 2026-02-25T15:19:29.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 1 librados: calling monclient init 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.462+0000 7f70e1173640 10 monclient: init 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 10 monclient(hunting): picked mon.noname-a con 0x7f70dc0b9c00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 10 monclient(hunting): picked mon.noname-b con 0x7f70dc0b9fd0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 10 monclient(hunting): picked mon.noname-c con 0x7f70dc167600 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70dc15efa0 con 0x7f70dc0b9c00 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70dc15f280 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70dc15f560 con 0x7f70dc167600 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70e1173640 10 monclient(hunting): authenticate will time out at 3739.052198s 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70db577640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f70dc167600 0x7f70dc15dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47708/0 (socket says 10.20.193.78:47708) 2026-02-25T15:19:29.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70da575640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f70dc0b9fd0 0x7f70dc158530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:45984/0 (socket says 10.20.193.78:45984) 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70db577640 1 -- 10.20.193.78:0/33661472 learned_addr learned my addr 10.20.193.78:0/33661472 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70bb7fe640 10 client.?.objecter ms_handle_connect 0x7f70dc0b9fd0 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70bb7fe640 10 client.?.objecter ms_handle_connect 0x7f70dc167600 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.463+0000 7f70bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 client.?.objecter ms_handle_connect 0x7f70dc0b9c00 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834081526 0 0) 0x7f70dc15f280 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 monclient(hunting): my global_id is 30076 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70a8003610 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456462335 0 0) 0x7f70dc15f560 con 0x7f70dc167600 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 10 monclient(hunting): my global_id is 27623 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.464+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70dc15f280 con 0x7f70dc167600 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.465+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913918136 0 0) 0x7f70dc15efa0 con 0x7f70dc0b9c00 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.465+0000 7f70bb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.465+0000 7f70bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.465+0000 7f70bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.465+0000 7f70bb7fe640 10 monclient(hunting): my global_id is 30789 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.465+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70dc15f560 con 0x7f70dc0b9c00 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1818259568 0 0) 0x7f70a8003610 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70dc15efa0 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f70c4002ee0 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.479 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1215335712 0 0) 0x7f70dc15f280 con 0x7f70dc167600 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70a8003610 con 0x7f70dc167600 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f70cc003470 con 0x7f70dc167600 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.467+0000 7f70bb7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.481 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4080697330 0 0) 0x7f70dc15f560 con 0x7f70dc0b9c00 2026-02-25T15:19:29.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70dc15f280 con 0x7f70dc0b9c00 2026-02-25T15:19:29.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f70d0003390 con 0x7f70dc0b9c00 2026-02-25T15:19:29.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.486 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3292028619 0 0) 0x7f70dc15efa0 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 >> v1:10.20.193.167:6789/0 conn(0x7f70dc167600 legacy=0x7f70dc15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 >> v1:10.20.193.78:6789/0 conn(0x7f70dc0b9c00 legacy=0x7f70dc160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 1 monclient: found mon.b 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:29.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70dc15f840 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 5 monclient: authenticate success, global_id 30076 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 10 monclient: _renew_subs 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f70dc15fb20 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 10 client.30076.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:29.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 10 monclient: _renew_subs 2026-02-25T15:19:29.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:29.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f70dc143ac0 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.468+0000 7f70e1173640 1 librados: init done 2026-02-25T15:19:29.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.469+0000 7f70e1173640 10 client.30076.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.469+0000 7f70e1173640 15 client.30076.objecter _session_command_op_assign -1 1 2026-02-25T15:19:29.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.469+0000 7f70e1173640 20 client.30076.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.469+0000 7f70e1173640 10 client.30076.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.469+0000 7f70e1173640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.469+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f70dc15ec90 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.476+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70c4003080 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.476+0000 7f70bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.476+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f70c4004a70 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.476+0000 7f70bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.476+0000 7f70bb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.476+0000 7f70bb7fe640 10 monclient: dump: 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.490 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.476+0000 7f70d9573640 4 set_mon_vals no callback set 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.477+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f70c401d8e0 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.478+0000 7f70dad76640 10 monclient: get_auth_request con 0x7f70a8077ed0 auth_method 0 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.478+0000 7f70bb7fe640 10 client.30076.objecter ms_handle_connect 0x7f70a8077ed0 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f70c4092fc0 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 10 client.30076.objecter ms_dispatch2 0x7f70dc000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 3 client.30076.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 3 client.30076.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 10 client.30076.objecter checking command 1 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 20 client.30076.objecter _get_session s=0x7f70a80a21e0 osd=4 3 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 20 client.30076.objecter put_session s=0x7f70a80a21e0 osd=4 3 2026-02-25T15:19:29.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 15 client.30076.objecter _session_command_op_remove -1 1 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 20 client.30076.objecter _get_session s=0x7f70a80a21e0 osd=4 3 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 20 client.30076.objecter get_session s=0x7f70a80a21e0 osd=4 3 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 15 client.30076.objecter _session_command_op_assign 4 1 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 20 client.30076.objecter put_session s=0x7f70a80a21e0 osd=4 4 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 10 client.30076.objecter _send_command 1 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.78:6805/2928350245 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70a80c44f0 con 0x7f70a80a2890 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 20 client.30076.objecter dump_active .. 0 homeless 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f70c405d0c0 con 0x7f70dc0b9fd0 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.479+0000 7f70bb7fe640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.480+0000 7f70db577640 10 monclient: get_auth_request con 0x7f70a80a2890 auth_method 0 2026-02-25T15:19:29.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.481+0000 7f70bb7fe640 10 client.30076.objecter ms_handle_connect 0x7f70a80a2890 2026-02-25T15:19:29.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.490+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== osd.4 v1:10.20.193.78:6805/2928350245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f70a80c44f0 con 0x7f70a80a2890 2026-02-25T15:19:29.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.490+0000 7f70bb7fe640 10 client.30076.objecter ms_dispatch2 0x7f70dc000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:29.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.490+0000 7f70bb7fe640 10 client.30076.objecter _finish_command 1 = system:0 2026-02-25T15:19:29.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.490+0000 7f70bb7fe640 20 client.30076.objecter put_session s=0x7f70a80a21e0 osd=4 4 2026-02-25T15:19:29.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.490+0000 7f70bb7fe640 15 client.30076.objecter _session_command_op_remove 4 1 2026-02-25T15:19:29.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 10 client.30076.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:29.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 15 client.30076.objecter _session_command_op_assign -1 2 2026-02-25T15:19:29.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 20 client.30076.objecter _get_session s=0x7f70a80a21e0 osd=4 3 2026-02-25T15:19:29.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 20 client.30076.objecter put_session s=0x7f70a80a21e0 osd=4 3 2026-02-25T15:19:29.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 20 client.30076.objecter _get_session s=0x7f70a80a21e0 osd=4 3 2026-02-25T15:19:29.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 15 client.30076.objecter _session_command_op_remove -1 2 2026-02-25T15:19:29.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 20 client.30076.objecter get_session s=0x7f70a80a21e0 osd=4 3 2026-02-25T15:19:29.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 15 client.30076.objecter _session_command_op_assign 4 2 2026-02-25T15:19:29.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 20 client.30076.objecter put_session s=0x7f70a80a21e0 osd=4 4 2026-02-25T15:19:29.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 10 client.30076.objecter _send_command 2 2026-02-25T15:19:29.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.498+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 --> v1:10.20.193.78:6805/2928350245 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f70dc05d6d0 con 0x7f70a80a2890 2026-02-25T15:19:29.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70bb7fe640 1 -- 10.20.193.78:0/33661472 <== osd.4 v1:10.20.193.78:6805/2928350245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f70dc05d6d0 con 0x7f70a80a2890 2026-02-25T15:19:29.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70bb7fe640 10 client.30076.objecter ms_dispatch2 0x7f70dc000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:29.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70bb7fe640 10 client.30076.objecter _finish_command 2 = system:0 2026-02-25T15:19:29.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70bb7fe640 20 client.30076.objecter put_session s=0x7f70a80a21e0 osd=4 4 2026-02-25T15:19:29.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70bb7fe640 15 client.30076.objecter _session_command_op_remove 4 2 2026-02-25T15:19:29.508 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:29.509 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:29.509 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:29.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 10 librados: watch_flush enter 2026-02-25T15:19:29.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 10 librados: watch_flush exit 2026-02-25T15:19:29.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 10 client.30076.objecter close_session for osd.4 2026-02-25T15:19:29.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 >> v1:10.20.193.78:6805/2928350245 conn(0x7f70a80a2890 legacy=0x7f70a80c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 20 client.30076.objecter put_session s=0x7f70a80a21e0 osd=4 1 2026-02-25T15:19:29.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 20 client.30076.objecter shutdown clearing up homeless session... 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 10 client.30076.objecter successfully canceled tick 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 >> v1:10.20.193.78:6800/3497602169 conn(0x7f70a8077ed0 legacy=0x7f70a8098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 10 monclient: shutdown 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 >> v1:10.20.193.155:6789/0 conn(0x7f70dc0b9fd0 legacy=0x7f70dc158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70db577640 1 -- 10.20.193.78:0/33661472 reap_dead start 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 shutdown_connections 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 >> 10.20.193.78:0/33661472 conn(0x7f70dc0b7500 msgr2=0x7f70dc0b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 shutdown_connections 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 1 -- 10.20.193.78:0/33661472 wait complete. 2026-02-25T15:19:29.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.505+0000 7f70e1173640 1 librados: shutdown 2026-02-25T15:19:29.516 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-25T15:19:29.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.581+0000 7f70a8808640 10 monclient: get_monmap_and_config 2026-02-25T15:19:29.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.581+0000 7f70a8808640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.581+0000 7f70a8808640 10 monclient: monmap: 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:29.582175+0000 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:29.582175+0000 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.584 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.585 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.581+0000 7f70a8808640 1 Processor -- start 2026-02-25T15:19:29.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.581+0000 7f70a8808640 1 -- start start 2026-02-25T15:19:29.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.581+0000 7f70a8808640 10 monclient: init 2026-02-25T15:19:29.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 10 monclient(hunting): picked mon.noname-c con 0x7f70a0157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 10 monclient(hunting): picked mon.noname-b con 0x7f70a0157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 10 monclient(hunting): picked mon.noname-a con 0x7f70a0164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a005de70 con 0x7f70a0164d00 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a0055b20 con 0x7f70a0157b50 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a0055e00 con 0x7f70a0157780 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a8808640 10 monclient(hunting): authenticate will time out at 3739.171425s 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a657d640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f70a0157780 0x7f70a0056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47716/0 (socket says 10.20.193.78:47716) 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.582+0000 7f70a657d640 1 -- 10.20.193.78:0/349633349 learned_addr learned my addr 10.20.193.78:0/349633349 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442246106 0 0) 0x7f70a0055b20 con 0x7f70a0157b50 2026-02-25T15:19:29.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): my global_id is 30079 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7090003610 con 0x7f70a0157b50 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240102830 0 0) 0x7f70a0055e00 con 0x7f70a0157780 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): my global_id is 27626 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70a0055b20 con 0x7f70a0157780 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43446225 0 0) 0x7f70a005de70 con 0x7f70a0164d00 2026-02-25T15:19:29.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 10 monclient(hunting): my global_id is 30792 2026-02-25T15:19:29.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.584+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70a0055e00 con 0x7f70a0164d00 2026-02-25T15:19:29.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 72130889 0 0) 0x7f7090003610 con 0x7f70a0157b50 2026-02-25T15:19:29.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 >> v1:10.20.193.167:6789/0 conn(0x7f70a0157780 legacy=0x7f70a0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 >> v1:10.20.193.78:6789/0 conn(0x7f70a0164d00 legacy=0x7f70a01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 1 monclient: found mon.noname-b 2026-02-25T15:19:29.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a00560e0 con 0x7f70a0157b50 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f708c002d20 con 0x7f70a0157b50 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a557b640 10 monclient: dump: 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.599 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a8808640 5 monclient: authenticate success, global_id 30079 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.585+0000 7f70a8808640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f708c002ef0 con 0x7f70a0157b50 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a557b640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a557b640 1 -- 10.20.193.78:0/349633349 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f708c003330 con 0x7f70a0157b50 2026-02-25T15:19:29.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a557b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a557b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a557b640 10 monclient: dump: 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.601 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 4 set_mon_vals no callback set 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 10 monclient: shutdown 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 1 -- 10.20.193.78:0/349633349 >> v1:10.20.193.155:6789/0 conn(0x7f70a0157b50 legacy=0x7f70a01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 1 -- 10.20.193.78:0/349633349 shutdown_connections 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 1 -- 10.20.193.78:0/349633349 >> 10.20.193.78:0/349633349 conn(0x7f70a00b2ef0 msgr2=0x7f70a00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 1 -- 10.20.193.78:0/349633349 shutdown_connections 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.586+0000 7f70a8808640 1 -- 10.20.193.78:0/349633349 wait complete. 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 10 monclient: monmap: 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.602 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 1 librados: starting msgr at 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 1 librados: starting objecter 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:29.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 1 Processor -- start 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 1 -- start start 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 1 librados: setting wanted keys 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 1 librados: calling monclient init 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.587+0000 7f70a8808640 10 monclient: init 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 10 monclient(hunting): picked mon.noname-b con 0x7f70a0157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 10 monclient(hunting): picked mon.noname-c con 0x7f70a0157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 10 monclient(hunting): picked mon.noname-a con 0x7f70a0164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a0149b50 con 0x7f70a0164d00 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a005c780 con 0x7f70a0157780 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a005ca40 con 0x7f70a0157b50 2026-02-25T15:19:29.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a8808640 10 monclient(hunting): authenticate will time out at 3739.177074s 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a657d640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f70a0157780 0x7f70a0149440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46004/0 (socket says 10.20.193.78:46004) 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f70a657d640 1 -- 10.20.193.78:0/3887080390 learned_addr learned my addr 10.20.193.78:0/3887080390 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f708affd640 10 client.?.objecter ms_handle_connect 0x7f70a0157780 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f708affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f708affd640 10 client.?.objecter ms_handle_connect 0x7f70a0164d00 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f708affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f708affd640 10 client.?.objecter ms_handle_connect 0x7f70a0157b50 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.588+0000 7f708affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778981576 0 0) 0x7f70a005c780 con 0x7f70a0157780 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): my global_id is 30082 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7070003610 con 0x7f70a0157780 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722228620 0 0) 0x7f70a0149b50 con 0x7f70a0164d00 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): my global_id is 30795 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70a005c780 con 0x7f70a0164d00 2026-02-25T15:19:29.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041652500 0 0) 0x7f70a005ca40 con 0x7f70a0157b50 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 10 monclient(hunting): my global_id is 27629 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.589+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70a0149b50 con 0x7f70a0157b50 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.591+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 448961323 0 0) 0x7f7070003610 con 0x7f70a0157780 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.591+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70a005ca40 con 0x7f70a0157780 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.591+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7098003170 con 0x7f70a0157780 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.591+0000 7f708affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.591+0000 7f708affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.591+0000 7f708affd640 10 monclient(hunting): dump: 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.607 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.591+0000 7f708affd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 776708259 0 0) 0x7f70a0149b50 con 0x7f70a0157b50 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7070003610 con 0x7f70a0157b50 2026-02-25T15:19:29.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f708c003240 con 0x7f70a0157b50 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 10 monclient(hunting): dump: 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.609 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2294128789 0 0) 0x7f70a005c780 con 0x7f70a0164d00 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70a0149b50 con 0x7f70a0164d00 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7094003250 con 0x7f70a0164d00 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.592+0000 7f708affd640 10 monclient(hunting): dump: 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.610 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2044786683 0 0) 0x7f7070003610 con 0x7f70a0157b50 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 >> v1:10.20.193.155:6789/0 conn(0x7f70a0157780 legacy=0x7f70a0149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 >> v1:10.20.193.78:6789/0 conn(0x7f70a0164d00 legacy=0x7f70a0149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 1 monclient: found mon.c 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a005cd20 con 0x7f70a0157b50 2026-02-25T15:19:29.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f708affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f70a8808640 5 monclient: authenticate success, global_id 27629 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f70a8808640 10 monclient: _renew_subs 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f70a8808640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.593+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f70a005d000 con 0x7f70a0157b50 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 10 client.27629.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 10 monclient: _renew_subs 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f70a014ab90 con 0x7f70a0157b50 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 1 librados: init done 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.594+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a005d240 con 0x7f70a0157b50 2026-02-25T15:19:29.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.684+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f708c002e70 con 0x7f70a0157b50 2026-02-25T15:19:29.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.684+0000 7f708affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.684+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f708c003a30 con 0x7f70a0157b50 2026-02-25T15:19:29.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.684+0000 7f708affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.684+0000 7f708affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:29.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.684+0000 7f708affd640 10 monclient: dump: 2026-02-25T15:19:29.687 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.684+0000 7f70a4d7a640 4 set_mon_vals no callback set 2026-02-25T15:19:29.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.685+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f708c01c8a0 con 0x7f70a0157b50 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.685+0000 7f70a657d640 10 monclient: get_auth_request con 0x7f7070077f40 auth_method 0 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.686+0000 7f708affd640 10 client.27629.objecter ms_handle_connect 0x7f7070077f40 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.686+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f708c091e60 con 0x7f70a0157b50 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.686+0000 7f708affd640 10 client.27629.objecter ms_dispatch2 0x7f70a0000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.686+0000 7f708affd640 3 client.27629.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.686+0000 7f708affd640 3 client.27629.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.686+0000 7f708affd640 20 client.27629.objecter dump_active .. 0 homeless 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.687+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f70a005d240 con 0x7f70a0157b50 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.687+0000 7f708affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.687+0000 7f708affd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:29.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.793+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f70a005e250 con 0x7f7070077f40 2026-02-25T15:19:29.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.793+0000 7f708affd640 1 -- 10.20.193.78:0/3887080390 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f70a005e250 con 0x7f7070077f40 2026-02-25T15:19:29.796 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 4 to deep-scrub 2026-02-25T15:19:29.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 10 librados: watch_flush enter 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 10 librados: watch_flush exit 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 20 client.27629.objecter shutdown clearing up homeless session... 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 10 client.27629.objecter successfully canceled tick 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7070077f40 legacy=0x7f70700983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 10 monclient: shutdown 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 >> v1:10.20.193.167:6789/0 conn(0x7f70a0157b50 legacy=0x7f70a0148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 shutdown_connections 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 >> 10.20.193.78:0/3887080390 conn(0x7f70a00b2ef0 msgr2=0x7f70a00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 shutdown_connections 2026-02-25T15:19:29.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 1 -- 10.20.193.78:0/3887080390 wait complete. 2026-02-25T15:19:29.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.794+0000 7f70a8808640 1 librados: shutdown 2026-02-25T15:19:29.805 INFO:tasks.ceph:Scrubbing osd.8 2026-02-25T15:19:29.805 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:29.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.871+0000 7f5582367640 10 monclient: get_monmap_and_config 2026-02-25T15:19:29.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.871+0000 7f5582367640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.871+0000 7f5582367640 10 monclient: monmap: 2026-02-25T15:19:29.874 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.874 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.874 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:29.872464+0000 2026-02-25T15:19:29.874 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:29.872464+0000 2026-02-25T15:19:29.874 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.874 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.875 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.875 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.875 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.875 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 1 Processor -- start 2026-02-25T15:19:29.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 1 -- start start 2026-02-25T15:19:29.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 10 monclient: init 2026-02-25T15:19:29.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 10 monclient(hunting): picked mon.noname-c con 0x7f557c0b9f80 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 10 monclient(hunting): picked mon.noname-b con 0x7f557c0ba350 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 10 monclient(hunting): picked mon.noname-a con 0x7f557c0585e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557c163930 con 0x7f557c0585e0 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557c163bb0 con 0x7f557c0ba350 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557c163e90 con 0x7f557c0b9f80 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.872+0000 7f5582367640 10 monclient(hunting): authenticate will time out at 3739.461961s 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.873+0000 7f557b7fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f557c0ba350 0x7f557c057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46008/0 (socket says 10.20.193.78:46008) 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.873+0000 7f557b7fe640 1 -- 10.20.193.78:0/2738034688 learned_addr learned my addr 10.20.193.78:0/2738034688 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850558199 0 0) 0x7f557c163bb0 con 0x7f557c0ba350 2026-02-25T15:19:29.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 10 monclient(hunting): my global_id is 30085 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5560003610 con 0x7f557c0ba350 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1539228203 0 0) 0x7f5570002c90 con 0x7f557c0585e0 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 10 monclient(hunting): my global_id is 30798 2026-02-25T15:19:29.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.874+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f557c163bb0 con 0x7f557c0585e0 2026-02-25T15:19:29.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3303183068 0 0) 0x7f557c163e90 con 0x7f557c0b9f80 2026-02-25T15:19:29.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient(hunting): my global_id is 27632 2026-02-25T15:19:29.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5570002c90 con 0x7f557c0b9f80 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3433573561 0 0) 0x7f5560003610 con 0x7f557c0ba350 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 >> v1:10.20.193.167:6789/0 conn(0x7f557c0b9f80 legacy=0x7f557c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 >> v1:10.20.193.78:6789/0 conn(0x7f557c0585e0 legacy=0x7f557c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 1 monclient: found mon.noname-b 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c0573f0 con 0x7f557c0ba350 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f556c002df0 con 0x7f557c0ba350 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f557affd640 10 monclient: dump: 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.886 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f5582367640 5 monclient: authenticate success, global_id 30085 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.876+0000 7f5582367640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f556c002fc0 con 0x7f557c0ba350 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f557affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f557affd640 1 -- 10.20.193.78:0/2738034688 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f556c003400 con 0x7f557c0ba350 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f557affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f557affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f557affd640 10 monclient: dump: 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.887 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 4 set_mon_vals no callback set 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 10 monclient: shutdown 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 1 -- 10.20.193.78:0/2738034688 >> v1:10.20.193.155:6789/0 conn(0x7f557c0ba350 legacy=0x7f557c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 1 -- 10.20.193.78:0/2738034688 shutdown_connections 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 1 -- 10.20.193.78:0/2738034688 >> 10.20.193.78:0/2738034688 conn(0x7f557c0b7990 msgr2=0x7f557c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 1 -- 10.20.193.78:0/2738034688 shutdown_connections 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.877+0000 7f5582367640 1 -- 10.20.193.78:0/2738034688 wait complete. 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 10 monclient: monmap: 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:29.889 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 1 librados: starting msgr at 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 1 librados: starting objecter 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 1 Processor -- start 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 1 -- start start 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 1 librados: setting wanted keys 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 1 librados: calling monclient init 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.878+0000 7f5582367640 10 monclient: init 2026-02-25T15:19:29.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 10 monclient(hunting): picked mon.noname-b con 0x7f557c0585e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 10 monclient(hunting): picked mon.noname-a con 0x7f557c0b9f80 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 10 monclient(hunting): picked mon.noname-c con 0x7f557c0ba350 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557c1fb950 con 0x7f557c0b9f80 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557c160510 con 0x7f557c0585e0 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557c1607f0 con 0x7f557c0ba350 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5582367640 10 monclient(hunting): authenticate will time out at 3739.468228s 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f557b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f557c0b9f80 0x7f557c15daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50222/0 (socket says 10.20.193.78:50222) 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f557b7fe640 1 -- 10.20.193.78:0/731435755 learned_addr learned my addr 10.20.193.78:0/731435755 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5578ff9640 10 client.?.objecter ms_handle_connect 0x7f557c0b9f80 2026-02-25T15:19:29.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5578ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5578ff9640 10 client.?.objecter ms_handle_connect 0x7f557c0585e0 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5578ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5578ff9640 10 client.?.objecter ms_handle_connect 0x7f557c0ba350 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.879+0000 7f5578ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341877898 0 0) 0x7f557c1fb950 con 0x7f557c0b9f80 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): my global_id is 30801 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554c003610 con 0x7f557c0b9f80 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377210596 0 0) 0x7f557c160510 con 0x7f557c0585e0 2026-02-25T15:19:29.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): my global_id is 30088 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f557c1fb950 con 0x7f557c0585e0 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837830240 0 0) 0x7f557c1607f0 con 0x7f557c0ba350 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 10 monclient(hunting): my global_id is 27635 2026-02-25T15:19:29.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.880+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f557c160510 con 0x7f557c0ba350 2026-02-25T15:19:29.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3297297338 0 0) 0x7f557c160510 con 0x7f557c0ba350 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f557c1607f0 con 0x7f557c0ba350 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5570003550 con 0x7f557c0ba350 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.898 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 883364491 0 0) 0x7f554c003610 con 0x7f557c0b9f80 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f557c160510 con 0x7f557c0b9f80 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f556c003310 con 0x7f557c0b9f80 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:29.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3576506696 0 0) 0x7f557c1fb950 con 0x7f557c0585e0 2026-02-25T15:19:29.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f554c003610 con 0x7f557c0585e0 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5568003060 con 0x7f557c0585e0 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.883+0000 7f5578ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.901 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1562096540 0 0) 0x7f557c1607f0 con 0x7f557c0ba350 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 >> v1:10.20.193.155:6789/0 conn(0x7f557c0585e0 legacy=0x7f557c166a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 >> v1:10.20.193.78:6789/0 conn(0x7f557c0b9f80 legacy=0x7f557c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 1 monclient: found mon.c 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c160ad0 con 0x7f557c0ba350 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 10 monclient: _finish_auth 0 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:19:29.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5578ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 5 monclient: authenticate success, global_id 27635 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 10 monclient: _renew_subs 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f557c1646d0 con 0x7f557c0ba350 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 10 client.27635.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 10 monclient: _renew_subs 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f557c160080 con 0x7f557c0ba350 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.884+0000 7f5582367640 1 librados: init done 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.885+0000 7f5582367640 10 client.27635.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.885+0000 7f5582367640 15 client.27635.objecter _session_command_op_assign -1 1 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.885+0000 7f5582367640 20 client.27635.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.885+0000 7f5582367640 10 client.27635.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:29.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.885+0000 7f5582367640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.885+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f557c0b64c0 con 0x7f557c0ba350 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.889+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f557c0b64c0 con 0x7f557c0ba350 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.889+0000 7f5578ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.889+0000 7f557a7fc640 4 set_mon_vals no callback set 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.892+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5570003b80 con 0x7f557c0ba350 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.892+0000 7f5578ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.892+0000 7f5578ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.892+0000 7f5578ff9640 10 monclient: dump: 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.904 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.893+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f5570003da0 con 0x7f557c0ba350 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f557bfff640 10 monclient: get_auth_request con 0x7f554c077e20 auth_method 0 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 10 client.27635.objecter ms_handle_connect 0x7f554c077e20 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f55700922f0 con 0x7f557c0ba350 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 10 client.27635.objecter ms_dispatch2 0x7f557c000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:29.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 3 client.27635.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 3 client.27635.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 10 client.27635.objecter checking command 1 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 20 client.27635.objecter _get_session s=0x7f554c0a20d0 osd=8 3 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 20 client.27635.objecter put_session s=0x7f554c0a20d0 osd=8 3 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 15 client.27635.objecter _session_command_op_remove -1 1 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 20 client.27635.objecter _get_session s=0x7f554c0a20d0 osd=8 3 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 20 client.27635.objecter get_session s=0x7f554c0a20d0 osd=8 3 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 15 client.27635.objecter _session_command_op_assign 8 1 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 20 client.27635.objecter put_session s=0x7f554c0a20d0 osd=8 4 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 10 client.27635.objecter _send_command 1 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.78:6810/1740746686 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f554c0c4480 con 0x7f554c0a2780 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.894+0000 7f5578ff9640 20 client.27635.objecter dump_active .. 0 homeless 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.895+0000 7f557b7fe640 10 monclient: get_auth_request con 0x7f554c0a2780 auth_method 0 2026-02-25T15:19:29.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.895+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f557005c3f0 con 0x7f557c0ba350 2026-02-25T15:19:29.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.895+0000 7f5578ff9640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:29.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.896+0000 7f5578ff9640 10 client.27635.objecter ms_handle_connect 0x7f554c0a2780 2026-02-25T15:19:29.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.905+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== osd.8 v1:10.20.193.78:6810/1740746686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f554c0c4480 con 0x7f554c0a2780 2026-02-25T15:19:29.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.905+0000 7f5578ff9640 10 client.27635.objecter ms_dispatch2 0x7f557c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:29.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.905+0000 7f5578ff9640 10 client.27635.objecter _finish_command 1 = system:0 2026-02-25T15:19:29.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.905+0000 7f5578ff9640 20 client.27635.objecter put_session s=0x7f554c0a20d0 osd=8 4 2026-02-25T15:19:29.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.905+0000 7f5578ff9640 15 client.27635.objecter _session_command_op_remove 8 1 2026-02-25T15:19:29.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 10 client.27635.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:29.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 15 client.27635.objecter _session_command_op_assign -1 2 2026-02-25T15:19:29.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 20 client.27635.objecter _get_session s=0x7f554c0a20d0 osd=8 3 2026-02-25T15:19:29.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 20 client.27635.objecter put_session s=0x7f554c0a20d0 osd=8 3 2026-02-25T15:19:29.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 20 client.27635.objecter _get_session s=0x7f554c0a20d0 osd=8 3 2026-02-25T15:19:29.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 15 client.27635.objecter _session_command_op_remove -1 2 2026-02-25T15:19:29.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 20 client.27635.objecter get_session s=0x7f554c0a20d0 osd=8 3 2026-02-25T15:19:29.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 15 client.27635.objecter _session_command_op_assign 8 2 2026-02-25T15:19:29.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 20 client.27635.objecter put_session s=0x7f554c0a20d0 osd=8 4 2026-02-25T15:19:29.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 10 client.27635.objecter _send_command 2 2026-02-25T15:19:29.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.912+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 --> v1:10.20.193.78:6810/1740746686 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f557c0b9630 con 0x7f554c0a2780 2026-02-25T15:19:29.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5578ff9640 1 -- 10.20.193.78:0/731435755 <== osd.8 v1:10.20.193.78:6810/1740746686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f557c0b9630 con 0x7f554c0a2780 2026-02-25T15:19:29.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5578ff9640 10 client.27635.objecter ms_dispatch2 0x7f557c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:29.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5578ff9640 10 client.27635.objecter _finish_command 2 = system:0 2026-02-25T15:19:29.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5578ff9640 20 client.27635.objecter put_session s=0x7f554c0a20d0 osd=8 4 2026-02-25T15:19:29.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5578ff9640 15 client.27635.objecter _session_command_op_remove 8 2 2026-02-25T15:19:29.923 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:29.923 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:29.923 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:29.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 10 librados: watch_flush enter 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 10 librados: watch_flush exit 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 10 client.27635.objecter close_session for osd.8 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 >> v1:10.20.193.78:6810/1740746686 conn(0x7f554c0a2780 legacy=0x7f554c0c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 20 client.27635.objecter put_session s=0x7f554c0a20d0 osd=8 1 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 20 client.27635.objecter shutdown clearing up homeless session... 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 10 client.27635.objecter successfully canceled tick 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 >> v1:10.20.193.78:6800/3497602169 conn(0x7f554c077e20 legacy=0x7f554c0982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 10 monclient: shutdown 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 >> v1:10.20.193.167:6789/0 conn(0x7f557c0ba350 legacy=0x7f557c1fb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:29.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f55808dd640 1 -- 10.20.193.78:0/731435755 reap_dead start 2026-02-25T15:19:29.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 shutdown_connections 2026-02-25T15:19:29.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 >> 10.20.193.78:0/731435755 conn(0x7f557c0b7990 msgr2=0x7f557c159700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:29.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 shutdown_connections 2026-02-25T15:19:29.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 1 -- 10.20.193.78:0/731435755 wait complete. 2026-02-25T15:19:29.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.920+0000 7f5582367640 1 librados: shutdown 2026-02-25T15:19:29.930 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-25T15:19:29.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.996+0000 7f56b4f44640 10 monclient: get_monmap_and_config 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.996+0000 7f56b4f44640 10 monclient: build_initial_monmap 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.996+0000 7f56b4f44640 10 monclient: monmap: 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:29.997341+0000 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:29.997341+0000 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:29.999 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.000 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.000 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.000 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.996+0000 7f56b4f44640 1 Processor -- start 2026-02-25T15:19:30.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.996+0000 7f56b4f44640 1 -- start start 2026-02-25T15:19:30.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.996+0000 7f56b4f44640 10 monclient: init 2026-02-25T15:19:30.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 10 monclient(hunting): picked mon.noname-b con 0x7f56b0157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 10 monclient(hunting): picked mon.noname-a con 0x7f56b0157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 10 monclient(hunting): picked mon.noname-c con 0x7f56b0164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b005de70 con 0x7f56b0157b50 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b0055b20 con 0x7f56b0157780 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b0055e00 con 0x7f56b0164d00 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56b4f44640 10 monclient(hunting): authenticate will time out at 3739.586492s 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56aed76640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f56b0164d00 0x7f56b01c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47764/0 (socket says 10.20.193.78:47764) 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.997+0000 7f56aed76640 1 -- 10.20.193.78:0/4061110860 learned_addr learned my addr 10.20.193.78:0/4061110860 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906433320 0 0) 0x7f56b0055b20 con 0x7f56b0157780 2026-02-25T15:19:30.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): my global_id is 30091 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f569c003610 con 0x7f56b0157780 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1457731735 0 0) 0x7f56b0055e00 con 0x7f56b0164d00 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): my global_id is 27638 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b0055b20 con 0x7f56b0164d00 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3030435012 0 0) 0x7f56b005de70 con 0x7f56b0157b50 2026-02-25T15:19:30.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 10 monclient(hunting): my global_id is 30804 2026-02-25T15:19:30.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:29.999+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b0055e00 con 0x7f56b0157b50 2026-02-25T15:19:30.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1751497042 0 0) 0x7f56b0055b20 con 0x7f56b0164d00 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 >> v1:10.20.193.155:6789/0 conn(0x7f56b0157780 legacy=0x7f56b0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 >> v1:10.20.193.78:6789/0 conn(0x7f56b0157b50 legacy=0x7f56b01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 1 monclient: found mon.noname-c 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b00560e0 con 0x7f56b0164d00 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56a0003170 con 0x7f56b0164d00 2026-02-25T15:19:30.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56b4f44640 5 monclient: authenticate success, global_id 27638 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56b4f44640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56ad573640 10 monclient: dump: 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.013 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.000+0000 7f56b4f44640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56a0003340 con 0x7f56b0164d00 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56ad573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56ad573640 1 -- 10.20.193.78:0/4061110860 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56a0003780 con 0x7f56b0164d00 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56ad573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56ad573640 10 monclient: dump: 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.014 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56b4f44640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56b4f44640 4 set_mon_vals no callback set 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56b4f44640 10 monclient: shutdown 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56b4f44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.001+0000 7f56b4f44640 1 -- 10.20.193.78:0/4061110860 >> v1:10.20.193.167:6789/0 conn(0x7f56b0164d00 legacy=0x7f56b01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 -- 10.20.193.78:0/4061110860 shutdown_connections 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 -- 10.20.193.78:0/4061110860 >> 10.20.193.78:0/4061110860 conn(0x7f56b00b2ef0 msgr2=0x7f56b00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 -- 10.20.193.78:0/4061110860 shutdown_connections 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 -- 10.20.193.78:0/4061110860 wait complete. 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 10 monclient: monmap: 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:30.016 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 librados: starting msgr at 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 librados: starting objecter 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 Processor -- start 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 -- start start 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 librados: setting wanted keys 2026-02-25T15:19:30.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 1 librados: calling monclient init 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.002+0000 7f56b4f44640 10 monclient: init 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 10 monclient(hunting): picked mon.noname-c con 0x7f56b0157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 10 monclient(hunting): picked mon.noname-a con 0x7f56b0157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 10 monclient(hunting): picked mon.noname-b con 0x7f56b0164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b0144820 con 0x7f56b0157b50 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b0133ad0 con 0x7f56b0164d00 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b0133db0 con 0x7f56b0157780 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56b4f44640 10 monclient(hunting): authenticate will time out at 3739.592221s 2026-02-25T15:19:30.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56ae575640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f56b0157780 0x7f56b00ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47778/0 (socket says 10.20.193.78:47778) 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f56ae575640 1 -- 10.20.193.78:0/609875181 learned_addr learned my addr 10.20.193.78:0/609875181 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f5696ffd640 10 client.?.objecter ms_handle_connect 0x7f56b0157b50 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f5696ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f5696ffd640 10 client.?.objecter ms_handle_connect 0x7f56b0157780 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.003+0000 7f5696ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 client.?.objecter ms_handle_connect 0x7f56b0164d00 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299770775 0 0) 0x7f56b0144820 con 0x7f56b0157b50 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 monclient(hunting): my global_id is 30807 2026-02-25T15:19:30.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f567c003610 con 0x7f56b0157b50 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964988606 0 0) 0x7f56b0133db0 con 0x7f56b0157780 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 10 monclient(hunting): my global_id is 27641 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.004+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b0144820 con 0x7f56b0157780 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.005+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569025674 0 0) 0x7f56b0133ad0 con 0x7f56b0164d00 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.005+0000 7f5696ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.005+0000 7f5696ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.005+0000 7f5696ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.005+0000 7f5696ffd640 10 monclient(hunting): my global_id is 30094 2026-02-25T15:19:30.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.005+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b0133db0 con 0x7f56b0164d00 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1600411098 0 0) 0x7f56b0144820 con 0x7f56b0157780 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56b0133ad0 con 0x7f56b0157780 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56a40030f0 con 0x7f56b0157780 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.021 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1222609366 0 0) 0x7f567c003610 con 0x7f56b0157b50 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56b0144820 con 0x7f56b0157b50 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5698002fe0 con 0x7f56b0157b50 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.022 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 297664848 0 0) 0x7f56b0133db0 con 0x7f56b0164d00 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f567c003610 con 0x7f56b0164d00 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56a0003690 con 0x7f56b0164d00 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.007+0000 7f5696ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 595375220 0 0) 0x7f56b0133ad0 con 0x7f56b0157780 2026-02-25T15:19:30.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 >> v1:10.20.193.155:6789/0 conn(0x7f56b0164d00 legacy=0x7f56b0143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 >> v1:10.20.193.78:6789/0 conn(0x7f56b0157b50 legacy=0x7f56b00577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 1 monclient: found mon.c 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b0134090 con 0x7f56b0157780 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f5696ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 5 monclient: authenticate success, global_id 27641 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 10 monclient: _renew_subs 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56b0134370 con 0x7f56b0157780 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 10 client.27641.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 10 monclient: _renew_subs 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56b0147060 con 0x7f56b0157780 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.008+0000 7f56b4f44640 1 librados: init done 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.009+0000 7f56b4f44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.009+0000 7f56b4f44640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.009+0000 7f56b4f44640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.009+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b00b4620 con 0x7f56b0157780 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.014+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56a40034a0 con 0x7f56b0157780 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.014+0000 7f5696ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.014+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56a4003b50 con 0x7f56b0157780 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.014+0000 7f5696ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.014+0000 7f5696ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.014+0000 7f5696ffd640 10 monclient: dump: 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.028 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.014+0000 7f56acd72640 4 set_mon_vals no callback set 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.017+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f56a4003b50 con 0x7f56b0157780 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.017+0000 7f56add74640 10 monclient: get_auth_request con 0x7f567c077dd0 auth_method 0 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.017+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f56a40931c0 con 0x7f56b0157780 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.017+0000 7f5696ffd640 10 client.27641.objecter ms_dispatch2 0x7f56b0000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.017+0000 7f5696ffd640 3 client.27641.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.017+0000 7f5696ffd640 3 client.27641.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.018+0000 7f5696ffd640 20 client.27641.objecter dump_active .. 0 homeless 2026-02-25T15:19:30.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.018+0000 7f5696ffd640 10 client.27641.objecter ms_handle_connect 0x7f567c077dd0 2026-02-25T15:19:30.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.104+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f56a405dbf0 con 0x7f56b0157780 2026-02-25T15:19:30.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.104+0000 7f5696ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.104+0000 7f5696ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:30.210 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.208+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f56b01385b0 con 0x7f567c077dd0 2026-02-25T15:19:30.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.208+0000 7f5696ffd640 1 -- 10.20.193.78:0/609875181 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (unknown 1222854447 0 0) 0x7f56b01385b0 con 0x7f567c077dd0 2026-02-25T15:19:30.211 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 8 to deep-scrub 2026-02-25T15:19:30.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 10 librados: watch_flush enter 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 10 librados: watch_flush exit 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 20 client.27641.objecter shutdown clearing up homeless session... 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 10 client.27641.objecter successfully canceled tick 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 >> v1:10.20.193.78:6800/3497602169 conn(0x7f567c077dd0 legacy=0x7f567c098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 10 monclient: shutdown 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 >> v1:10.20.193.167:6789/0 conn(0x7f56b0157780 legacy=0x7f56b00ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 shutdown_connections 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 >> 10.20.193.78:0/609875181 conn(0x7f56b00b2ef0 msgr2=0x7f56b00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 shutdown_connections 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 1 -- 10.20.193.78:0/609875181 wait complete. 2026-02-25T15:19:30.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.209+0000 7f56b4f44640 1 librados: shutdown 2026-02-25T15:19:30.220 INFO:tasks.ceph:Scrubbing osd.12 2026-02-25T15:19:30.220 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:30.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.287+0000 7f12afbe0640 10 monclient: get_monmap_and_config 2026-02-25T15:19:30.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.287+0000 7f12afbe0640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.287+0000 7f12afbe0640 10 monclient: monmap: 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:30.288252+0000 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:30.288252+0000 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.290 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.291 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.287+0000 7f12afbe0640 1 Processor -- start 2026-02-25T15:19:30.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.287+0000 7f12afbe0640 1 -- start start 2026-02-25T15:19:30.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.287+0000 7f12afbe0640 10 monclient: init 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 10 monclient(hunting): picked mon.noname-a con 0x7f12a80b9c00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 10 monclient(hunting): picked mon.noname-c con 0x7f12a8167600 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 10 monclient(hunting): picked mon.noname-b con 0x7f12a80b9fd0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a8163ad0 con 0x7f12a80b9c00 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a8163d90 con 0x7f12a80b9fd0 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a8164070 con 0x7f12a8167600 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12afbe0640 10 monclient(hunting): authenticate will time out at 3739.877572s 2026-02-25T15:19:30.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12ad154640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f12a8167600 0x7f12a81633c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47784/0 (socket says 10.20.193.78:47784) 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.288+0000 7f12ad154640 1 -- 10.20.193.78:0/4183919907 learned_addr learned my addr 10.20.193.78:0/4183919907 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814587868 0 0) 0x7f12a8164070 con 0x7f12a8167600 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): my global_id is 27644 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1290003610 con 0x7f12a8167600 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050276595 0 0) 0x7f12a8163d90 con 0x7f12a80b9fd0 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): my global_id is 30097 2026-02-25T15:19:30.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a8164070 con 0x7f12a80b9fd0 2026-02-25T15:19:30.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115828895 0 0) 0x7f12a8163ad0 con 0x7f12a80b9c00 2026-02-25T15:19:30.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 10 monclient(hunting): my global_id is 30810 2026-02-25T15:19:30.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.290+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a8163d90 con 0x7f12a80b9c00 2026-02-25T15:19:30.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4051301451 0 0) 0x7f1290003610 con 0x7f12a8167600 2026-02-25T15:19:30.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 >> v1:10.20.193.155:6789/0 conn(0x7f12a80b9fd0 legacy=0x7f12a8058190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 >> v1:10.20.193.78:6789/0 conn(0x7f12a80b9c00 legacy=0x7f12a8055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 1 monclient: found mon.noname-c 2026-02-25T15:19:30.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a80576b0 con 0x7f12a8167600 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f129c002df0 con 0x7f12a8167600 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12ac953640 10 monclient: dump: 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.305 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12afbe0640 5 monclient: authenticate success, global_id 27644 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.291+0000 7f12afbe0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.292+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f129c002fc0 con 0x7f12a8167600 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.292+0000 7f12ac953640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.292+0000 7f12ac953640 1 -- 10.20.193.78:0/4183919907 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f129c003400 con 0x7f12a8167600 2026-02-25T15:19:30.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.292+0000 7f12ac953640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.292+0000 7f12ac953640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.292+0000 7f12ac953640 10 monclient: dump: 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.307 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.292+0000 7f12afbe0640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.292+0000 7f12afbe0640 4 set_mon_vals no callback set 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 10 monclient: shutdown 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 1 -- 10.20.193.78:0/4183919907 >> v1:10.20.193.167:6789/0 conn(0x7f12a8167600 legacy=0x7f12a81633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 1 -- 10.20.193.78:0/4183919907 shutdown_connections 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 1 -- 10.20.193.78:0/4183919907 >> 10.20.193.78:0/4183919907 conn(0x7f12a80b7500 msgr2=0x7f12a80b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 1 -- 10.20.193.78:0/4183919907 shutdown_connections 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 1 -- 10.20.193.78:0/4183919907 wait complete. 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 10 monclient: monmap: 2026-02-25T15:19:30.308 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 1 librados: starting msgr at 2026-02-25T15:19:30.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 1 librados: starting objecter 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.293+0000 7f12afbe0640 1 Processor -- start 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 1 -- start start 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 1 librados: setting wanted keys 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 1 librados: calling monclient init 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 10 monclient: init 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 10 monclient(hunting): picked mon.noname-a con 0x7f12a80b9c00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 10 monclient(hunting): picked mon.noname-c con 0x7f12a80b9fd0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 10 monclient(hunting): picked mon.noname-b con 0x7f12a8167600 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a80b2fc0 con 0x7f12a80b9c00 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a80b49e0 con 0x7f12a8167600 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a81605c0 con 0x7f12a80b9fd0 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12afbe0640 10 monclient(hunting): authenticate will time out at 3739.883568s 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12ad955640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f12a80b9c00 0x7f12a80b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50250/0 (socket says 10.20.193.78:50250) 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.294+0000 7f12ad955640 1 -- 10.20.193.78:0/70584832 learned_addr learned my addr 10.20.193.78:0/70584832 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.295+0000 7f12967fc640 10 client.?.objecter ms_handle_connect 0x7f12a80b9c00 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.295+0000 7f12967fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.295+0000 7f12967fc640 10 client.?.objecter ms_handle_connect 0x7f12a8167600 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.295+0000 7f12967fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.295+0000 7f12967fc640 10 client.?.objecter ms_handle_connect 0x7f12a80b9fd0 2026-02-25T15:19:30.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.295+0000 7f12967fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.295+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752611914 0 0) 0x7f12a80b2fc0 con 0x7f12a80b9c00 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): my global_id is 30813 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1278003610 con 0x7f12a80b9c00 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591039287 0 0) 0x7f12a81605c0 con 0x7f12a80b9fd0 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): my global_id is 27647 2026-02-25T15:19:30.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a80b2fc0 con 0x7f12a80b9fd0 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272589955 0 0) 0x7f12a80b49e0 con 0x7f12a8167600 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 10 monclient(hunting): my global_id is 30100 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.296+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a81605c0 con 0x7f12a8167600 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1453071475 0 0) 0x7f1278003610 con 0x7f12a80b9c00 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12a80b49e0 con 0x7f12a80b9c00 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1298003170 con 0x7f12a80b9c00 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:30.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): dump: 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:30.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1183714452 0 0) 0x7f12a81605c0 con 0x7f12a8167600 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1278003610 con 0x7f12a8167600 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f12a4003430 con 0x7f12a8167600 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): dump: 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.315 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2572521054 0 0) 0x7f12a80b2fc0 con 0x7f12a80b9fd0 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12a81605c0 con 0x7f12a80b9fd0 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f129c003310 con 0x7f12a80b9fd0 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.298+0000 7f12967fc640 10 monclient(hunting): dump: 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.316 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1171214694 0 0) 0x7f12a81605c0 con 0x7f12a80b9fd0 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 >> v1:10.20.193.155:6789/0 conn(0x7f12a8167600 legacy=0x7f12a80b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 >> v1:10.20.193.78:6789/0 conn(0x7f12a80b9c00 legacy=0x7f12a80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 1 monclient: found mon.c 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a80b3230 con 0x7f12a80b9fd0 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 5 monclient: authenticate success, global_id 27647 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 10 monclient: _renew_subs 2026-02-25T15:19:30.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f12a80b3510 con 0x7f12a80b9fd0 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 10 client.27647.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 10 monclient: _renew_subs 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f12a80b3db0 con 0x7f12a80b9fd0 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 1 librados: init done 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 10 client.27647.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 15 client.27647.objecter _session_command_op_assign -1 1 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 20 client.27647.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 10 client.27647.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.300+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f12a80b6020 con 0x7f12a80b9fd0 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.308+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12a80b6020 con 0x7f12a80b9fd0 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.308+0000 7f12967fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.308+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f129c002880 con 0x7f12a80b9fd0 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.308+0000 7f12967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.308+0000 7f12967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.308+0000 7f12967fc640 10 monclient: dump: 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.322 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.308+0000 7f1297fff640 4 set_mon_vals no callback set 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.308+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f129c01d850 con 0x7f12a80b9fd0 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12ad955640 10 monclient: get_auth_request con 0x7f1278077f60 auth_method 0 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 10 client.27647.objecter ms_handle_connect 0x7f1278077f60 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f129c092d50 con 0x7f12a80b9fd0 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 10 client.27647.objecter ms_dispatch2 0x7f12a8000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:30.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 3 client.27647.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 3 client.27647.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 10 client.27647.objecter checking command 1 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 20 client.27647.objecter _get_session s=0x7f12780a2210 osd=12 3 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 20 client.27647.objecter put_session s=0x7f12780a2210 osd=12 3 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 15 client.27647.objecter _session_command_op_remove -1 1 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 20 client.27647.objecter _get_session s=0x7f12780a2210 osd=12 3 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 20 client.27647.objecter get_session s=0x7f12780a2210 osd=12 3 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 15 client.27647.objecter _session_command_op_assign 12 1 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 20 client.27647.objecter put_session s=0x7f12780a2210 osd=12 4 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 10 client.27647.objecter _send_command 1 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.78:6809/3800864779 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12780c4520 con 0x7f12780a28c0 2026-02-25T15:19:30.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.309+0000 7f12967fc640 20 client.27647.objecter dump_active .. 0 homeless 2026-02-25T15:19:30.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.310+0000 7f12ae156640 10 monclient: get_auth_request con 0x7f12780a28c0 auth_method 0 2026-02-25T15:19:30.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.310+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f129c0593f0 con 0x7f12a80b9fd0 2026-02-25T15:19:30.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.310+0000 7f12967fc640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:30.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.311+0000 7f12967fc640 10 client.27647.objecter ms_handle_connect 0x7f12780a28c0 2026-02-25T15:19:30.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.320+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== osd.12 v1:10.20.193.78:6809/3800864779 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f12780c4520 con 0x7f12780a28c0 2026-02-25T15:19:30.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.320+0000 7f12967fc640 10 client.27647.objecter ms_dispatch2 0x7f12a8000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:30.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.320+0000 7f12967fc640 10 client.27647.objecter _finish_command 1 = system:0 2026-02-25T15:19:30.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.320+0000 7f12967fc640 20 client.27647.objecter put_session s=0x7f12780a2210 osd=12 4 2026-02-25T15:19:30.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.320+0000 7f12967fc640 15 client.27647.objecter _session_command_op_remove 12 1 2026-02-25T15:19:30.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 10 client.27647.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:30.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 15 client.27647.objecter _session_command_op_assign -1 2 2026-02-25T15:19:30.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 20 client.27647.objecter _get_session s=0x7f12780a2210 osd=12 3 2026-02-25T15:19:30.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 20 client.27647.objecter put_session s=0x7f12780a2210 osd=12 3 2026-02-25T15:19:30.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 20 client.27647.objecter _get_session s=0x7f12780a2210 osd=12 3 2026-02-25T15:19:30.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 15 client.27647.objecter _session_command_op_remove -1 2 2026-02-25T15:19:30.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 20 client.27647.objecter get_session s=0x7f12780a2210 osd=12 3 2026-02-25T15:19:30.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 15 client.27647.objecter _session_command_op_assign 12 2 2026-02-25T15:19:30.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 20 client.27647.objecter put_session s=0x7f12780a2210 osd=12 4 2026-02-25T15:19:30.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 10 client.27647.objecter _send_command 2 2026-02-25T15:19:30.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.327+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 --> v1:10.20.193.78:6809/3800864779 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f12a80b5d40 con 0x7f12780a28c0 2026-02-25T15:19:30.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12967fc640 1 -- 10.20.193.78:0/70584832 <== osd.12 v1:10.20.193.78:6809/3800864779 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f12a80b5d40 con 0x7f12780a28c0 2026-02-25T15:19:30.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12967fc640 10 client.27647.objecter ms_dispatch2 0x7f12a8000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12967fc640 10 client.27647.objecter _finish_command 2 = system:0 2026-02-25T15:19:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12967fc640 20 client.27647.objecter put_session s=0x7f12780a2210 osd=12 4 2026-02-25T15:19:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12967fc640 15 client.27647.objecter _session_command_op_remove 12 2 2026-02-25T15:19:30.339 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:30.339 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:30.339 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 10 librados: watch_flush enter 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 10 librados: watch_flush exit 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 10 client.27647.objecter close_session for osd.12 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 >> v1:10.20.193.78:6809/3800864779 conn(0x7f12780a28c0 legacy=0x7f12780c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 20 client.27647.objecter put_session s=0x7f12780a2210 osd=12 1 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 20 client.27647.objecter shutdown clearing up homeless session... 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 10 client.27647.objecter successfully canceled tick 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 >> v1:10.20.193.78:6800/3497602169 conn(0x7f1278077f60 legacy=0x7f1278098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 10 monclient: shutdown 2026-02-25T15:19:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 >> v1:10.20.193.167:6789/0 conn(0x7f12a80b9fd0 legacy=0x7f12a815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12ae156640 1 -- 10.20.193.78:0/70584832 reap_dead start 2026-02-25T15:19:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 shutdown_connections 2026-02-25T15:19:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 >> 10.20.193.78:0/70584832 conn(0x7f12a80b7500 msgr2=0x7f12a8158030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 shutdown_connections 2026-02-25T15:19:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 1 -- 10.20.193.78:0/70584832 wait complete. 2026-02-25T15:19:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.336+0000 7f12afbe0640 1 librados: shutdown 2026-02-25T15:19:30.347 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-25T15:19:30.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.413+0000 7f4ff089c640 10 monclient: get_monmap_and_config 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.413+0000 7f4ff089c640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.413+0000 7f4ff089c640 10 monclient: monmap: 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:30.414372+0000 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:30.414372+0000 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.416 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.417 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.417 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.417 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.413+0000 7f4ff089c640 1 Processor -- start 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 1 -- start start 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 10 monclient: init 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 10 monclient(hunting): picked mon.noname-a con 0x7f4fe8157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fe8157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 10 monclient(hunting): picked mon.noname-b con 0x7f4fe8164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe805de70 con 0x7f4fe8157780 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe8055b20 con 0x7f4fe8164d00 2026-02-25T15:19:30.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe8055e00 con 0x7f4fe8157b50 2026-02-25T15:19:30.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.414+0000 7f4ff089c640 10 monclient(hunting): authenticate will time out at 3740.003554s 2026-02-25T15:19:30.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.415+0000 7f4feee12640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f4fe8164d00 0x7f4fe81c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46040/0 (socket says 10.20.193.78:46040) 2026-02-25T15:19:30.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.415+0000 7f4feee12640 1 -- 10.20.193.78:0/621975964 learned_addr learned my addr 10.20.193.78:0/621975964 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.417+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201373497 0 0) 0x7f4fe8055b20 con 0x7f4fe8164d00 2026-02-25T15:19:30.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.417+0000 7f4fed60f640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.417+0000 7f4fed60f640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.417+0000 7f4fed60f640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.417+0000 7f4fed60f640 10 monclient(hunting): my global_id is 30103 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.417+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd8003610 con 0x7f4fe8164d00 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383023203 0 0) 0x7f4fe8055e00 con 0x7f4fe8157b50 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 10 monclient(hunting): my global_id is 27650 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe8055b20 con 0x7f4fe8157b50 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220776912 0 0) 0x7f4fe805de70 con 0x7f4fe8157780 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 10 monclient(hunting): my global_id is 30816 2026-02-25T15:19:30.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.418+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe8055e00 con 0x7f4fe8157780 2026-02-25T15:19:30.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1680224286 0 0) 0x7f4fe8055b20 con 0x7f4fe8157b50 2026-02-25T15:19:30.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 >> v1:10.20.193.155:6789/0 conn(0x7f4fe8164d00 legacy=0x7f4fe81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 >> v1:10.20.193.78:6789/0 conn(0x7f4fe8157780 legacy=0x7f4fe8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 1 monclient: found mon.noname-c 2026-02-25T15:19:30.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe80560e0 con 0x7f4fe8157b50 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4ff089c640 5 monclient: authenticate success, global_id 27650 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4fd4002df0 con 0x7f4fe8157b50 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4ff089c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4fed60f640 10 monclient: dump: 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.428 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.419+0000 7f4ff089c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.420+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fd4002fc0 con 0x7f4fe8157b50 2026-02-25T15:19:30.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.420+0000 7f4fed60f640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.420+0000 7f4fed60f640 1 -- 10.20.193.78:0/621975964 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4fd4003400 con 0x7f4fe8157b50 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.420+0000 7f4ff089c640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.420+0000 7f4ff089c640 4 set_mon_vals no callback set 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.420+0000 7f4fed60f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.420+0000 7f4fed60f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.420+0000 7f4fed60f640 10 monclient: dump: 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.430 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 10 monclient: shutdown 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 -- 10.20.193.78:0/621975964 >> v1:10.20.193.167:6789/0 conn(0x7f4fe8157b50 legacy=0x7f4fe81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 -- 10.20.193.78:0/621975964 shutdown_connections 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 -- 10.20.193.78:0/621975964 >> 10.20.193.78:0/621975964 conn(0x7f4fe80b2ef0 msgr2=0x7f4fe80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 -- 10.20.193.78:0/621975964 shutdown_connections 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 -- 10.20.193.78:0/621975964 wait complete. 2026-02-25T15:19:30.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 10 monclient: monmap: 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 librados: starting msgr at 2026-02-25T15:19:30.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 librados: starting objecter 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 Processor -- start 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 -- start start 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 librados: setting wanted keys 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 1 librados: calling monclient init 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.421+0000 7f4ff089c640 10 monclient: init 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fe8157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 10 monclient(hunting): picked mon.noname-b con 0x7f4fe8157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 10 monclient(hunting): picked mon.noname-a con 0x7f4fe8164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe81487c0 con 0x7f4fe8164d00 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe8148aa0 con 0x7f4fe8157b50 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe8148d80 con 0x7f4fe8157780 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4ff089c640 10 monclient(hunting): authenticate will time out at 3740.011303s 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4fee611640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f4fe8157780 0x7f4fe805c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47812/0 (socket says 10.20.193.78:47812) 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4fee611640 1 -- 10.20.193.78:0/305274379 learned_addr learned my addr 10.20.193.78:0/305274379 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4fd2ffd640 10 client.?.objecter ms_handle_connect 0x7f4fe8157780 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4fd2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4fd2ffd640 10 client.?.objecter ms_handle_connect 0x7f4fe8164d00 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.422+0000 7f4fd2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 client.?.objecter ms_handle_connect 0x7f4fe8157b50 2026-02-25T15:19:30.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427945222 0 0) 0x7f4fe8148d80 con 0x7f4fe8157780 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 monclient(hunting): my global_id is 27653 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb8003610 con 0x7f4fe8157780 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213828592 0 0) 0x7f4fe81487c0 con 0x7f4fe8164d00 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 10 monclient(hunting): my global_id is 30819 2026-02-25T15:19:30.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.423+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe8148d80 con 0x7f4fe8164d00 2026-02-25T15:19:30.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.424+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771945863 0 0) 0x7f4fe8148aa0 con 0x7f4fe8157b50 2026-02-25T15:19:30.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.424+0000 7f4fd2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.424+0000 7f4fd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.424+0000 7f4fd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.424+0000 7f4fd2ffd640 10 monclient(hunting): my global_id is 30106 2026-02-25T15:19:30.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.424+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe81487c0 con 0x7f4fe8157b50 2026-02-25T15:19:30.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2789266716 0 0) 0x7f4fe8148d80 con 0x7f4fe8164d00 2026-02-25T15:19:30.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fe8148aa0 con 0x7f4fe8164d00 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4fdc003370 con 0x7f4fe8164d00 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.439 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1467401249 0 0) 0x7f4fb8003610 con 0x7f4fe8157780 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fe8148d80 con 0x7f4fe8157780 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4fe00030c0 con 0x7f4fe8157780 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.440 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1367119173 0 0) 0x7f4fe81487c0 con 0x7f4fe8157b50 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fb8003610 con 0x7f4fe8157b50 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4fd4003310 con 0x7f4fe8157b50 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.426+0000 7f4fd2ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 533895235 0 0) 0x7f4fe8148aa0 con 0x7f4fe8164d00 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 >> v1:10.20.193.167:6789/0 conn(0x7f4fe8157780 legacy=0x7f4fe805c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 >> v1:10.20.193.155:6789/0 conn(0x7f4fe8157b50 legacy=0x7f4fe8058b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 1 monclient: found mon.a 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe805b900 con 0x7f4fe8164d00 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4fd2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 5 monclient: authenticate success, global_id 30819 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 10 monclient: _renew_subs 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:30.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe8148290 con 0x7f4fe8164d00 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 10 client.30819.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 10 monclient: _renew_subs 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4fe805c9f0 con 0x7f4fe8164d00 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.427+0000 7f4ff089c640 1 librados: init done 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.428+0000 7f4ff089c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.428+0000 7f4ff089c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.428+0000 7f4ff089c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:30.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.428+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe805e250 con 0x7f4fe8164d00 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.519+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fdc003830 con 0x7f4fe8164d00 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.519+0000 7f4fd2ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.519+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4fdc004df0 con 0x7f4fe8164d00 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.519+0000 7f4fd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.519+0000 7f4fd2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.519+0000 7f4fece0e640 4 set_mon_vals no callback set 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.519+0000 7f4fd2ffd640 10 monclient: dump: 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.522 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.523 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.523 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.523 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.523 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.523 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.523 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.523 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.520+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f4fdc01dc60 con 0x7f4fe8164d00 2026-02-25T15:19:30.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.520+0000 7f4fee611640 10 monclient: get_auth_request con 0x7f4fb8077e20 auth_method 0 2026-02-25T15:19:30.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.520+0000 7f4fd2ffd640 10 client.30819.objecter ms_handle_connect 0x7f4fb8077e20 2026-02-25T15:19:30.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.523+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f4fdc093450 con 0x7f4fe8164d00 2026-02-25T15:19:30.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.523+0000 7f4fd2ffd640 10 client.30819.objecter ms_dispatch2 0x7f4fe8000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:30.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.523+0000 7f4fd2ffd640 3 client.30819.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:30.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.523+0000 7f4fd2ffd640 3 client.30819.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:30.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.523+0000 7f4fd2ffd640 20 client.30819.objecter dump_active .. 0 homeless 2026-02-25T15:19:30.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.523+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4fe805e250 con 0x7f4fe8164d00 2026-02-25T15:19:30.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.523+0000 7f4fd2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.523+0000 7f4fd2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:30.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.630+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7f4fe805b740 con 0x7f4fb8077e20 2026-02-25T15:19:30.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.630+0000 7f4fd2ffd640 1 -- 10.20.193.78:0/305274379 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (unknown 660425183 0 0) 0x7f4fe00058b0 con 0x7f4fb8077e20 2026-02-25T15:19:30.633 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 12 to deep-scrub 2026-02-25T15:19:30.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 10 librados: watch_flush enter 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 10 librados: watch_flush exit 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 20 client.30819.objecter shutdown clearing up homeless session... 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 10 client.30819.objecter successfully canceled tick 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 >> v1:10.20.193.78:6800/3497602169 conn(0x7f4fb8077e20 legacy=0x7f4fb80982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 10 monclient: shutdown 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 >> v1:10.20.193.78:6789/0 conn(0x7f4fe8164d00 legacy=0x7f4fe8128150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 shutdown_connections 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 >> 10.20.193.78:0/305274379 conn(0x7f4fe80b2ef0 msgr2=0x7f4fe80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 shutdown_connections 2026-02-25T15:19:30.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 1 -- 10.20.193.78:0/305274379 wait complete. 2026-02-25T15:19:30.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.631+0000 7f4ff089c640 1 librados: shutdown 2026-02-25T15:19:30.642 INFO:tasks.ceph:Scrubbing osd.1 2026-02-25T15:19:30.643 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:30.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.710+0000 7f56ded44640 10 monclient: get_monmap_and_config 2026-02-25T15:19:30.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.710+0000 7f56ded44640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.710+0000 7f56ded44640 10 monclient: monmap: 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:30.711161+0000 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:30.711161+0000 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.713 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.710+0000 7f56ded44640 1 Processor -- start 2026-02-25T15:19:30.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.710+0000 7f56ded44640 1 -- start start 2026-02-25T15:19:30.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.710+0000 7f56ded44640 10 monclient: init 2026-02-25T15:19:30.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:30.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 10 monclient(hunting): picked mon.noname-a con 0x7f56d8159da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 10 monclient(hunting): picked mon.noname-c con 0x7f56d8165880 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 10 monclient(hunting): picked mon.noname-b con 0x7f56d8056090 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d815a170 con 0x7f56d8159da0 2026-02-25T15:19:30.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d80b4650 con 0x7f56d8056090 2026-02-25T15:19:30.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d80b4930 con 0x7f56d8165880 2026-02-25T15:19:30.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.711+0000 7f56ded44640 10 monclient(hunting): authenticate will time out at 3740.300658s 2026-02-25T15:19:30.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.712+0000 7f56cffff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f56d8165880 0x7f56d8055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47816/0 (socket says 10.20.193.78:47816) 2026-02-25T15:19:30.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.712+0000 7f56cffff640 1 -- 10.20.193.78:0/711063789 learned_addr learned my addr 10.20.193.78:0/711063789 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273455596 0 0) 0x7f56d80b4930 con 0x7f56d8165880 2026-02-25T15:19:30.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 10 monclient(hunting): my global_id is 27656 2026-02-25T15:19:30.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56c4003610 con 0x7f56d8165880 2026-02-25T15:19:30.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968877491 0 0) 0x7f56d80b4650 con 0x7f56d8056090 2026-02-25T15:19:30.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 10 monclient(hunting): my global_id is 30109 2026-02-25T15:19:30.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.713+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d80b4930 con 0x7f56d8056090 2026-02-25T15:19:30.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2665219256 0 0) 0x7f56c4003610 con 0x7f56d8165880 2026-02-25T15:19:30.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 >> v1:10.20.193.155:6789/0 conn(0x7f56d8056090 legacy=0x7f56d80b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 >> v1:10.20.193.78:6789/0 conn(0x7f56d8159da0 legacy=0x7f56d8165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:19:30.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 1 monclient: found mon.noname-c 2026-02-25T15:19:30.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:30.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d80b4c10 con 0x7f56d8165880 2026-02-25T15:19:30.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c0002df0 con 0x7f56d8165880 2026-02-25T15:19:30.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:30.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: dump: 2026-02-25T15:19:30.733 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.733 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.734 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.734 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.734 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.734 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.734 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.734 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.734 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.735 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56ded44640 5 monclient: authenticate success, global_id 27656 2026-02-25T15:19:30.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56ded44640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:30.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56c0003000 con 0x7f56d8165880 2026-02-25T15:19:30.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 1 -- 10.20.193.78:0/711063789 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c0003440 con 0x7f56d8165880 2026-02-25T15:19:30.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56cf7fe640 10 monclient: dump: 2026-02-25T15:19:30.736 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.736 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.736 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.737 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.737 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.737 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.737 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.737 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.737 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.738 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56ded44640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:30.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.715+0000 7f56ded44640 4 set_mon_vals no callback set 2026-02-25T15:19:30.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 10 monclient: shutdown 2026-02-25T15:19:30.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 1 -- 10.20.193.78:0/711063789 >> v1:10.20.193.167:6789/0 conn(0x7f56d8165880 legacy=0x7f56d8055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 1 -- 10.20.193.78:0/711063789 shutdown_connections 2026-02-25T15:19:30.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 1 -- 10.20.193.78:0/711063789 >> 10.20.193.78:0/711063789 conn(0x7f56d80b78c0 msgr2=0x7f56d80b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 1 -- 10.20.193.78:0/711063789 shutdown_connections 2026-02-25T15:19:30.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 1 -- 10.20.193.78:0/711063789 wait complete. 2026-02-25T15:19:30.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.716+0000 7f56ded44640 10 monclient: monmap: 2026-02-25T15:19:30.740 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.740 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:30.740 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:30.740 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:30.740 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.740 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:30.740 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.741 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.741 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.741 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 librados: starting msgr at 2026-02-25T15:19:30.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 librados: starting objecter 2026-02-25T15:19:30.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:30.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 Processor -- start 2026-02-25T15:19:30.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 -- start start 2026-02-25T15:19:30.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 librados: setting wanted keys 2026-02-25T15:19:30.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 librados: calling monclient init 2026-02-25T15:19:30.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 10 monclient: init 2026-02-25T15:19:30.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:30.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 10 monclient(hunting): picked mon.noname-a con 0x7f56d8056090 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 10 monclient(hunting): picked mon.noname-b con 0x7f56d8159da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 10 monclient(hunting): picked mon.noname-c con 0x7f56d8165880 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d80b9f20 con 0x7f56d8056090 2026-02-25T15:19:30.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d80ba200 con 0x7f56d8159da0 2026-02-25T15:19:30.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d80ba4e0 con 0x7f56d8165880 2026-02-25T15:19:30.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56ded44640 10 monclient(hunting): authenticate will time out at 3740.306731s 2026-02-25T15:19:30.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56dd2ba640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f56d8165880 0x7f56d80b5bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47826/0 (socket says 10.20.193.78:47826) 2026-02-25T15:19:30.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.717+0000 7f56dd2ba640 1 -- 10.20.193.78:0/3362308575 learned_addr learned my addr 10.20.193.78:0/3362308575 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.718+0000 7f56cd7fa640 10 client.?.objecter ms_handle_connect 0x7f56d8165880 2026-02-25T15:19:30.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.718+0000 7f56cd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.718+0000 7f56cd7fa640 10 client.?.objecter ms_handle_connect 0x7f56d8159da0 2026-02-25T15:19:30.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.718+0000 7f56cd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.718+0000 7f56cd7fa640 10 client.?.objecter ms_handle_connect 0x7f56d8056090 2026-02-25T15:19:30.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.718+0000 7f56cd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485787951 0 0) 0x7f56d80ba4e0 con 0x7f56d8165880 2026-02-25T15:19:30.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): my global_id is 27659 2026-02-25T15:19:30.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a8003610 con 0x7f56d8165880 2026-02-25T15:19:30.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059314014 0 0) 0x7f56d80ba200 con 0x7f56d8159da0 2026-02-25T15:19:30.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): my global_id is 30112 2026-02-25T15:19:30.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d80ba4e0 con 0x7f56d8159da0 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416095146 0 0) 0x7f56d80b9f20 con 0x7f56d8056090 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 10 monclient(hunting): my global_id is 30822 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.719+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d80ba200 con 0x7f56d8056090 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3918862952 0 0) 0x7f56d80ba4e0 con 0x7f56d8159da0 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d80b9f20 con 0x7f56d8159da0 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c00033f0 con 0x7f56d8159da0 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 10 monclient(hunting): dump: 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 532533618 0 0) 0x7f56a8003610 con 0x7f56d8165880 2026-02-25T15:19:30.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d80ba4e0 con 0x7f56d8165880 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56d4003470 con 0x7f56d8165880 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.721+0000 7f56cd7fa640 10 monclient(hunting): dump: 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.749 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2826519678 0 0) 0x7f56d80b9f20 con 0x7f56d8159da0 2026-02-25T15:19:30.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 >> v1:10.20.193.167:6789/0 conn(0x7f56d8165880 legacy=0x7f56d80b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 >> v1:10.20.193.78:6789/0 conn(0x7f56d8056090 legacy=0x7f56d8152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 1 monclient: found mon.b 2026-02-25T15:19:30.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d80b53d0 con 0x7f56d8159da0 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56cd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 5 monclient: authenticate success, global_id 30112 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 10 monclient: _renew_subs 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56d80b56b0 con 0x7f56d8159da0 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 10 client.30112.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 10 monclient: _renew_subs 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56d80b62e0 con 0x7f56d8159da0 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 1 librados: init done 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 10 client.30112.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 15 client.30112.objecter _session_command_op_assign -1 1 2026-02-25T15:19:30.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 20 client.30112.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:30.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 10 client.30112.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:30.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.723+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f56d8055260 con 0x7f56d8159da0 2026-02-25T15:19:30.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.731+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56d8055260 con 0x7f56d8159da0 2026-02-25T15:19:30.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.731+0000 7f56cd7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.731+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f56c0004b80 con 0x7f56d8159da0 2026-02-25T15:19:30.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.731+0000 7f56cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.731+0000 7f56cd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:30.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.731+0000 7f56ceffd640 4 set_mon_vals no callback set 2026-02-25T15:19:30.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.731+0000 7f56cd7fa640 10 monclient: dump: 2026-02-25T15:19:30.754 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.732+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f56c001d9f0 con 0x7f56d8159da0 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.732+0000 7f56dcab9640 10 monclient: get_auth_request con 0x7f56a8077d30 auth_method 0 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 10 client.30112.objecter ms_handle_connect 0x7f56a8077d30 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f56c00930f0 con 0x7f56d8159da0 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 10 client.30112.objecter ms_dispatch2 0x7f56d8000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 3 client.30112.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:30.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 3 client.30112.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 10 client.30112.objecter checking command 1 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 20 client.30112.objecter _get_session s=0x7f56a80a1fe0 osd=1 3 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 20 client.30112.objecter put_session s=0x7f56a80a1fe0 osd=1 3 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 15 client.30112.objecter _session_command_op_remove -1 1 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 20 client.30112.objecter _get_session s=0x7f56a80a1fe0 osd=1 3 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 20 client.30112.objecter get_session s=0x7f56a80a1fe0 osd=1 3 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 15 client.30112.objecter _session_command_op_assign 1 1 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 20 client.30112.objecter put_session s=0x7f56a80a1fe0 osd=1 4 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 10 client.30112.objecter _send_command 1 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.155:6812/2301996681 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56a80c42f0 con 0x7f56a80a2690 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 20 client.30112.objecter dump_active .. 0 homeless 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f56c0059790 con 0x7f56d8159da0 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56cd7fa640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.733+0000 7f56dd2ba640 10 monclient: get_auth_request con 0x7f56a80a2690 auth_method 0 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.734+0000 7f56cd7fa640 10 client.30112.objecter ms_handle_connect 0x7f56a80a2690 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.744+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== osd.1 v1:10.20.193.155:6812/2301996681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f56a80c42f0 con 0x7f56a80a2690 2026-02-25T15:19:30.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.744+0000 7f56cd7fa640 10 client.30112.objecter ms_dispatch2 0x7f56d8000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.744+0000 7f56cd7fa640 10 client.30112.objecter _finish_command 1 = system:0 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.744+0000 7f56cd7fa640 20 client.30112.objecter put_session s=0x7f56a80a1fe0 osd=1 4 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.744+0000 7f56cd7fa640 15 client.30112.objecter _session_command_op_remove 1 1 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 10 client.30112.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 15 client.30112.objecter _session_command_op_assign -1 2 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 20 client.30112.objecter _get_session s=0x7f56a80a1fe0 osd=1 3 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 20 client.30112.objecter put_session s=0x7f56a80a1fe0 osd=1 3 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 20 client.30112.objecter _get_session s=0x7f56a80a1fe0 osd=1 3 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 15 client.30112.objecter _session_command_op_remove -1 2 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 20 client.30112.objecter get_session s=0x7f56a80a1fe0 osd=1 3 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 15 client.30112.objecter _session_command_op_assign 1 2 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 20 client.30112.objecter put_session s=0x7f56a80a1fe0 osd=1 4 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 10 client.30112.objecter _send_command 2 2026-02-25T15:19:30.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.752+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 --> v1:10.20.193.155:6812/2301996681 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f56d80b4650 con 0x7f56a80a2690 2026-02-25T15:19:30.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56cd7fa640 1 -- 10.20.193.78:0/3362308575 <== osd.1 v1:10.20.193.155:6812/2301996681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f56d80b4650 con 0x7f56a80a2690 2026-02-25T15:19:30.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56cd7fa640 10 client.30112.objecter ms_dispatch2 0x7f56d8000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:30.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56cd7fa640 10 client.30112.objecter _finish_command 2 = system:0 2026-02-25T15:19:30.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56cd7fa640 20 client.30112.objecter put_session s=0x7f56a80a1fe0 osd=1 4 2026-02-25T15:19:30.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56cd7fa640 15 client.30112.objecter _session_command_op_remove 1 2 2026-02-25T15:19:30.762 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:30.762 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:30.762 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 10 librados: watch_flush enter 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 10 librados: watch_flush exit 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 10 client.30112.objecter close_session for osd.1 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 >> v1:10.20.193.155:6812/2301996681 conn(0x7f56a80a2690 legacy=0x7f56a80c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 20 client.30112.objecter put_session s=0x7f56a80a1fe0 osd=1 1 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 20 client.30112.objecter shutdown clearing up homeless session... 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 10 client.30112.objecter successfully canceled tick 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 >> v1:10.20.193.78:6800/3497602169 conn(0x7f56a8077d30 legacy=0x7f56a80981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 10 monclient: shutdown 2026-02-25T15:19:30.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 >> v1:10.20.193.155:6789/0 conn(0x7f56d8159da0 legacy=0x7f56d8137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56dd2ba640 1 -- 10.20.193.78:0/3362308575 reap_dead start 2026-02-25T15:19:30.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 shutdown_connections 2026-02-25T15:19:30.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 >> 10.20.193.78:0/3362308575 conn(0x7f56d80b78c0 msgr2=0x7f56d8158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 shutdown_connections 2026-02-25T15:19:30.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.759+0000 7f56ded44640 1 -- 10.20.193.78:0/3362308575 wait complete. 2026-02-25T15:19:30.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.760+0000 7f56ded44640 1 librados: shutdown 2026-02-25T15:19:30.769 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-25T15:19:30.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.835+0000 7f5566c16640 10 monclient: get_monmap_and_config 2026-02-25T15:19:30.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.835+0000 7f5566c16640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.835+0000 7f5566c16640 10 monclient: monmap: 2026-02-25T15:19:30.838 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.838 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.838 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:30.836798+0000 2026-02-25T15:19:30.838 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:30.836798+0000 2026-02-25T15:19:30.839 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.839 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.839 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.839 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.839 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.839 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.836+0000 7f5566c16640 1 Processor -- start 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.836+0000 7f5566c16640 1 -- start start 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.836+0000 7f5566c16640 10 monclient: init 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 10 monclient(hunting): picked mon.noname-b con 0x7f5560157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 10 monclient(hunting): picked mon.noname-c con 0x7f5560157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 10 monclient(hunting): picked mon.noname-a con 0x7f5560164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556005de70 con 0x7f5560164d00 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5560055b20 con 0x7f5560157780 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5560055e00 con 0x7f5560157b50 2026-02-25T15:19:30.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f5566c16640 10 monclient(hunting): authenticate will time out at 3740.426275s 2026-02-25T15:19:30.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f556498b640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f5560157780 0x7f5560056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46080/0 (socket says 10.20.193.78:46080) 2026-02-25T15:19:30.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.837+0000 7f556498b640 1 -- 10.20.193.78:0/2403044945 learned_addr learned my addr 10.20.193.78:0/2403044945 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.838+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474872442 0 0) 0x7f556005de70 con 0x7f5560164d00 2026-02-25T15:19:30.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.838+0000 7f55577fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.838+0000 7f55577fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.838+0000 7f55577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.838+0000 7f55577fe640 10 monclient(hunting): my global_id is 30825 2026-02-25T15:19:30.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554c003610 con 0x7f5560164d00 2026-02-25T15:19:30.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724093160 0 0) 0x7f5560055b20 con 0x7f5560157780 2026-02-25T15:19:30.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 10 monclient(hunting): my global_id is 30115 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f556005de70 con 0x7f5560157780 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447148073 0 0) 0x7f5560055e00 con 0x7f5560157b50 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 10 monclient(hunting): my global_id is 27662 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.839+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5560055b20 con 0x7f5560157b50 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4278612677 0 0) 0x7f556005de70 con 0x7f5560157780 2026-02-25T15:19:30.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 >> v1:10.20.193.167:6789/0 conn(0x7f5560157b50 legacy=0x7f55601645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 >> v1:10.20.193.78:6789/0 conn(0x7f5560164d00 legacy=0x7f55601c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 1 monclient: found mon.noname-b 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55600560e0 con 0x7f5560157780 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5550002d70 con 0x7f5560157780 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f55577fe640 10 monclient: dump: 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f5566c16640 5 monclient: authenticate success, global_id 30115 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.840+0000 7f5566c16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5550002f40 con 0x7f5560157780 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f55577fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f55577fe640 1 -- 10.20.193.78:0/2403044945 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5550003380 con 0x7f5560157780 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f55577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f55577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f55577fe640 10 monclient: dump: 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.850 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 4 set_mon_vals no callback set 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 10 monclient: shutdown 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 1 -- 10.20.193.78:0/2403044945 >> v1:10.20.193.155:6789/0 conn(0x7f5560157780 legacy=0x7f5560056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 1 -- 10.20.193.78:0/2403044945 shutdown_connections 2026-02-25T15:19:30.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 1 -- 10.20.193.78:0/2403044945 >> 10.20.193.78:0/2403044945 conn(0x7f55600b2ef0 msgr2=0x7f55600b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 1 -- 10.20.193.78:0/2403044945 shutdown_connections 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.841+0000 7f5566c16640 1 -- 10.20.193.78:0/2403044945 wait complete. 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 10 monclient: build_initial_monmap 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 10 monclient: monmap: 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:30.852 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 1 librados: starting msgr at 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 1 librados: starting objecter 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 1 Processor -- start 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 1 -- start start 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 1 librados: setting wanted keys 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 1 librados: calling monclient init 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.842+0000 7f5566c16640 10 monclient: init 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 10 monclient(hunting): picked mon.noname-c con 0x7f5560157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 10 monclient(hunting): picked mon.noname-b con 0x7f5560157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 10 monclient(hunting): picked mon.noname-a con 0x7f5560164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55601362c0 con 0x7f5560164d00 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55601365a0 con 0x7f5560157b50 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5560160c20 con 0x7f5560157780 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5566c16640 10 monclient(hunting): authenticate will time out at 3740.432309s 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5557fff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f5560157b50 0x7f55600577c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46096/0 (socket says 10.20.193.78:46096) 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f5557fff640 1 -- 10.20.193.78:0/3445019808 learned_addr learned my addr 10.20.193.78:0/3445019808 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f55557fa640 10 client.?.objecter ms_handle_connect 0x7f5560157780 2026-02-25T15:19:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f55557fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f55557fa640 10 client.?.objecter ms_handle_connect 0x7f5560164d00 2026-02-25T15:19:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f55557fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f55557fa640 10 client.?.objecter ms_handle_connect 0x7f5560157b50 2026-02-25T15:19:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.843+0000 7f55557fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606304630 0 0) 0x7f55601365a0 con 0x7f5560157b50 2026-02-25T15:19:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): my global_id is 30118 2026-02-25T15:19:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5530003610 con 0x7f5560157b50 2026-02-25T15:19:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887470844 0 0) 0x7f5560160c20 con 0x7f5560157780 2026-02-25T15:19:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): my global_id is 27665 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55601365a0 con 0x7f5560157780 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918185059 0 0) 0x7f55601362c0 con 0x7f5560164d00 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 10 monclient(hunting): my global_id is 30828 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.844+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5560160c20 con 0x7f5560164d00 2026-02-25T15:19:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4184979514 0 0) 0x7f5530003610 con 0x7f5560157b50 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55601362c0 con 0x7f5560157b50 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5548003170 con 0x7f5560157b50 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): dump: 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.861 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4061031888 0 0) 0x7f5560160c20 con 0x7f5560164d00 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5530003610 con 0x7f5560164d00 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2777397384 0 0) 0x7f55601365a0 con 0x7f5560157780 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5560160c20 con 0x7f5560157780 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5550003290 con 0x7f5560157780 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:30.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): dump: 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f555c0033d0 con 0x7f5560164d00 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.847+0000 7f55557fa640 10 monclient(hunting): dump: 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.864 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3544874400 0 0) 0x7f55601362c0 con 0x7f5560157b50 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 >> v1:10.20.193.167:6789/0 conn(0x7f5560157780 legacy=0x7f5560135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 >> v1:10.20.193.78:6789/0 conn(0x7f5560164d00 legacy=0x7f5560139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 10 monclient: _finish_hunting 0 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 1 monclient: found mon.b 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5560160f00 con 0x7f5560157b50 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 10 monclient: _finish_auth 0 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 10 monclient: _check_auth_tickets 2026-02-25T15:19:30.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f55557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 5 monclient: authenticate success, global_id 30118 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 10 monclient: _renew_subs 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f55601611e0 con 0x7f5560157b50 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 10 client.30118.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 10 monclient: _renew_subs 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5560135e60 con 0x7f5560157b50 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 1 librados: init done 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:30.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.849+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5560165140 con 0x7f5560157b50 2026-02-25T15:19:30.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.940+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5548003310 con 0x7f5560157b50 2026-02-25T15:19:30.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.940+0000 7f55557fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:30.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.940+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5548003b50 con 0x7f5560157b50 2026-02-25T15:19:30.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.940+0000 7f55557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:30.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.940+0000 7f55557fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.940+0000 7f5556ffd640 4 set_mon_vals no callback set 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.940+0000 7f55557fa640 10 monclient: dump: 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:30.943 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:30.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.940+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f5548003d30 con 0x7f5560157b50 2026-02-25T15:19:30.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.941+0000 7f556498b640 10 monclient: get_auth_request con 0x7f5530077ef0 auth_method 0 2026-02-25T15:19:30.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.941+0000 7f55557fa640 10 client.30118.objecter ms_handle_connect 0x7f5530077ef0 2026-02-25T15:19:30.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.942+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f55480931f0 con 0x7f5560157b50 2026-02-25T15:19:30.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.942+0000 7f55557fa640 10 client.30118.objecter ms_dispatch2 0x7f5560000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:30.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.942+0000 7f55557fa640 3 client.30118.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:30.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.942+0000 7f55557fa640 3 client.30118.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:30.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.942+0000 7f55557fa640 20 client.30118.objecter dump_active .. 0 homeless 2026-02-25T15:19:30.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.943+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f554805dc20 con 0x7f5560157b50 2026-02-25T15:19:30.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.943+0000 7f55557fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:30.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:30.943+0000 7f55557fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:31.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.048+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f5560138570 con 0x7f5530077ef0 2026-02-25T15:19:31.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.048+0000 7f55557fa640 1 -- 10.20.193.78:0/3445019808 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f5560138570 con 0x7f5530077ef0 2026-02-25T15:19:31.050 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 1 to deep-scrub 2026-02-25T15:19:31.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 10 librados: watch_flush enter 2026-02-25T15:19:31.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 10 librados: watch_flush exit 2026-02-25T15:19:31.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 20 client.30118.objecter shutdown clearing up homeless session... 2026-02-25T15:19:31.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 10 client.30118.objecter successfully canceled tick 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 >> v1:10.20.193.78:6800/3497602169 conn(0x7f5530077ef0 legacy=0x7f55300983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 10 monclient: shutdown 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 >> v1:10.20.193.155:6789/0 conn(0x7f5560157b50 legacy=0x7f55600577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 shutdown_connections 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 >> 10.20.193.78:0/3445019808 conn(0x7f55600b2ef0 msgr2=0x7f55600b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 shutdown_connections 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 1 -- 10.20.193.78:0/3445019808 wait complete. 2026-02-25T15:19:31.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.049+0000 7f5566c16640 1 librados: shutdown 2026-02-25T15:19:31.059 INFO:tasks.ceph:Scrubbing osd.5 2026-02-25T15:19:31.059 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:31.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.126+0000 7f6fbe309640 10 monclient: get_monmap_and_config 2026-02-25T15:19:31.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.126+0000 7f6fbe309640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.126+0000 7f6fbe309640 10 monclient: monmap: 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:31.127077+0000 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:31.127077+0000 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.129 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.126+0000 7f6fbe309640 1 Processor -- start 2026-02-25T15:19:31.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.126+0000 7f6fbe309640 1 -- start start 2026-02-25T15:19:31.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.126+0000 7f6fbe309640 10 monclient: init 2026-02-25T15:19:31.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:31.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 10 monclient(hunting): picked mon.noname-a con 0x7f6fb815e2a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 10 monclient(hunting): picked mon.noname-c con 0x7f6fb8059e10 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 10 monclient(hunting): picked mon.noname-b con 0x7f6fb81a5660 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb8162df0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb81630d0 con 0x7f6fb81a5660 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb81633b0 con 0x7f6fb8059e10 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbe309640 10 monclient(hunting): authenticate will time out at 3740.716251s 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbc87f640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f6fb81a5660 0x7f6fb81c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46108/0 (socket says 10.20.193.78:46108) 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.127+0000 7f6fbc87f640 1 -- 10.20.193.78:0/1730547596 learned_addr learned my addr 10.20.193.78:0/1730547596 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730145059 0 0) 0x7f6fb81630d0 con 0x7f6fb81a5660 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): my global_id is 30121 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9c003610 con 0x7f6fb81a5660 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225008671 0 0) 0x7f6fb81633b0 con 0x7f6fb8059e10 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): my global_id is 27668 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb81630d0 con 0x7f6fb8059e10 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928736697 0 0) 0x7f6fb8162df0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 10 monclient(hunting): my global_id is 30831 2026-02-25T15:19:31.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.129+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb81633b0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 672887962 0 0) 0x7f6f9c003610 con 0x7f6fb81a5660 2026-02-25T15:19:31.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 >> v1:10.20.193.167:6789/0 conn(0x7f6fb8059e10 legacy=0x7f6fb815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 >> v1:10.20.193.78:6789/0 conn(0x7f6fb815e2a0 legacy=0x7f6fb805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 1 monclient: found mon.noname-b 2026-02-25T15:19:31.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb8163690 con 0x7f6fb81a5660 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6fac003170 con 0x7f6fb81a5660 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fb6ffd640 10 monclient: dump: 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.143 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fbe309640 5 monclient: authenticate success, global_id 30121 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.130+0000 7f6fbe309640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fac003340 con 0x7f6fb81a5660 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fb6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fbe309640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fbe309640 4 set_mon_vals no callback set 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fb6ffd640 1 -- 10.20.193.78:0/1730547596 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6fac003780 con 0x7f6fb81a5660 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fb6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fb6ffd640 10 monclient: dump: 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.145 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fbe309640 10 monclient: shutdown 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fbe309640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fbe309640 1 -- 10.20.193.78:0/1730547596 >> v1:10.20.193.155:6789/0 conn(0x7f6fb81a5660 legacy=0x7f6fb81c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fbe309640 1 -- 10.20.193.78:0/1730547596 shutdown_connections 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.131+0000 7f6fbe309640 1 -- 10.20.193.78:0/1730547596 >> 10.20.193.78:0/1730547596 conn(0x7f6fb80b2f60 msgr2=0x7f6fb80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 1 -- 10.20.193.78:0/1730547596 shutdown_connections 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 1 -- 10.20.193.78:0/1730547596 wait complete. 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 10 monclient: monmap: 2026-02-25T15:19:31.146 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 1 librados: starting msgr at 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 1 librados: starting objecter 2026-02-25T15:19:31.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 1 Processor -- start 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 1 -- start start 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 1 librados: setting wanted keys 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 1 librados: calling monclient init 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.132+0000 7f6fbe309640 10 monclient: init 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 10 monclient(hunting): picked mon.noname-b con 0x7f6fb8059e10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 10 monclient(hunting): picked mon.noname-c con 0x7f6fb815e2a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 10 monclient(hunting): picked mon.noname-a con 0x7f6fb81a5660 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb815fdd0 con 0x7f6fb81a5660 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb81600b0 con 0x7f6fb8059e10 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb8160390 con 0x7f6fb815e2a0 2026-02-25T15:19:31.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbe309640 10 monclient(hunting): authenticate will time out at 3740.722382s 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbc87f640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6fb81a5660 0x7f6fb812aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50350/0 (socket says 10.20.193.78:50350) 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fbc87f640 1 -- 10.20.193.78:0/201465917 learned_addr learned my addr 10.20.193.78:0/201465917 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fb4ff9640 10 client.?.objecter ms_handle_connect 0x7f6fb81a5660 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.133+0000 7f6fb4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.134+0000 7f6fb4ff9640 10 client.?.objecter ms_handle_connect 0x7f6fb815e2a0 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.134+0000 7f6fb4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.134+0000 7f6fb4ff9640 10 client.?.objecter ms_handle_connect 0x7f6fb8059e10 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.134+0000 7f6fb4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819140392 0 0) 0x7f6fb8160390 con 0x7f6fb815e2a0 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): my global_id is 27671 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f88003610 con 0x7f6fb815e2a0 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200598672 0 0) 0x7f6fb815fdd0 con 0x7f6fb81a5660 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): my global_id is 30834 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb8160390 con 0x7f6fb81a5660 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891156543 0 0) 0x7f6fb81600b0 con 0x7f6fb8059e10 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 10 monclient(hunting): my global_id is 30124 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.135+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb815fdd0 con 0x7f6fb8059e10 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2752766089 0 0) 0x7f6f88003610 con 0x7f6fb815e2a0 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fb81600b0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6fa8002ff0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.151 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 336906335 0 0) 0x7f6fb8160390 con 0x7f6fb81a5660 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f88003610 con 0x7f6fb81a5660 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6fac0034f0 con 0x7f6fb81a5660 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.137+0000 7f6fb4ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 364057097 0 0) 0x7f6fb815fdd0 con 0x7f6fb8059e10 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fb8160390 con 0x7f6fb8059e10 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6fa4003060 con 0x7f6fb8059e10 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.154 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3057647536 0 0) 0x7f6fb81600b0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 >> v1:10.20.193.155:6789/0 conn(0x7f6fb8059e10 legacy=0x7f6fb8128dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 >> v1:10.20.193.78:6789/0 conn(0x7f6fb81a5660 legacy=0x7f6fb812aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 1 monclient: found mon.c 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb8160670 con 0x7f6fb815e2a0 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fb4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fbe309640 5 monclient: authenticate success, global_id 27671 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fbe309640 10 monclient: _renew_subs 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fbe309640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb8160950 con 0x7f6fb815e2a0 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fbe309640 10 client.27671.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fbe309640 10 monclient: _renew_subs 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fbe309640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.138+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fb8161330 con 0x7f6fb815e2a0 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.139+0000 7f6fbe309640 1 librados: init done 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.139+0000 7f6fbe309640 10 client.27671.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.139+0000 7f6fbe309640 15 client.27671.objecter _session_command_op_assign -1 1 2026-02-25T15:19:31.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.139+0000 7f6fbe309640 20 client.27671.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:31.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.139+0000 7f6fbe309640 10 client.27671.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:31.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.139+0000 7f6fbe309640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:31.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.139+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6fb815c7c0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.147+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fb815c7c0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.147+0000 7f6fb4ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.147+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6fa80037b0 con 0x7f6fb815e2a0 2026-02-25T15:19:31.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.147+0000 7f6fb4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.147+0000 7f6fb4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:31.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.147+0000 7f6fb4ff9640 10 monclient: dump: 2026-02-25T15:19:31.159 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.159 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.147+0000 7f6fb67fc640 4 set_mon_vals no callback set 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.147+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6fa801c620 con 0x7f6fb815e2a0 2026-02-25T15:19:31.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.148+0000 7f6fb7fff640 10 monclient: get_auth_request con 0x7f6f88077e20 auth_method 0 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.148+0000 7f6fb4ff9640 10 client.27671.objecter ms_handle_connect 0x7f6f88077e20 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f6fa8091d70 con 0x7f6fb815e2a0 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 10 client.27671.objecter ms_dispatch2 0x7f6fb8000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 3 client.27671.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 3 client.27671.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 10 client.27671.objecter checking command 1 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 20 client.27671.objecter _get_session s=0x7f6f880a20d0 osd=5 3 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 20 client.27671.objecter put_session s=0x7f6f880a20d0 osd=5 3 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 15 client.27671.objecter _session_command_op_remove -1 1 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 20 client.27671.objecter _get_session s=0x7f6f880a20d0 osd=5 3 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 20 client.27671.objecter get_session s=0x7f6f880a20d0 osd=5 3 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 15 client.27671.objecter _session_command_op_assign 5 1 2026-02-25T15:19:31.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 20 client.27671.objecter put_session s=0x7f6f880a20d0 osd=5 4 2026-02-25T15:19:31.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 10 client.27671.objecter _send_command 1 2026-02-25T15:19:31.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.155:6804/3530698425 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f880c43e0 con 0x7f6f880a2780 2026-02-25T15:19:31.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 20 client.27671.objecter dump_active .. 0 homeless 2026-02-25T15:19:31.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f6fa805be70 con 0x7f6fb815e2a0 2026-02-25T15:19:31.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.149+0000 7f6fb4ff9640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:31.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.150+0000 7f6fbc87f640 10 monclient: get_auth_request con 0x7f6f880a2780 auth_method 0 2026-02-25T15:19:31.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.151+0000 7f6fb4ff9640 10 client.27671.objecter ms_handle_connect 0x7f6f880a2780 2026-02-25T15:19:31.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.161+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== osd.5 v1:10.20.193.155:6804/3530698425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6f880c43e0 con 0x7f6f880a2780 2026-02-25T15:19:31.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.161+0000 7f6fb4ff9640 10 client.27671.objecter ms_dispatch2 0x7f6fb8000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:31.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.161+0000 7f6fb4ff9640 10 client.27671.objecter _finish_command 1 = system:0 2026-02-25T15:19:31.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.161+0000 7f6fb4ff9640 20 client.27671.objecter put_session s=0x7f6f880a20d0 osd=5 4 2026-02-25T15:19:31.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.161+0000 7f6fb4ff9640 15 client.27671.objecter _session_command_op_remove 5 1 2026-02-25T15:19:31.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 10 client.27671.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:31.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 15 client.27671.objecter _session_command_op_assign -1 2 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 20 client.27671.objecter _get_session s=0x7f6f880a20d0 osd=5 3 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 20 client.27671.objecter put_session s=0x7f6f880a20d0 osd=5 3 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 20 client.27671.objecter _get_session s=0x7f6f880a20d0 osd=5 3 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 15 client.27671.objecter _session_command_op_remove -1 2 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 20 client.27671.objecter get_session s=0x7f6f880a20d0 osd=5 3 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 15 client.27671.objecter _session_command_op_assign 5 2 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 20 client.27671.objecter put_session s=0x7f6f880a20d0 osd=5 4 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 10 client.27671.objecter _send_command 2 2026-02-25T15:19:31.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.169+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 --> v1:10.20.193.155:6804/3530698425 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6fb815f050 con 0x7f6f880a2780 2026-02-25T15:19:31.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.176+0000 7f6fb4ff9640 1 -- 10.20.193.78:0/201465917 <== osd.5 v1:10.20.193.155:6804/3530698425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6fb815f050 con 0x7f6f880a2780 2026-02-25T15:19:31.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.176+0000 7f6fb4ff9640 10 client.27671.objecter ms_dispatch2 0x7f6fb8000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:31.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.176+0000 7f6fb4ff9640 10 client.27671.objecter _finish_command 2 = system:0 2026-02-25T15:19:31.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.176+0000 7f6fb4ff9640 20 client.27671.objecter put_session s=0x7f6f880a20d0 osd=5 4 2026-02-25T15:19:31.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.176+0000 7f6fb4ff9640 15 client.27671.objecter _session_command_op_remove 5 2 2026-02-25T15:19:31.180 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:31.180 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:31.180 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:31.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 10 librados: watch_flush enter 2026-02-25T15:19:31.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 10 librados: watch_flush exit 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 10 client.27671.objecter close_session for osd.5 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 >> v1:10.20.193.155:6804/3530698425 conn(0x7f6f880a2780 legacy=0x7f6f880c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 20 client.27671.objecter put_session s=0x7f6f880a20d0 osd=5 1 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 20 client.27671.objecter shutdown clearing up homeless session... 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 10 client.27671.objecter successfully canceled tick 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6f88077e20 legacy=0x7f6f880982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 10 monclient: shutdown 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 >> v1:10.20.193.167:6789/0 conn(0x7f6fb815e2a0 legacy=0x7f6fb81a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbc87f640 1 -- 10.20.193.78:0/201465917 reap_dead start 2026-02-25T15:19:31.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 shutdown_connections 2026-02-25T15:19:31.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 >> 10.20.193.78:0/201465917 conn(0x7f6fb80b2f60 msgr2=0x7f6fb80b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 shutdown_connections 2026-02-25T15:19:31.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 1 -- 10.20.193.78:0/201465917 wait complete. 2026-02-25T15:19:31.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.177+0000 7f6fbe309640 1 librados: shutdown 2026-02-25T15:19:31.188 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-25T15:19:31.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.255+0000 7fedf3508640 10 monclient: get_monmap_and_config 2026-02-25T15:19:31.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.255+0000 7fedf3508640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.255+0000 7fedf3508640 10 monclient: monmap: 2026-02-25T15:19:31.257 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.257 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.257 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:31.256382+0000 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:31.256382+0000 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 1 Processor -- start 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 1 -- start start 2026-02-25T15:19:31.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 10 monclient: init 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 10 monclient(hunting): picked mon.noname-b con 0x7fedec15d0c0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 10 monclient(hunting): picked mon.noname-c con 0x7fedec0b0ca0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 10 monclient(hunting): picked mon.noname-a con 0x7fedec0b28b0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0b8540 con 0x7fedec0b28b0 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0b5da0 con 0x7fedec15d0c0 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0b6080 con 0x7fedec0b0ca0 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.256+0000 7fedf3508640 10 monclient(hunting): authenticate will time out at 3740.845769s 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.257+0000 7fedf1a7e640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fedec0b28b0 0x7fedec0b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50358/0 (socket says 10.20.193.78:50358) 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.257+0000 7fedf1a7e640 1 -- 10.20.193.78:0/2669285146 learned_addr learned my addr 10.20.193.78:0/2669285146 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.257+0000 7fedf0a7c640 1 --1- 10.20.193.78:0/2669285146 >> v1:10.20.193.167:6789/0 conn(0x7fedec0b0ca0 0x7fedec0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47850/0 (socket says 10.20.193.78:47850) 2026-02-25T15:19:31.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144031070 0 0) 0x7fedec0b8540 con 0x7fedec0b28b0 2026-02-25T15:19:31.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): my global_id is 30837 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd4003610 con 0x7fedec0b28b0 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647848884 0 0) 0x7fedec0b6080 con 0x7fedec0b0ca0 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): my global_id is 27674 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec0b8540 con 0x7fedec0b0ca0 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942163948 0 0) 0x7fedec0b5da0 con 0x7fedec15d0c0 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 10 monclient(hunting): my global_id is 30127 2026-02-25T15:19:31.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.258+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec0b6080 con 0x7fedec15d0c0 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2893511518 0 0) 0x7fedd4003610 con 0x7fedec0b28b0 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 >> v1:10.20.193.167:6789/0 conn(0x7fedec0b0ca0 legacy=0x7fedec0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 >> v1:10.20.193.155:6789/0 conn(0x7fedec15d0c0 legacy=0x7fedec0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 1 monclient: found mon.noname-a 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec163e10 con 0x7fedec0b28b0 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fede8003170 con 0x7fedec0b28b0 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7feddbfff640 10 monclient: dump: 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7fedf3508640 5 monclient: authenticate success, global_id 30837 2026-02-25T15:19:31.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.260+0000 7fedf3508640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fede8003340 con 0x7fedec0b28b0 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7feddbfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7feddbfff640 1 -- 10.20.193.78:0/2669285146 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fede8003780 con 0x7fedec0b28b0 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7feddbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7feddbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7feddbfff640 10 monclient: dump: 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 4 set_mon_vals no callback set 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 10 monclient: shutdown 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 1 -- 10.20.193.78:0/2669285146 >> v1:10.20.193.78:6789/0 conn(0x7fedec0b28b0 legacy=0x7fedec0b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 1 -- 10.20.193.78:0/2669285146 shutdown_connections 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 1 -- 10.20.193.78:0/2669285146 >> 10.20.193.78:0/2669285146 conn(0x7fedec0b5290 msgr2=0x7fedec0b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 1 -- 10.20.193.78:0/2669285146 shutdown_connections 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 1 -- 10.20.193.78:0/2669285146 wait complete. 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.261+0000 7fedf3508640 10 monclient: monmap: 2026-02-25T15:19:31.264 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.265 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 librados: starting msgr at 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 librados: starting objecter 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 Processor -- start 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 -- start start 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 librados: setting wanted keys 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 librados: calling monclient init 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 10 monclient: init 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 10 monclient(hunting): picked mon.noname-a con 0x7fedec0b0ca0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 10 monclient(hunting): picked mon.noname-c con 0x7fedec0b28b0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 10 monclient(hunting): picked mon.noname-b con 0x7fedec15d0c0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec159030 con 0x7fedec0b0ca0 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0b3960 con 0x7fedec15d0c0 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec1fea30 con 0x7fedec0b28b0 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.262+0000 7fedf3508640 10 monclient(hunting): authenticate will time out at 3740.851932s 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.263+0000 7fedf127d640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fedec0b0ca0 0x7fedec158920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50364/0 (socket says 10.20.193.78:50364) 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.263+0000 7fedf127d640 1 -- 10.20.193.78:0/3236108277 learned_addr learned my addr 10.20.193.78:0/3236108277 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.263+0000 7fedd9ffb640 10 client.?.objecter ms_handle_connect 0x7fedec0b0ca0 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.263+0000 7fedd9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.263+0000 7fedd9ffb640 10 client.?.objecter ms_handle_connect 0x7fedec15d0c0 2026-02-25T15:19:31.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.263+0000 7fedd9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 client.?.objecter ms_handle_connect 0x7fedec0b28b0 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551962551 0 0) 0x7fedec159030 con 0x7fedec0b0ca0 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 monclient(hunting): my global_id is 30840 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedbc003610 con 0x7fedec0b0ca0 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2526105367 0 0) 0x7fedec163e10 con 0x7fedec15d0c0 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 10 monclient(hunting): my global_id is 30130 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.264+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec159030 con 0x7fedec15d0c0 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.265+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3160113685 0 0) 0x7fedec1fea30 con 0x7fedec0b28b0 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.265+0000 7fedd9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.265+0000 7fedd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.265+0000 7fedd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.265+0000 7fedd9ffb640 10 monclient(hunting): my global_id is 27677 2026-02-25T15:19:31.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.265+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec163e10 con 0x7fedec0b28b0 2026-02-25T15:19:31.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2439918955 0 0) 0x7fedbc003610 con 0x7fedec0b0ca0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedec1fea30 con 0x7fedec0b0ca0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7feddc0030c0 con 0x7fedec0b0ca0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 169532034 0 0) 0x7fedec159030 con 0x7fedec15d0c0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedbc003610 con 0x7fedec15d0c0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fede80034f0 con 0x7fedec15d0c0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.266+0000 7fedd9ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.269 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.267+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3842182296 0 0) 0x7fedec163e10 con 0x7fedec0b28b0 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.267+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedec159030 con 0x7fedec0b28b0 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.267+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fede0003040 con 0x7fedec0b28b0 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.267+0000 7fedd9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.267+0000 7fedd9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.267+0000 7fedd9ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.270 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1007814964 0 0) 0x7fedec1fea30 con 0x7fedec0b0ca0 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 >> v1:10.20.193.167:6789/0 conn(0x7fedec0b28b0 legacy=0x7fedec156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 >> v1:10.20.193.155:6789/0 conn(0x7fedec15d0c0 legacy=0x7fedec1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 1 monclient: found mon.a 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec1fecf0 con 0x7fedec0b0ca0 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedd9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 5 monclient: authenticate success, global_id 30840 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 10 monclient: _renew_subs 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fedec1fefd0 con 0x7fedec0b0ca0 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 10 client.30840.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 10 monclient: _renew_subs 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fedec1ff590 con 0x7fedec0b0ca0 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 1 librados: init done 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.268+0000 7fedf3508640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.269+0000 7fedf3508640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.269+0000 7fedf3508640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.269+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec05e210 con 0x7fedec0b0ca0 2026-02-25T15:19:31.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.361+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feddc003470 con 0x7fedec0b0ca0 2026-02-25T15:19:31.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.361+0000 7fedd9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.361+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7feddc003b50 con 0x7fedec0b0ca0 2026-02-25T15:19:31.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.361+0000 7fedd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.361+0000 7fedd9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:31.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.361+0000 7fedd9ffb640 10 monclient: dump: 2026-02-25T15:19:31.366 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.366 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.366 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.366 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.367 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.367 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.367 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.367 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.367 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.367 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.361+0000 7feddb7fe640 4 set_mon_vals no callback set 2026-02-25T15:19:31.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.362+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7feddc003d30 con 0x7fedec0b0ca0 2026-02-25T15:19:31.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.362+0000 7fedf0a7c640 10 monclient: get_auth_request con 0x7fedbc077e70 auth_method 0 2026-02-25T15:19:31.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.362+0000 7fedd9ffb640 10 client.30840.objecter ms_handle_connect 0x7fedbc077e70 2026-02-25T15:19:31.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.366+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7feddc0931f0 con 0x7fedec0b0ca0 2026-02-25T15:19:31.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.366+0000 7fedd9ffb640 10 client.30840.objecter ms_dispatch2 0x7fedec000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:31.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.366+0000 7fedd9ffb640 3 client.30840.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:31.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.366+0000 7fedd9ffb640 3 client.30840.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:31.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.366+0000 7fedd9ffb640 20 client.30840.objecter dump_active .. 0 homeless 2026-02-25T15:19:31.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.366+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7feddc05dc20 con 0x7fedec0b0ca0 2026-02-25T15:19:31.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.366+0000 7fedd9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:31.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.366+0000 7fedd9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:31.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.476+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fedec163ac0 con 0x7fedbc077e70 2026-02-25T15:19:31.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.476+0000 7fedd9ffb640 1 -- 10.20.193.78:0/3236108277 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fedec163ac0 con 0x7fedbc077e70 2026-02-25T15:19:31.479 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 5 to deep-scrub 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 10 librados: watch_flush enter 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 10 librados: watch_flush exit 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 20 client.30840.objecter shutdown clearing up homeless session... 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 10 client.30840.objecter successfully canceled tick 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 >> v1:10.20.193.78:6800/3497602169 conn(0x7fedbc077e70 legacy=0x7fedbc098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 10 monclient: shutdown 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 >> v1:10.20.193.78:6789/0 conn(0x7fedec0b0ca0 legacy=0x7fedec158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 shutdown_connections 2026-02-25T15:19:31.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 >> 10.20.193.78:0/3236108277 conn(0x7fedec0b5290 msgr2=0x7fedec0b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.478+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 shutdown_connections 2026-02-25T15:19:31.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.479+0000 7fedf3508640 1 -- 10.20.193.78:0/3236108277 wait complete. 2026-02-25T15:19:31.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.479+0000 7fedf3508640 1 librados: shutdown 2026-02-25T15:19:31.490 INFO:tasks.ceph:Scrubbing osd.9 2026-02-25T15:19:31.490 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:31.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.557+0000 7f2e48caa640 10 monclient: get_monmap_and_config 2026-02-25T15:19:31.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.557+0000 7f2e48caa640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.557+0000 7f2e48caa640 10 monclient: monmap: 2026-02-25T15:19:31.560 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.560 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.560 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:31.558418+0000 2026-02-25T15:19:31.560 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:31.558418+0000 2026-02-25T15:19:31.560 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.560 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.561 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.561 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.561 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.561 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 1 Processor -- start 2026-02-25T15:19:31.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 1 -- start start 2026-02-25T15:19:31.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 10 monclient: init 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 10 monclient(hunting): picked mon.noname-c con 0x7f2e4415e2a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 10 monclient(hunting): picked mon.noname-a con 0x7f2e44059e10 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 10 monclient(hunting): picked mon.noname-b con 0x7f2e441a5660 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e44162df0 con 0x7f2e44059e10 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e441630d0 con 0x7f2e441a5660 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e441633b0 con 0x7f2e4415e2a0 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e48caa640 10 monclient(hunting): authenticate will time out at 3741.147633s 2026-02-25T15:19:31.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e42575640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f2e4415e2a0 0x7f2e4405da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47864/0 (socket says 10.20.193.78:47864) 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.559+0000 7f2e42575640 1 -- 10.20.193.78:0/4021290428 learned_addr learned my addr 10.20.193.78:0/4021290428 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.558+0000 7f2e41d74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f2e44059e10 0x7f2e4415ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50378/0 (socket says 10.20.193.78:50378) 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694305668 0 0) 0x7f2e44162df0 con 0x7f2e44059e10 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): my global_id is 30843 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e30003610 con 0x7f2e44059e10 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921864380 0 0) 0x7f2e441633b0 con 0x7f2e4415e2a0 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): my global_id is 27680 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e44162df0 con 0x7f2e4415e2a0 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312421665 0 0) 0x7f2e441630d0 con 0x7f2e441a5660 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 10 monclient(hunting): my global_id is 30133 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.560+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e441633b0 con 0x7f2e441a5660 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2336031326 0 0) 0x7f2e30003610 con 0x7f2e44059e10 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 >> v1:10.20.193.167:6789/0 conn(0x7f2e4415e2a0 legacy=0x7f2e4405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 >> v1:10.20.193.155:6789/0 conn(0x7f2e441a5660 legacy=0x7f2e441c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 1 monclient: found mon.noname-a 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e44163690 con 0x7f2e44059e10 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2e2c002df0 con 0x7f2e44059e10 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e41573640 10 monclient: dump: 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.568 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e48caa640 5 monclient: authenticate success, global_id 30843 2026-02-25T15:19:31.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.561+0000 7f2e48caa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:31.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.562+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e2c002fc0 con 0x7f2e44059e10 2026-02-25T15:19:31.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.562+0000 7f2e41573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.562+0000 7f2e41573640 1 -- 10.20.193.78:0/4021290428 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2e2c003400 con 0x7f2e44059e10 2026-02-25T15:19:31.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.562+0000 7f2e41573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.562+0000 7f2e41573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.562+0000 7f2e41573640 10 monclient: dump: 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.576 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.562+0000 7f2e48caa640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.562+0000 7f2e48caa640 4 set_mon_vals no callback set 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 10 monclient: shutdown 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 -- 10.20.193.78:0/4021290428 >> v1:10.20.193.78:6789/0 conn(0x7f2e44059e10 legacy=0x7f2e4415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 -- 10.20.193.78:0/4021290428 shutdown_connections 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 -- 10.20.193.78:0/4021290428 >> 10.20.193.78:0/4021290428 conn(0x7f2e440b2f60 msgr2=0x7f2e440b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 -- 10.20.193.78:0/4021290428 shutdown_connections 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 -- 10.20.193.78:0/4021290428 wait complete. 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 10 monclient: monmap: 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 librados: starting msgr at 2026-02-25T15:19:31.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 librados: starting objecter 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 Processor -- start 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 -- start start 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 librados: setting wanted keys 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 1 librados: calling monclient init 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.563+0000 7f2e48caa640 10 monclient: init 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 10 monclient(hunting): picked mon.noname-a con 0x7f2e44059e10 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 10 monclient(hunting): picked mon.noname-b con 0x7f2e4415e2a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 10 monclient(hunting): picked mon.noname-c con 0x7f2e441a5660 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e440a79a0 con 0x7f2e44059e10 2026-02-25T15:19:31.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e440a7c80 con 0x7f2e4415e2a0 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e440a7f60 con 0x7f2e441a5660 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e48caa640 10 monclient(hunting): authenticate will time out at 3741.153428s 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e42d76640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f2e441a5660 0x7f2e44056a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47880/0 (socket says 10.20.193.78:47880) 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e42d76640 1 -- 10.20.193.78:0/1001418396 learned_addr learned my addr 10.20.193.78:0/1001418396 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e2affd640 10 client.?.objecter ms_handle_connect 0x7f2e441a5660 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e2affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e2affd640 10 client.?.objecter ms_handle_connect 0x7f2e4415e2a0 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.564+0000 7f2e2affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.565+0000 7f2e2affd640 10 client.?.objecter ms_handle_connect 0x7f2e44059e10 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.565+0000 7f2e2affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.565+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3809507931 0 0) 0x7f2e440a7f60 con 0x7f2e441a5660 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.565+0000 7f2e2affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.565+0000 7f2e2affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.565+0000 7f2e2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.565+0000 7f2e2affd640 10 monclient(hunting): my global_id is 27683 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.565+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e10003610 con 0x7f2e441a5660 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306032535 0 0) 0x7f2e440a79a0 con 0x7f2e44059e10 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 10 monclient(hunting): my global_id is 30846 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e440a7f60 con 0x7f2e44059e10 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270591995 0 0) 0x7f2e440a7c80 con 0x7f2e4415e2a0 2026-02-25T15:19:31.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 10 monclient(hunting): my global_id is 30136 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.566+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e440a79a0 con 0x7f2e4415e2a0 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2820515659 0 0) 0x7f2e10003610 con 0x7f2e441a5660 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e440a7c80 con 0x7f2e441a5660 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2e34003470 con 0x7f2e441a5660 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): dump: 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.582 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 254718622 0 0) 0x7f2e440a7f60 con 0x7f2e44059e10 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e10003610 con 0x7f2e44059e10 2026-02-25T15:19:31.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2e380030b0 con 0x7f2e44059e10 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): dump: 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.584 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3014932031 0 0) 0x7f2e440a79a0 con 0x7f2e4415e2a0 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e440a7f60 con 0x7f2e4415e2a0 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2e2c003310 con 0x7f2e4415e2a0 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.568+0000 7f2e2affd640 10 monclient(hunting): dump: 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.585 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3623796148 0 0) 0x7f2e440a7c80 con 0x7f2e441a5660 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 >> v1:10.20.193.155:6789/0 conn(0x7f2e4415e2a0 legacy=0x7f2e44191a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 >> v1:10.20.193.78:6789/0 conn(0x7f2e44059e10 legacy=0x7f2e440a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 1 monclient: found mon.c 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e440a8240 con 0x7f2e441a5660 2026-02-25T15:19:31.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 5 monclient: authenticate success, global_id 27683 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 10 monclient: _renew_subs 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e440a8520 con 0x7f2e441a5660 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 10 client.27683.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 10 monclient: _renew_subs 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e44057700 con 0x7f2e441a5660 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.569+0000 7f2e48caa640 1 librados: init done 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.570+0000 7f2e48caa640 10 client.27683.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:31.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.570+0000 7f2e48caa640 15 client.27683.objecter _session_command_op_assign -1 1 2026-02-25T15:19:31.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.570+0000 7f2e48caa640 20 client.27683.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:31.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.570+0000 7f2e48caa640 10 client.27683.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:31.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.570+0000 7f2e48caa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:31.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.570+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2e44160810 con 0x7f2e441a5660 2026-02-25T15:19:31.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.578+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e44160810 con 0x7f2e441a5660 2026-02-25T15:19:31.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.578+0000 7f2e2affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.578+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f2e34003d30 con 0x7f2e441a5660 2026-02-25T15:19:31.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.578+0000 7f2e2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.578+0000 7f2e2affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:31.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.578+0000 7f2e2affd640 10 monclient: dump: 2026-02-25T15:19:31.590 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.578+0000 7f2e40d72640 4 set_mon_vals no callback set 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.579+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f2e34003f10 con 0x7f2e441a5660 2026-02-25T15:19:31.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.579+0000 7f2e42575640 10 monclient: get_auth_request con 0x7f2e10077ef0 auth_method 0 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.579+0000 7f2e2affd640 10 client.27683.objecter ms_handle_connect 0x7f2e10077ef0 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.580+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f2e340933d0 con 0x7f2e441a5660 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.580+0000 7f2e2affd640 10 client.27683.objecter ms_dispatch2 0x7f2e44000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.580+0000 7f2e2affd640 3 client.27683.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.580+0000 7f2e2affd640 3 client.27683.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 10 client.27683.objecter checking command 1 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 20 client.27683.objecter _get_session s=0x7f2e100a21a0 osd=9 3 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 20 client.27683.objecter put_session s=0x7f2e100a21a0 osd=9 3 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 15 client.27683.objecter _session_command_op_remove -1 1 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 20 client.27683.objecter _get_session s=0x7f2e100a21a0 osd=9 3 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 20 client.27683.objecter get_session s=0x7f2e100a21a0 osd=9 3 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 15 client.27683.objecter _session_command_op_assign 9 1 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 20 client.27683.objecter put_session s=0x7f2e100a21a0 osd=9 4 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 10 client.27683.objecter _send_command 1 2026-02-25T15:19:31.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.155:6805/976780597 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e100c44b0 con 0x7f2e100a2850 2026-02-25T15:19:31.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 20 client.27683.objecter dump_active .. 0 homeless 2026-02-25T15:19:31.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f2e34059a70 con 0x7f2e441a5660 2026-02-25T15:19:31.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e2affd640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:31.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.581+0000 7f2e41d74640 10 monclient: get_auth_request con 0x7f2e100a2850 auth_method 0 2026-02-25T15:19:31.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.582+0000 7f2e2affd640 10 client.27683.objecter ms_handle_connect 0x7f2e100a2850 2026-02-25T15:19:31.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.592+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== osd.9 v1:10.20.193.155:6805/976780597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f2e100c44b0 con 0x7f2e100a2850 2026-02-25T15:19:31.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.592+0000 7f2e2affd640 10 client.27683.objecter ms_dispatch2 0x7f2e44000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:31.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.592+0000 7f2e2affd640 10 client.27683.objecter _finish_command 1 = system:0 2026-02-25T15:19:31.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.592+0000 7f2e2affd640 20 client.27683.objecter put_session s=0x7f2e100a21a0 osd=9 4 2026-02-25T15:19:31.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.592+0000 7f2e2affd640 15 client.27683.objecter _session_command_op_remove 9 1 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 10 client.27683.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 15 client.27683.objecter _session_command_op_assign -1 2 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 20 client.27683.objecter _get_session s=0x7f2e100a21a0 osd=9 3 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 20 client.27683.objecter put_session s=0x7f2e100a21a0 osd=9 3 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 20 client.27683.objecter _get_session s=0x7f2e100a21a0 osd=9 3 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 15 client.27683.objecter _session_command_op_remove -1 2 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 20 client.27683.objecter get_session s=0x7f2e100a21a0 osd=9 3 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 15 client.27683.objecter _session_command_op_assign 9 2 2026-02-25T15:19:31.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 20 client.27683.objecter put_session s=0x7f2e100a21a0 osd=9 4 2026-02-25T15:19:31.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 10 client.27683.objecter _send_command 2 2026-02-25T15:19:31.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.599+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 --> v1:10.20.193.155:6805/976780597 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2e44160530 con 0x7f2e100a2850 2026-02-25T15:19:31.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e2affd640 1 -- 10.20.193.78:0/1001418396 <== osd.9 v1:10.20.193.155:6805/976780597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f2e44160530 con 0x7f2e100a2850 2026-02-25T15:19:31.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e2affd640 10 client.27683.objecter ms_dispatch2 0x7f2e44000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:31.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e2affd640 10 client.27683.objecter _finish_command 2 = system:0 2026-02-25T15:19:31.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e2affd640 20 client.27683.objecter put_session s=0x7f2e100a21a0 osd=9 4 2026-02-25T15:19:31.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e2affd640 15 client.27683.objecter _session_command_op_remove 9 2 2026-02-25T15:19:31.610 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:31.610 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:31.610 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:31.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 10 librados: watch_flush enter 2026-02-25T15:19:31.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 10 librados: watch_flush exit 2026-02-25T15:19:31.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 10 client.27683.objecter close_session for osd.9 2026-02-25T15:19:31.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 >> v1:10.20.193.155:6805/976780597 conn(0x7f2e100a2850 legacy=0x7f2e100c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 20 client.27683.objecter put_session s=0x7f2e100a21a0 osd=9 1 2026-02-25T15:19:31.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 20 client.27683.objecter shutdown clearing up homeless session... 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 10 client.27683.objecter successfully canceled tick 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 >> v1:10.20.193.78:6800/3497602169 conn(0x7f2e10077ef0 legacy=0x7f2e100983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 10 monclient: shutdown 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 >> v1:10.20.193.167:6789/0 conn(0x7f2e441a5660 legacy=0x7f2e44056a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e42d76640 1 -- 10.20.193.78:0/1001418396 reap_dead start 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 shutdown_connections 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 >> 10.20.193.78:0/1001418396 conn(0x7f2e440b2f60 msgr2=0x7f2e440b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 shutdown_connections 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 1 -- 10.20.193.78:0/1001418396 wait complete. 2026-02-25T15:19:31.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.607+0000 7f2e48caa640 1 librados: shutdown 2026-02-25T15:19:31.617 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-25T15:19:31.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.685+0000 7f5156b6b640 10 monclient: get_monmap_and_config 2026-02-25T15:19:31.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.685+0000 7f5156b6b640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.685+0000 7f5156b6b640 10 monclient: monmap: 2026-02-25T15:19:31.688 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.688 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.688 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:31.686497+0000 2026-02-25T15:19:31.688 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:31.686497+0000 2026-02-25T15:19:31.688 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.689 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.689 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.689 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.689 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.689 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 1 Processor -- start 2026-02-25T15:19:31.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 1 -- start start 2026-02-25T15:19:31.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 10 monclient: init 2026-02-25T15:19:31.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:31.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 10 monclient(hunting): picked mon.noname-a con 0x7f5150157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 10 monclient(hunting): picked mon.noname-c con 0x7f5150157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 10 monclient(hunting): picked mon.noname-b con 0x7f5150164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f515005de70 con 0x7f5150157780 2026-02-25T15:19:31.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5150055b20 con 0x7f5150164d00 2026-02-25T15:19:31.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5150055e00 con 0x7f5150157b50 2026-02-25T15:19:31.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.686+0000 7f5156b6b640 10 monclient(hunting): authenticate will time out at 3741.275718s 2026-02-25T15:19:31.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.687+0000 7f51550e1640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f5150164d00 0x7f51501c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46160/0 (socket says 10.20.193.78:46160) 2026-02-25T15:19:31.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.687+0000 7f51550e1640 1 -- 10.20.193.78:0/3974452226 learned_addr learned my addr 10.20.193.78:0/3974452226 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071280652 0 0) 0x7f5150055b20 con 0x7f5150164d00 2026-02-25T15:19:31.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): my global_id is 30139 2026-02-25T15:19:31.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f513c003610 con 0x7f5150164d00 2026-02-25T15:19:31.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065832750 0 0) 0x7f5150055e00 con 0x7f5150157b50 2026-02-25T15:19:31.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): my global_id is 27686 2026-02-25T15:19:31.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5150055b20 con 0x7f5150157b50 2026-02-25T15:19:31.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980981705 0 0) 0x7f515005de70 con 0x7f5150157780 2026-02-25T15:19:31.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 10 monclient(hunting): my global_id is 30849 2026-02-25T15:19:31.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.688+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5150055e00 con 0x7f5150157780 2026-02-25T15:19:31.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 602585698 0 0) 0x7f513c003610 con 0x7f5150164d00 2026-02-25T15:19:31.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 >> v1:10.20.193.167:6789/0 conn(0x7f5150157b50 legacy=0x7f51501645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 >> v1:10.20.193.78:6789/0 conn(0x7f5150157780 legacy=0x7f5150056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 1 monclient: found mon.noname-b 2026-02-25T15:19:31.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:31.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51500560e0 con 0x7f5150164d00 2026-02-25T15:19:31.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f514c003170 con 0x7f5150164d00 2026-02-25T15:19:31.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f5156b6b640 5 monclient: authenticate success, global_id 30139 2026-02-25T15:19:31.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f5156b6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:31.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:31.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f51477fe640 10 monclient: dump: 2026-02-25T15:19:31.711 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.712 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.712 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.712 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.712 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.712 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.712 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.713 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.713 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.713 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.690+0000 7f5156b6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:31.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f514c0033c0 con 0x7f5150164d00 2026-02-25T15:19:31.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f51477fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f51477fe640 1 -- 10.20.193.78:0/3974452226 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f514c003800 con 0x7f5150164d00 2026-02-25T15:19:31.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:31.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 4 set_mon_vals no callback set 2026-02-25T15:19:31.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f51477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f51477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:31.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f51477fe640 10 monclient: dump: 2026-02-25T15:19:31.715 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.715 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.715 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.715 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.715 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.715 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.715 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.716 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.716 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.716 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 10 monclient: shutdown 2026-02-25T15:19:31.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 1 -- 10.20.193.78:0/3974452226 >> v1:10.20.193.155:6789/0 conn(0x7f5150164d00 legacy=0x7f51501c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 1 -- 10.20.193.78:0/3974452226 shutdown_connections 2026-02-25T15:19:31.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 1 -- 10.20.193.78:0/3974452226 >> 10.20.193.78:0/3974452226 conn(0x7f51500b2ef0 msgr2=0x7f51500b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 1 -- 10.20.193.78:0/3974452226 shutdown_connections 2026-02-25T15:19:31.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 1 -- 10.20.193.78:0/3974452226 wait complete. 2026-02-25T15:19:31.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.691+0000 7f5156b6b640 10 monclient: monmap: 2026-02-25T15:19:31.717 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.718 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:31.718 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:31.718 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:31.718 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.718 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:31.718 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.718 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.718 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.719 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 librados: starting msgr at 2026-02-25T15:19:31.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 librados: starting objecter 2026-02-25T15:19:31.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:31.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 Processor -- start 2026-02-25T15:19:31.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 -- start start 2026-02-25T15:19:31.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 librados: setting wanted keys 2026-02-25T15:19:31.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 librados: calling monclient init 2026-02-25T15:19:31.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 10 monclient: init 2026-02-25T15:19:31.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:31.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 10 monclient(hunting): picked mon.noname-c con 0x7f5150157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 10 monclient(hunting): picked mon.noname-a con 0x7f5150157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 10 monclient(hunting): picked mon.noname-b con 0x7f5150164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51501570f0 con 0x7f5150157b50 2026-02-25T15:19:31.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5150130790 con 0x7f5150164d00 2026-02-25T15:19:31.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5150130a70 con 0x7f5150157780 2026-02-25T15:19:31.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5156b6b640 10 monclient(hunting): authenticate will time out at 3741.281537s 2026-02-25T15:19:31.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5147fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5150157b50 0x7f5150132740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50406/0 (socket says 10.20.193.78:50406) 2026-02-25T15:19:31.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f5147fff640 1 -- 10.20.193.78:0/947936195 learned_addr learned my addr 10.20.193.78:0/947936195 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.692+0000 7f51457fa640 10 client.?.objecter ms_handle_connect 0x7f5150164d00 2026-02-25T15:19:31.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 client.?.objecter ms_handle_connect 0x7f5150157b50 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 client.?.objecter ms_handle_connect 0x7f5150157780 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2583377447 0 0) 0x7f5150130790 con 0x7f5150164d00 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 monclient(hunting): my global_id is 30142 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5120003610 con 0x7f5150164d00 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206300451 0 0) 0x7f51501570f0 con 0x7f5150157b50 2026-02-25T15:19:31.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 10 monclient(hunting): my global_id is 30852 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.693+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5150130790 con 0x7f5150157b50 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.694+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816549409 0 0) 0x7f5150130a70 con 0x7f5150157780 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.694+0000 7f51457fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.694+0000 7f51457fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.694+0000 7f51457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.694+0000 7f51457fa640 10 monclient(hunting): my global_id is 27689 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.694+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51501570f0 con 0x7f5150157780 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 347112264 0 0) 0x7f5150130790 con 0x7f5150157b50 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5150130a70 con 0x7f5150157b50 2026-02-25T15:19:31.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f51380030e0 con 0x7f5150157b50 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): dump: 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:31.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2547211960 0 0) 0x7f51501570f0 con 0x7f5150157780 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5150130790 con 0x7f5150157780 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5140003060 con 0x7f5150157780 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): dump: 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.725 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2557038561 0 0) 0x7f5120003610 con 0x7f5150164d00 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51501570f0 con 0x7f5150164d00 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f514c003710 con 0x7f5150164d00 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.696+0000 7f51457fa640 10 monclient(hunting): dump: 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.726 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1537524958 0 0) 0x7f5150130a70 con 0x7f5150157b50 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 >> v1:10.20.193.167:6789/0 conn(0x7f5150157780 legacy=0x7f5150134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 >> v1:10.20.193.155:6789/0 conn(0x7f5150164d00 legacy=0x7f5150132e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 1 monclient: found mon.a 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5150130d50 con 0x7f5150157b50 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f51457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 5 monclient: authenticate success, global_id 30852 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 10 monclient: _renew_subs 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5150131030 con 0x7f5150157b50 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 10 client.30852.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:31.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 10 monclient: _renew_subs 2026-02-25T15:19:31.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f51501315f0 con 0x7f5150157b50 2026-02-25T15:19:31.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 1 librados: init done 2026-02-25T15:19:31.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:31.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:31.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:31.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.698+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5150165700 con 0x7f5150157b50 2026-02-25T15:19:31.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.790+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5138003280 con 0x7f5150157b50 2026-02-25T15:19:31.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.790+0000 7f51457fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.790+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f51380039b0 con 0x7f5150157b50 2026-02-25T15:19:31.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.790+0000 7f51457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.790+0000 7f51457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.790+0000 7f51457fa640 10 monclient: dump: 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.790+0000 7f5146ffd640 4 set_mon_vals no callback set 2026-02-25T15:19:31.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.791+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f5138003b90 con 0x7f5150157b50 2026-02-25T15:19:31.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.791+0000 7f51548e0640 10 monclient: get_auth_request con 0x7f5120077df0 auth_method 0 2026-02-25T15:19:31.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.791+0000 7f51457fa640 10 client.30852.objecter ms_handle_connect 0x7f5120077df0 2026-02-25T15:19:31.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.794+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f51380931e0 con 0x7f5150157b50 2026-02-25T15:19:31.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.794+0000 7f51457fa640 10 client.30852.objecter ms_dispatch2 0x7f5150000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:31.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.794+0000 7f51457fa640 3 client.30852.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:31.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.794+0000 7f51457fa640 3 client.30852.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:31.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.794+0000 7f51457fa640 20 client.30852.objecter dump_active .. 0 homeless 2026-02-25T15:19:31.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.794+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f5150165700 con 0x7f5150157b50 2026-02-25T15:19:31.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.794+0000 7f51457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:31.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.794+0000 7f51457fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:31.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.899+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7f51500b55b0 con 0x7f5120077df0 2026-02-25T15:19:31.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.899+0000 7f51457fa640 1 -- 10.20.193.78:0/947936195 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (unknown 795720238 0 0) 0x7f51500b55b0 con 0x7f5120077df0 2026-02-25T15:19:31.902 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 9 to deep-scrub 2026-02-25T15:19:31.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 10 librados: watch_flush enter 2026-02-25T15:19:31.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 10 librados: watch_flush exit 2026-02-25T15:19:31.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 20 client.30852.objecter shutdown clearing up homeless session... 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 10 client.30852.objecter successfully canceled tick 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 >> v1:10.20.193.78:6800/3497602169 conn(0x7f5120077df0 legacy=0x7f51200982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 10 monclient: shutdown 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 >> v1:10.20.193.78:6789/0 conn(0x7f5150157b50 legacy=0x7f5150132740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 shutdown_connections 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 >> 10.20.193.78:0/947936195 conn(0x7f51500b2ef0 msgr2=0x7f5150138670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 shutdown_connections 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 1 -- 10.20.193.78:0/947936195 wait complete. 2026-02-25T15:19:31.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.901+0000 7f5156b6b640 1 librados: shutdown 2026-02-25T15:19:31.912 INFO:tasks.ceph:Scrubbing osd.13 2026-02-25T15:19:31.913 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:31.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.979+0000 7f6e98832640 10 monclient: get_monmap_and_config 2026-02-25T15:19:31.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.979+0000 7f6e98832640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.979+0000 7f6e98832640 10 monclient: monmap: 2026-02-25T15:19:31.981 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:31.979983+0000 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:31.979983+0000 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.982 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.979+0000 7f6e98832640 1 Processor -- start 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.979+0000 7f6e98832640 1 -- start start 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.979+0000 7f6e98832640 10 monclient: init 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 10 monclient(hunting): picked mon.noname-b con 0x7f6e9015e2a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 10 monclient(hunting): picked mon.noname-a con 0x7f6e90059e10 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 10 monclient(hunting): picked mon.noname-c con 0x7f6e901a5660 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e90162df0 con 0x7f6e90059e10 2026-02-25T15:19:31.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e901630d0 con 0x7f6e9015e2a0 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e901633b0 con 0x7f6e901a5660 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e98832640 10 monclient(hunting): authenticate will time out at 3741.569112s 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e965a7640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f6e9015e2a0 0x7f6e9005da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46178/0 (socket says 10.20.193.78:46178) 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.980+0000 7f6e965a7640 1 -- 10.20.193.78:0/4253101643 learned_addr learned my addr 10.20.193.78:0/4253101643 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900159640 0 0) 0x7f6e90162df0 con 0x7f6e90059e10 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 10 monclient(hunting): my global_id is 30855 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e80003610 con 0x7f6e90059e10 2026-02-25T15:19:31.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519284906 0 0) 0x7f6e901630d0 con 0x7f6e9015e2a0 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 10 monclient(hunting): my global_id is 30145 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.981+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e90162df0 con 0x7f6e9015e2a0 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.982+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2805849370 0 0) 0x7f6e901633b0 con 0x7f6e901a5660 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.982+0000 7f6e955a5640 10 monclient(hunting): _negotiate 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.982+0000 7f6e955a5640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.982+0000 7f6e955a5640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.982+0000 7f6e955a5640 10 monclient(hunting): my global_id is 27692 2026-02-25T15:19:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.982+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e901630d0 con 0x7f6e901a5660 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3034909333 0 0) 0x7f6e90162df0 con 0x7f6e9015e2a0 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 >> v1:10.20.193.167:6789/0 conn(0x7f6e901a5660 legacy=0x7f6e901c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 >> v1:10.20.193.78:6789/0 conn(0x7f6e90059e10 legacy=0x7f6e9015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 10 monclient: _finish_hunting 0 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 1 monclient: found mon.noname-b 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90163690 con 0x7f6e9015e2a0 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 10 monclient: _finish_auth 0 2026-02-25T15:19:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 10 monclient: _check_auth_tickets 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e88002d20 con 0x7f6e9015e2a0 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e98832640 5 monclient: authenticate success, global_id 30145 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e98832640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e955a5640 10 monclient: dump: 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.994 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.983+0000 7f6e98832640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e88002ef0 con 0x7f6e9015e2a0 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e955a5640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e955a5640 1 -- 10.20.193.78:0/4253101643 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e88003330 con 0x7f6e9015e2a0 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e955a5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e955a5640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e955a5640 10 monclient: dump: 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:31.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 4 set_mon_vals no callback set 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 10 monclient: shutdown 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 1 -- 10.20.193.78:0/4253101643 >> v1:10.20.193.155:6789/0 conn(0x7f6e9015e2a0 legacy=0x7f6e9005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 1 -- 10.20.193.78:0/4253101643 shutdown_connections 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 1 -- 10.20.193.78:0/4253101643 >> 10.20.193.78:0/4253101643 conn(0x7f6e900b2f60 msgr2=0x7f6e900b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 1 -- 10.20.193.78:0/4253101643 shutdown_connections 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.984+0000 7f6e98832640 1 -- 10.20.193.78:0/4253101643 wait complete. 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient: build_initial_monmap 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient: monmap: 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:31.997 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 librados: starting msgr at 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 librados: starting objecter 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 Processor -- start 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 -- start start 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 librados: setting wanted keys 2026-02-25T15:19:31.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 librados: calling monclient init 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient: init 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient(hunting): picked mon.noname-b con 0x7f6e90059e10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient(hunting): picked mon.noname-a con 0x7f6e9015e2a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient(hunting): picked mon.noname-c con 0x7f6e901a5660 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9018fcb0 con 0x7f6e9015e2a0 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9018ff90 con 0x7f6e90059e10 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e90190270 con 0x7f6e901a5660 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.985+0000 7f6e98832640 10 monclient(hunting): authenticate will time out at 3741.574980s 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e965a7640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f6e90059e10 0x7f6e9012b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46194/0 (socket says 10.20.193.78:46194) 2026-02-25T15:19:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e965a7640 1 -- 10.20.193.78:0/2716177902 learned_addr learned my addr 10.20.193.78:0/2716177902 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e95da6640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6e9015e2a0 0x7f6e90127100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50430/0 (socket says 10.20.193.78:50430) 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e7affd640 10 client.?.objecter ms_handle_connect 0x7f6e9015e2a0 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e7affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e7affd640 10 client.?.objecter ms_handle_connect 0x7f6e901a5660 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e7affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e7affd640 10 client.?.objecter ms_handle_connect 0x7f6e90059e10 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.986+0000 7f6e7affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728608538 0 0) 0x7f6e9018fcb0 con 0x7f6e9015e2a0 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): my global_id is 30858 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e60003610 con 0x7f6e9015e2a0 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927279021 0 0) 0x7f6e9018ff90 con 0x7f6e90059e10 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): my global_id is 30148 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e9018fcb0 con 0x7f6e90059e10 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442048595 0 0) 0x7f6e90190270 con 0x7f6e901a5660 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 10 monclient(hunting): my global_id is 27695 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.987+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e9018ff90 con 0x7f6e901a5660 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.989+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2772240785 0 0) 0x7f6e60003610 con 0x7f6e9015e2a0 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.989+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e90190270 con 0x7f6e9015e2a0 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.989+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e7c003010 con 0x7f6e9015e2a0 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.989+0000 7f6e7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.989+0000 7f6e7affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.989+0000 7f6e7affd640 10 monclient(hunting): dump: 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.002 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.989+0000 7f6e7affd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 213845341 0 0) 0x7f6e9018fcb0 con 0x7f6e90059e10 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e60003610 con 0x7f6e90059e10 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e88003240 con 0x7f6e90059e10 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 10 monclient(hunting): dump: 2026-02-25T15:19:32.003 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4024474533 0 0) 0x7f6e9018ff90 con 0x7f6e901a5660 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e9018fcb0 con 0x7f6e901a5660 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e84003410 con 0x7f6e901a5660 2026-02-25T15:19:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.990+0000 7f6e7affd640 10 monclient(hunting): dump: 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.005 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 894525756 0 0) 0x7f6e90190270 con 0x7f6e9015e2a0 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 >> v1:10.20.193.167:6789/0 conn(0x7f6e901a5660 legacy=0x7f6e900a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 >> v1:10.20.193.155:6789/0 conn(0x7f6e90059e10 legacy=0x7f6e9012b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 1 monclient: found mon.a 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90190550 con 0x7f6e9015e2a0 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 5 monclient: authenticate success, global_id 30858 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 10 monclient: _renew_subs 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e90190830 con 0x7f6e9015e2a0 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 10 client.30858.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 10 monclient: _renew_subs 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e90191030 con 0x7f6e9015e2a0 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 1 librados: init done 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 10 client.30858.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 15 client.30858.objecter _session_command_op_assign -1 1 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 20 client.30858.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:32.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 10 client.30858.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:31.991+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6e90192bc0 con 0x7f6e9015e2a0 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.000+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e90192bc0 con 0x7f6e9015e2a0 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.000+0000 7f6e7affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.000+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6e7c0038a0 con 0x7f6e9015e2a0 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.000+0000 7f6e7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.000+0000 7f6e7affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.000+0000 7f6e7affd640 10 monclient: dump: 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.011 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.000+0000 7f6e94da4640 4 set_mon_vals no callback set 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.000+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6e7c003a80 con 0x7f6e9015e2a0 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.001+0000 7f6e965a7640 10 monclient: get_auth_request con 0x7f6e60077dd0 auth_method 0 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.001+0000 7f6e7affd640 10 client.30858.objecter ms_handle_connect 0x7f6e60077dd0 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f6e7c092e60 con 0x7f6e9015e2a0 2026-02-25T15:19:32.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 10 client.30858.objecter ms_dispatch2 0x7f6e90000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 3 client.30858.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 3 client.30858.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 10 client.30858.objecter checking command 1 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 20 client.30858.objecter _get_session s=0x7f6e600a2080 osd=13 3 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 20 client.30858.objecter put_session s=0x7f6e600a2080 osd=13 3 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 15 client.30858.objecter _session_command_op_remove -1 1 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 20 client.30858.objecter _get_session s=0x7f6e600a2080 osd=13 3 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 20 client.30858.objecter get_session s=0x7f6e600a2080 osd=13 3 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 15 client.30858.objecter _session_command_op_assign 13 1 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 20 client.30858.objecter put_session s=0x7f6e600a2080 osd=13 4 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 10 client.30858.objecter _send_command 1 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.155:6800/4105183277 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e600c4390 con 0x7f6e600a2730 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 20 client.30858.objecter dump_active .. 0 homeless 2026-02-25T15:19:32.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f6e7c059500 con 0x7f6e9015e2a0 2026-02-25T15:19:32.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e7affd640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:32.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.002+0000 7f6e96da8640 10 monclient: get_auth_request con 0x7f6e600a2730 auth_method 0 2026-02-25T15:19:32.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.003+0000 7f6e7affd640 10 client.30858.objecter ms_handle_connect 0x7f6e600a2730 2026-02-25T15:19:32.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.012+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== osd.13 v1:10.20.193.155:6800/4105183277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6e600c4390 con 0x7f6e600a2730 2026-02-25T15:19:32.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.012+0000 7f6e7affd640 10 client.30858.objecter ms_dispatch2 0x7f6e90000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:32.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.012+0000 7f6e7affd640 10 client.30858.objecter _finish_command 1 = system:0 2026-02-25T15:19:32.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.012+0000 7f6e7affd640 20 client.30858.objecter put_session s=0x7f6e600a2080 osd=13 4 2026-02-25T15:19:32.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.012+0000 7f6e7affd640 15 client.30858.objecter _session_command_op_remove 13 1 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 10 client.30858.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 15 client.30858.objecter _session_command_op_assign -1 2 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 20 client.30858.objecter _get_session s=0x7f6e600a2080 osd=13 3 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 20 client.30858.objecter put_session s=0x7f6e600a2080 osd=13 3 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 20 client.30858.objecter _get_session s=0x7f6e600a2080 osd=13 3 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 15 client.30858.objecter _session_command_op_remove -1 2 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 20 client.30858.objecter get_session s=0x7f6e600a2080 osd=13 3 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 15 client.30858.objecter _session_command_op_assign 13 2 2026-02-25T15:19:32.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 20 client.30858.objecter put_session s=0x7f6e600a2080 osd=13 4 2026-02-25T15:19:32.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 10 client.30858.objecter _send_command 2 2026-02-25T15:19:32.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.020+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 --> v1:10.20.193.155:6800/4105183277 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6e90165170 con 0x7f6e600a2730 2026-02-25T15:19:32.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e7affd640 1 -- 10.20.193.78:0/2716177902 <== osd.13 v1:10.20.193.155:6800/4105183277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6e90165170 con 0x7f6e600a2730 2026-02-25T15:19:32.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e7affd640 10 client.30858.objecter ms_dispatch2 0x7f6e90000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:32.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e7affd640 10 client.30858.objecter _finish_command 2 = system:0 2026-02-25T15:19:32.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e7affd640 20 client.30858.objecter put_session s=0x7f6e600a2080 osd=13 4 2026-02-25T15:19:32.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e7affd640 15 client.30858.objecter _session_command_op_remove 13 2 2026-02-25T15:19:32.031 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:32.031 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:32.032 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:32.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 10 librados: watch_flush enter 2026-02-25T15:19:32.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 10 librados: watch_flush exit 2026-02-25T15:19:32.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 10 client.30858.objecter close_session for osd.13 2026-02-25T15:19:32.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 >> v1:10.20.193.155:6800/4105183277 conn(0x7f6e600a2730 legacy=0x7f6e600c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 20 client.30858.objecter put_session s=0x7f6e600a2080 osd=13 1 2026-02-25T15:19:32.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 20 client.30858.objecter shutdown clearing up homeless session... 2026-02-25T15:19:32.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 10 client.30858.objecter successfully canceled tick 2026-02-25T15:19:32.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6e60077dd0 legacy=0x7f6e60098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 10 monclient: shutdown 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 >> v1:10.20.193.78:6789/0 conn(0x7f6e9015e2a0 legacy=0x7f6e90127100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e96da8640 1 -- 10.20.193.78:0/2716177902 reap_dead start 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 shutdown_connections 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 >> 10.20.193.78:0/2716177902 conn(0x7f6e900b2f60 msgr2=0x7f6e90195ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 shutdown_connections 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 1 -- 10.20.193.78:0/2716177902 wait complete. 2026-02-25T15:19:32.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.028+0000 7f6e98832640 1 librados: shutdown 2026-02-25T15:19:32.039 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-25T15:19:32.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.104+0000 7f91b1e54640 10 monclient: get_monmap_and_config 2026-02-25T15:19:32.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.104+0000 7f91b1e54640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.104+0000 7f91b1e54640 10 monclient: monmap: 2026-02-25T15:19:32.107 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.107 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.107 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:32.105164+0000 2026-02-25T15:19:32.107 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:32.105164+0000 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.104+0000 7f91b1e54640 1 Processor -- start 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.104+0000 7f91b1e54640 1 -- start start 2026-02-25T15:19:32.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.104+0000 7f91b1e54640 10 monclient: init 2026-02-25T15:19:32.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:32.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 10 monclient(hunting): picked mon.noname-c con 0x7f91ac157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 10 monclient(hunting): picked mon.noname-a con 0x7f91ac157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 10 monclient(hunting): picked mon.noname-b con 0x7f91ac164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac05de70 con 0x7f91ac157b50 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac055b20 con 0x7f91ac164d00 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac055e00 con 0x7f91ac157780 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91b1e54640 10 monclient(hunting): authenticate will time out at 3741.694476s 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91ab7fe640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f91ac157780 0x7f91ac056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47916/0 (socket says 10.20.193.78:47916) 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.105+0000 7f91ab7fe640 1 -- 10.20.193.78:0/1822188130 learned_addr learned my addr 10.20.193.78:0/1822188130 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9191758 0 0) 0x7f91ac055e00 con 0x7f91ac157780 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): my global_id is 27698 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9190003610 con 0x7f91ac157780 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520012173 0 0) 0x7f91ac055b20 con 0x7f91ac164d00 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): my global_id is 30151 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ac055e00 con 0x7f91ac164d00 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726714740 0 0) 0x7f91ac05de70 con 0x7f91ac157b50 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 10 monclient(hunting): my global_id is 30861 2026-02-25T15:19:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.107+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ac055b20 con 0x7f91ac157b50 2026-02-25T15:19:32.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1876224990 0 0) 0x7f9190003610 con 0x7f91ac157780 2026-02-25T15:19:32.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 >> v1:10.20.193.155:6789/0 conn(0x7f91ac164d00 legacy=0x7f91ac1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 >> v1:10.20.193.78:6789/0 conn(0x7f91ac157b50 legacy=0x7f91ac1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 1 monclient: found mon.noname-c 2026-02-25T15:19:32.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:32.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac0560e0 con 0x7f91ac157780 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9198002df0 con 0x7f91ac157780 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91aa7fc640 10 monclient: dump: 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.119 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91b1e54640 5 monclient: authenticate success, global_id 27698 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.108+0000 7f91b1e54640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.109+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9198002fc0 con 0x7f91ac157780 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.109+0000 7f91aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.109+0000 7f91aa7fc640 1 -- 10.20.193.78:0/1822188130 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9198003400 con 0x7f91ac157780 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.109+0000 7f91aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.109+0000 7f91aa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.109+0000 7f91aa7fc640 10 monclient: dump: 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.121 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.109+0000 7f91b1e54640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.109+0000 7f91b1e54640 4 set_mon_vals no callback set 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 10 monclient: shutdown 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 -- 10.20.193.78:0/1822188130 >> v1:10.20.193.167:6789/0 conn(0x7f91ac157780 legacy=0x7f91ac056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 -- 10.20.193.78:0/1822188130 shutdown_connections 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 -- 10.20.193.78:0/1822188130 >> 10.20.193.78:0/1822188130 conn(0x7f91ac0b2ef0 msgr2=0x7f91ac0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 -- 10.20.193.78:0/1822188130 shutdown_connections 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 -- 10.20.193.78:0/1822188130 wait complete. 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 10 monclient: monmap: 2026-02-25T15:19:32.122 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 librados: starting msgr at 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 librados: starting objecter 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:32.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 Processor -- start 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 -- start start 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 librados: setting wanted keys 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 1 librados: calling monclient init 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.110+0000 7f91b1e54640 10 monclient: init 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 10 monclient(hunting): picked mon.noname-b con 0x7f91ac157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 10 monclient(hunting): picked mon.noname-c con 0x7f91ac157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 10 monclient(hunting): picked mon.noname-a con 0x7f91ac164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac1612e0 con 0x7f91ac164d00 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac1615c0 con 0x7f91ac157780 2026-02-25T15:19:32.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac1458b0 con 0x7f91ac157b50 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91b1e54640 10 monclient(hunting): authenticate will time out at 3741.700351s 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91abfff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f91ac164d00 0x7f91ac1220f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50440/0 (socket says 10.20.193.78:50440) 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91ab7fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f91ac157780 0x7f91ac146390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46206/0 (socket says 10.20.193.78:46206) 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91abfff640 1 -- 10.20.193.78:0/1625551810 learned_addr learned my addr 10.20.193.78:0/1625551810 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f91aaffd640 1 --1- 10.20.193.78:0/1625551810 >> v1:10.20.193.167:6789/0 conn(0x7f91ac157b50 0x7f91ac1476f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47920/0 (socket says 10.20.193.78:47920) 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f9187fff640 10 client.?.objecter ms_handle_connect 0x7f91ac164d00 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f9187fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f9187fff640 10 client.?.objecter ms_handle_connect 0x7f91ac157b50 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f9187fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f9187fff640 10 client.?.objecter ms_handle_connect 0x7f91ac157780 2026-02-25T15:19:32.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.111+0000 7f9187fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007760798 0 0) 0x7f91ac1612e0 con 0x7f91ac164d00 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 10 monclient(hunting): my global_id is 30864 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917c003610 con 0x7f91ac164d00 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76155261 0 0) 0x7f91ac1458b0 con 0x7f91ac157b50 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 10 monclient(hunting): my global_id is 27701 2026-02-25T15:19:32.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.112+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ac1612e0 con 0x7f91ac157b50 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.113+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830551326 0 0) 0x7f91ac1615c0 con 0x7f91ac157780 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.113+0000 7f9187fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.113+0000 7f9187fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.113+0000 7f9187fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.113+0000 7f9187fff640 10 monclient(hunting): my global_id is 30154 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.113+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ac1458b0 con 0x7f91ac157780 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.114+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1083727682 0 0) 0x7f917c003610 con 0x7f91ac164d00 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.114+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91ac1615c0 con 0x7f91ac164d00 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.114+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f91a00033f0 con 0x7f91ac164d00 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.114+0000 7f9187fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.114+0000 7f9187fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.114+0000 7f9187fff640 10 monclient(hunting): dump: 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.127 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3605024506 0 0) 0x7f91ac1612e0 con 0x7f91ac157b50 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f917c003610 con 0x7f91ac157b50 2026-02-25T15:19:32.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f919c0030b0 con 0x7f91ac157b50 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 10 monclient(hunting): dump: 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.129 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1975584782 0 0) 0x7f91ac1458b0 con 0x7f91ac157780 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91ac1612e0 con 0x7f91ac157780 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9198003310 con 0x7f91ac157780 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.115+0000 7f9187fff640 10 monclient(hunting): dump: 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.130 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.131 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.131 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.131 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1109212743 0 0) 0x7f91ac1615c0 con 0x7f91ac164d00 2026-02-25T15:19:32.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 >> v1:10.20.193.167:6789/0 conn(0x7f91ac157b50 legacy=0x7f91ac1476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 >> v1:10.20.193.155:6789/0 conn(0x7f91ac157780 legacy=0x7f91ac146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 1 monclient: found mon.a 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac145b90 con 0x7f91ac164d00 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f9187fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 5 monclient: authenticate success, global_id 30864 2026-02-25T15:19:32.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 10 monclient: _renew_subs 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac145e70 con 0x7f91ac164d00 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 10 client.30864.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 10 monclient: _renew_subs 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f91ac160fc0 con 0x7f91ac164d00 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.116+0000 7f91b1e54640 1 librados: init done 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.117+0000 7f91b1e54640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.117+0000 7f91b1e54640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.117+0000 7f91b1e54640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.117+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ac165740 con 0x7f91ac164d00 2026-02-25T15:19:32.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.125+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91a0003a80 con 0x7f91ac164d00 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.125+0000 7f9187fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.125+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f91a0003e90 con 0x7f91ac164d00 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.125+0000 7f9187fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.125+0000 7f9187fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.125+0000 7f9187fff640 10 monclient: dump: 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.136 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.125+0000 7f91a9ffb640 4 set_mon_vals no callback set 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.126+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f91a0004070 con 0x7f91ac164d00 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.126+0000 7f91ab7fe640 10 monclient: get_auth_request con 0x7f917c077ed0 auth_method 0 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.126+0000 7f9187fff640 10 client.30864.objecter ms_handle_connect 0x7f917c077ed0 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.127+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f91a00934a0 con 0x7f91ac164d00 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.127+0000 7f9187fff640 10 client.30864.objecter ms_dispatch2 0x7f91ac000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.127+0000 7f9187fff640 3 client.30864.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.127+0000 7f9187fff640 3 client.30864.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:32.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.127+0000 7f9187fff640 20 client.30864.objecter dump_active .. 0 homeless 2026-02-25T15:19:32.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.214+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f91ac165740 con 0x7f91ac164d00 2026-02-25T15:19:32.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.214+0000 7f9187fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.214+0000 7f9187fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:32.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.324+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7f91ac05e250 con 0x7f917c077ed0 2026-02-25T15:19:32.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.324+0000 7f9187fff640 1 -- 10.20.193.78:0/1625551810 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (unknown 1087616222 0 0) 0x7f91ac05e250 con 0x7f917c077ed0 2026-02-25T15:19:32.327 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 13 to deep-scrub 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.325+0000 7f91b1e54640 10 librados: watch_flush enter 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.325+0000 7f91b1e54640 10 librados: watch_flush exit 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.325+0000 7f91b1e54640 20 client.30864.objecter shutdown clearing up homeless session... 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.325+0000 7f91b1e54640 10 client.30864.objecter successfully canceled tick 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.325+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 >> v1:10.20.193.78:6800/3497602169 conn(0x7f917c077ed0 legacy=0x7f917c098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.325+0000 7f91b1e54640 10 monclient: shutdown 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.325+0000 7f91b1e54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.325+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 >> v1:10.20.193.78:6789/0 conn(0x7f91ac164d00 legacy=0x7f91ac1220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.326+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 shutdown_connections 2026-02-25T15:19:32.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.326+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 >> 10.20.193.78:0/1625551810 conn(0x7f91ac0b2ef0 msgr2=0x7f91ac1385b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.326+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 shutdown_connections 2026-02-25T15:19:32.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.326+0000 7f91b1e54640 1 -- 10.20.193.78:0/1625551810 wait complete. 2026-02-25T15:19:32.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.326+0000 7f91b1e54640 1 librados: shutdown 2026-02-25T15:19:32.337 INFO:tasks.ceph:Scrubbing osd.2 2026-02-25T15:19:32.338 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:32.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.405+0000 7fe1b576f640 10 monclient: get_monmap_and_config 2026-02-25T15:19:32.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.405+0000 7fe1b576f640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.405+0000 7fe1b576f640 10 monclient: monmap: 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:32.406164+0000 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:32.406164+0000 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.408 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.405+0000 7fe1b576f640 1 Processor -- start 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.405+0000 7fe1b576f640 1 -- start start 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.405+0000 7fe1b576f640 10 monclient: init 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 10 monclient(hunting): picked mon.noname-c con 0x7fe1b015e2a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 10 monclient(hunting): picked mon.noname-a con 0x7fe1b0059e10 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 10 monclient(hunting): picked mon.noname-b con 0x7fe1b01a5660 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b0162df0 con 0x7fe1b0059e10 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b01630d0 con 0x7fe1b01a5660 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b01633b0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1b576f640 10 monclient(hunting): authenticate will time out at 3741.995287s 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1af7fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fe1b01a5660 0x7fe1b01c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46210/0 (socket says 10.20.193.78:46210) 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1af7fe640 1 -- 10.20.193.78:0/2192624091 learned_addr learned my addr 10.20.193.78:0/2192624091 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.406+0000 7fe1aeffd640 1 --1- 10.20.193.78:0/2192624091 >> v1:10.20.193.167:6789/0 conn(0x7fe1b015e2a0 0x7fe1b005da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:47934/0 (socket says 10.20.193.78:47934) 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277521577 0 0) 0x7fe1b01633b0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): my global_id is 27704 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe19c003610 con 0x7fe1b015e2a0 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792940842 0 0) 0x7fe1b0162df0 con 0x7fe1b0059e10 2026-02-25T15:19:32.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): my global_id is 30867 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b01633b0 con 0x7fe1b0059e10 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699927235 0 0) 0x7fe1b01630d0 con 0x7fe1b01a5660 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 10 monclient(hunting): my global_id is 30157 2026-02-25T15:19:32.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.408+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b0162df0 con 0x7fe1b01a5660 2026-02-25T15:19:32.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3767520225 0 0) 0x7fe19c003610 con 0x7fe1b015e2a0 2026-02-25T15:19:32.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 >> v1:10.20.193.155:6789/0 conn(0x7fe1b01a5660 legacy=0x7fe1b01c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 >> v1:10.20.193.78:6789/0 conn(0x7fe1b0059e10 legacy=0x7fe1b015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 1 monclient: found mon.noname-c 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b0163690 con 0x7fe1b015e2a0 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1a4002df0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1b576f640 5 monclient: authenticate success, global_id 27704 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:32.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1adffb640 10 monclient: dump: 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.409+0000 7fe1b576f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1a4002fc0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1adffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1adffb640 1 -- 10.20.193.78:0/2192624091 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1a4003400 con 0x7fe1b015e2a0 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1b576f640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1b576f640 4 set_mon_vals no callback set 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1adffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1adffb640 10 monclient: dump: 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.422 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1b576f640 10 monclient: shutdown 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1b576f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1b576f640 1 -- 10.20.193.78:0/2192624091 >> v1:10.20.193.167:6789/0 conn(0x7fe1b015e2a0 legacy=0x7fe1b005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1b576f640 1 -- 10.20.193.78:0/2192624091 shutdown_connections 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1b576f640 1 -- 10.20.193.78:0/2192624091 >> 10.20.193.78:0/2192624091 conn(0x7fe1b00b2f60 msgr2=0x7fe1b00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.410+0000 7fe1b576f640 1 -- 10.20.193.78:0/2192624091 shutdown_connections 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.411+0000 7fe1b576f640 1 -- 10.20.193.78:0/2192624091 wait complete. 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.411+0000 7fe1b576f640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.411+0000 7fe1b576f640 10 monclient: monmap: 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.424 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.411+0000 7fe1b576f640 1 librados: starting msgr at 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.411+0000 7fe1b576f640 1 librados: starting objecter 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.411+0000 7fe1b576f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.411+0000 7fe1b576f640 1 Processor -- start 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 1 -- start start 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 1 librados: setting wanted keys 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 1 librados: calling monclient init 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 10 monclient: init 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 10 monclient(hunting): picked mon.noname-a con 0x7fe1b0059e10 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 10 monclient(hunting): picked mon.noname-b con 0x7fe1b015e2a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 10 monclient(hunting): picked mon.noname-c con 0x7fe1b01a5660 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b0128560 con 0x7fe1b0059e10 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b0128840 con 0x7fe1b015e2a0 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b0194470 con 0x7fe1b01a5660 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1b576f640 10 monclient(hunting): authenticate will time out at 3742.001545s 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1ae7fc640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fe1b015e2a0 0x7fe1b0127ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46214/0 (socket says 10.20.193.78:46214) 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.412+0000 7fe1ae7fc640 1 -- 10.20.193.78:0/3528233390 learned_addr learned my addr 10.20.193.78:0/3528233390 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 client.?.objecter ms_handle_connect 0x7fe1b015e2a0 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 client.?.objecter ms_handle_connect 0x7fe1b0059e10 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 client.?.objecter ms_handle_connect 0x7fe1b01a5660 2026-02-25T15:19:32.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379240873 0 0) 0x7fe1b0128840 con 0x7fe1b015e2a0 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 10 monclient(hunting): my global_id is 30160 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.413+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17c003610 con 0x7fe1b015e2a0 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033764860 0 0) 0x7fe1b0128560 con 0x7fe1b0059e10 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 10 monclient(hunting): my global_id is 30870 2026-02-25T15:19:32.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b0128840 con 0x7fe1b0059e10 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026101233 0 0) 0x7fe1b0194470 con 0x7fe1b01a5660 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 10 monclient(hunting): my global_id is 27707 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.414+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b0128560 con 0x7fe1b01a5660 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1292095482 0 0) 0x7fe17c003610 con 0x7fe1b015e2a0 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1b0194470 con 0x7fe1b015e2a0 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1980030f0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:32.428 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3415417440 0 0) 0x7fe1b0128560 con 0x7fe1b01a5660 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe17c003610 con 0x7fe1b01a5660 2026-02-25T15:19:32.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1a0003410 con 0x7fe1b01a5660 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.430 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2397124636 0 0) 0x7fe1b0128840 con 0x7fe1b0059e10 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1b0128560 con 0x7fe1b0059e10 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1a4003310 con 0x7fe1b0059e10 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.416+0000 7fe18f7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.431 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.432 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.432 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 383154007 0 0) 0x7fe1b0194470 con 0x7fe1b015e2a0 2026-02-25T15:19:32.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 >> v1:10.20.193.167:6789/0 conn(0x7fe1b01a5660 legacy=0x7fe1b0195230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 >> v1:10.20.193.78:6789/0 conn(0x7fe1b0059e10 legacy=0x7fe1b01a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 1 monclient: found mon.b 2026-02-25T15:19:32.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b0194750 con 0x7fe1b015e2a0 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe18f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe1b576f640 5 monclient: authenticate success, global_id 30160 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe1b576f640 10 monclient: _renew_subs 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe1b576f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.417+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b0194a30 con 0x7fe1b015e2a0 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 10 client.30160.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 10 monclient: _renew_subs 2026-02-25T15:19:32.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe1b00b2b70 con 0x7fe1b015e2a0 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 1 librados: init done 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 10 client.30160.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 15 client.30160.objecter _session_command_op_assign -1 1 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 20 client.30160.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 10 client.30160.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.418+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe1b01609c0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.426+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1b01609c0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.426+0000 7fe18f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.426+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fe1980039b0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.426+0000 7fe18f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.426+0000 7fe18f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.426+0000 7fe18f7fe640 10 monclient: dump: 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.426+0000 7fe1ad7fa640 4 set_mon_vals no callback set 2026-02-25T15:19:32.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.427+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fe198003b80 con 0x7fe1b015e2a0 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.428+0000 7fe1aeffd640 10 monclient: get_auth_request con 0x7fe17c077e20 auth_method 0 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.428+0000 7fe18f7fe640 10 client.30160.objecter ms_handle_connect 0x7fe17c077e20 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fe198093040 con 0x7fe1b015e2a0 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 10 client.30160.objecter ms_dispatch2 0x7fe1b0000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 3 client.30160.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 3 client.30160.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 10 client.30160.objecter checking command 1 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 20 client.30160.objecter _get_session s=0x7fe17c0a20d0 osd=2 3 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 20 client.30160.objecter put_session s=0x7fe17c0a20d0 osd=2 3 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 15 client.30160.objecter _session_command_op_remove -1 1 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 20 client.30160.objecter _get_session s=0x7fe17c0a20d0 osd=2 3 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 20 client.30160.objecter get_session s=0x7fe17c0a20d0 osd=2 3 2026-02-25T15:19:32.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 15 client.30160.objecter _session_command_op_assign 2 1 2026-02-25T15:19:32.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 20 client.30160.objecter put_session s=0x7fe17c0a20d0 osd=2 4 2026-02-25T15:19:32.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 10 client.30160.objecter _send_command 1 2026-02-25T15:19:32.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.167:6808/3985671893 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe17c0c43e0 con 0x7fe17c0a2780 2026-02-25T15:19:32.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 20 client.30160.objecter dump_active .. 0 homeless 2026-02-25T15:19:32.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7fe1980596e0 con 0x7fe1b015e2a0 2026-02-25T15:19:32.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.429+0000 7fe18f7fe640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:32.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.430+0000 7fe1af7fe640 10 monclient: get_auth_request con 0x7fe17c0a2780 auth_method 0 2026-02-25T15:19:32.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.431+0000 7fe18f7fe640 10 client.30160.objecter ms_handle_connect 0x7fe17c0a2780 2026-02-25T15:19:32.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.440+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== osd.2 v1:10.20.193.167:6808/3985671893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe17c0c43e0 con 0x7fe17c0a2780 2026-02-25T15:19:32.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.440+0000 7fe18f7fe640 10 client.30160.objecter ms_dispatch2 0x7fe1b0000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:32.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.440+0000 7fe18f7fe640 10 client.30160.objecter _finish_command 1 = system:0 2026-02-25T15:19:32.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.440+0000 7fe18f7fe640 20 client.30160.objecter put_session s=0x7fe17c0a20d0 osd=2 4 2026-02-25T15:19:32.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.440+0000 7fe18f7fe640 15 client.30160.objecter _session_command_op_remove 2 1 2026-02-25T15:19:32.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 10 client.30160.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:32.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 15 client.30160.objecter _session_command_op_assign -1 2 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 20 client.30160.objecter _get_session s=0x7fe17c0a20d0 osd=2 3 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 20 client.30160.objecter put_session s=0x7fe17c0a20d0 osd=2 3 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 20 client.30160.objecter _get_session s=0x7fe17c0a20d0 osd=2 3 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 15 client.30160.objecter _session_command_op_remove -1 2 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 20 client.30160.objecter get_session s=0x7fe17c0a20d0 osd=2 3 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 15 client.30160.objecter _session_command_op_assign 2 2 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 20 client.30160.objecter put_session s=0x7fe17c0a20d0 osd=2 4 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 10 client.30160.objecter _send_command 2 2026-02-25T15:19:32.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.448+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 --> v1:10.20.193.167:6808/3985671893 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe1b01606e0 con 0x7fe17c0a2780 2026-02-25T15:19:32.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe18f7fe640 1 -- 10.20.193.78:0/3528233390 <== osd.2 v1:10.20.193.167:6808/3985671893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe1b01606e0 con 0x7fe17c0a2780 2026-02-25T15:19:32.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe18f7fe640 10 client.30160.objecter ms_dispatch2 0x7fe1b0000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:32.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe18f7fe640 10 client.30160.objecter _finish_command 2 = system:0 2026-02-25T15:19:32.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe18f7fe640 20 client.30160.objecter put_session s=0x7fe17c0a20d0 osd=2 4 2026-02-25T15:19:32.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe18f7fe640 15 client.30160.objecter _session_command_op_remove 2 2 2026-02-25T15:19:32.459 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:32.459 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:32.459 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:32.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 10 librados: watch_flush enter 2026-02-25T15:19:32.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 10 librados: watch_flush exit 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 10 client.30160.objecter close_session for osd.2 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 >> v1:10.20.193.167:6808/3985671893 conn(0x7fe17c0a2780 legacy=0x7fe17c0c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 20 client.30160.objecter put_session s=0x7fe17c0a20d0 osd=2 1 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 20 client.30160.objecter shutdown clearing up homeless session... 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 10 client.30160.objecter successfully canceled tick 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 >> v1:10.20.193.78:6800/3497602169 conn(0x7fe17c077e20 legacy=0x7fe17c0982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 10 monclient: shutdown 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 >> v1:10.20.193.155:6789/0 conn(0x7fe1b015e2a0 legacy=0x7fe1b0127ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1af7fe640 1 -- 10.20.193.78:0/3528233390 reap_dead start 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 shutdown_connections 2026-02-25T15:19:32.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 >> 10.20.193.78:0/3528233390 conn(0x7fe1b00b2f60 msgr2=0x7fe1b00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 shutdown_connections 2026-02-25T15:19:32.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 1 -- 10.20.193.78:0/3528233390 wait complete. 2026-02-25T15:19:32.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.456+0000 7fe1b576f640 1 librados: shutdown 2026-02-25T15:19:32.466 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-25T15:19:32.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.529+0000 7f7a75e74640 10 monclient: get_monmap_and_config 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.529+0000 7f7a75e74640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.529+0000 7f7a75e74640 10 monclient: monmap: 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:32.530763+0000 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:32.530763+0000 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.533 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.534 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 1 Processor -- start 2026-02-25T15:19:32.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 1 -- start start 2026-02-25T15:19:32.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 10 monclient: init 2026-02-25T15:19:32.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 10 monclient(hunting): picked mon.noname-c con 0x7f7a70157780 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 10 monclient(hunting): picked mon.noname-a con 0x7f7a70157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 10 monclient(hunting): picked mon.noname-b con 0x7f7a70164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7005de70 con 0x7f7a70157b50 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a70055b20 con 0x7f7a70164d00 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a70055e00 con 0x7f7a70157780 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.530+0000 7f7a75e74640 10 monclient(hunting): authenticate will time out at 3742.119895s 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.531+0000 7f7a6effd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7a70157b50 0x7f7a701645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50464/0 (socket says 10.20.193.78:50464) 2026-02-25T15:19:32.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.531+0000 7f7a6effd640 1 -- 10.20.193.78:0/2408457238 learned_addr learned my addr 10.20.193.78:0/2408457238 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355640250 0 0) 0x7f7a7005de70 con 0x7f7a70157b50 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): my global_id is 30873 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a54003610 con 0x7f7a70157b50 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720769056 0 0) 0x7f7a70055e00 con 0x7f7a70157780 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): my global_id is 27710 2026-02-25T15:19:32.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a7005de70 con 0x7f7a70157780 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232380044 0 0) 0x7f7a70055b20 con 0x7f7a70164d00 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 10 monclient(hunting): my global_id is 30163 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.532+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a70055e00 con 0x7f7a70164d00 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 657778432 0 0) 0x7f7a54003610 con 0x7f7a70157b50 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 >> v1:10.20.193.167:6789/0 conn(0x7f7a70157780 legacy=0x7f7a70056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 >> v1:10.20.193.155:6789/0 conn(0x7f7a70164d00 legacy=0x7f7a701c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 1 monclient: found mon.noname-a 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a700560e0 con 0x7f7a70157b50 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a60002df0 con 0x7f7a70157b50 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a6e7fc640 10 monclient: dump: 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.541 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a75e74640 5 monclient: authenticate success, global_id 30873 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.534+0000 7f7a75e74640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a60002fc0 con 0x7f7a70157b50 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a6e7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a6e7fc640 1 -- 10.20.193.78:0/2408457238 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a60003400 con 0x7f7a70157b50 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:32.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 4 set_mon_vals no callback set 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a6e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a6e7fc640 10 monclient: dump: 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.543 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.544 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 10 monclient: shutdown 2026-02-25T15:19:32.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 1 -- 10.20.193.78:0/2408457238 >> v1:10.20.193.78:6789/0 conn(0x7f7a70157b50 legacy=0x7f7a701645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 1 -- 10.20.193.78:0/2408457238 shutdown_connections 2026-02-25T15:19:32.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 1 -- 10.20.193.78:0/2408457238 >> 10.20.193.78:0/2408457238 conn(0x7f7a700b2ef0 msgr2=0x7f7a700b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 1 -- 10.20.193.78:0/2408457238 shutdown_connections 2026-02-25T15:19:32.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 1 -- 10.20.193.78:0/2408457238 wait complete. 2026-02-25T15:19:32.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.535+0000 7f7a75e74640 10 monclient: monmap: 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.550 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 librados: starting msgr at 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 librados: starting objecter 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 Processor -- start 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 -- start start 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 librados: setting wanted keys 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 librados: calling monclient init 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 10 monclient: init 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:32.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 10 monclient(hunting): picked mon.noname-b con 0x7f7a70157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 10 monclient(hunting): picked mon.noname-a con 0x7f7a70157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 10 monclient(hunting): picked mon.noname-c con 0x7f7a70164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a70161c80 con 0x7f7a70157b50 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7013bf30 con 0x7f7a70157780 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a700a71f0 con 0x7f7a70164d00 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a75e74640 10 monclient(hunting): authenticate will time out at 3742.125551s 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a6f7fe640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f7a70157780 0x7f7a701479f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46236/0 (socket says 10.20.193.78:46236) 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.536+0000 7f7a6f7fe640 1 -- 10.20.193.78:0/621757804 learned_addr learned my addr 10.20.193.78:0/621757804 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 client.?.objecter ms_handle_connect 0x7f7a70164d00 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 client.?.objecter ms_handle_connect 0x7f7a70157780 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 client.?.objecter ms_handle_connect 0x7f7a70157b50 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820038023 0 0) 0x7f7a700a71f0 con 0x7f7a70164d00 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.537+0000 7f7a4bfff640 10 monclient(hunting): my global_id is 27713 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a40003610 con 0x7f7a70164d00 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663651940 0 0) 0x7f7a7013bf30 con 0x7f7a70157780 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 10 monclient(hunting): my global_id is 30166 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a700a71f0 con 0x7f7a70157780 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721261364 0 0) 0x7f7a70161c80 con 0x7f7a70157b50 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 10 monclient(hunting): my global_id is 30876 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.538+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a7013bf30 con 0x7f7a70157b50 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 592266092 0 0) 0x7f7a700a71f0 con 0x7f7a70157780 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a70161c80 con 0x7f7a70157780 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a5c003170 con 0x7f7a70157780 2026-02-25T15:19:32.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 10 monclient(hunting): dump: 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1777450228 0 0) 0x7f7a7013bf30 con 0x7f7a70157b50 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a700a71f0 con 0x7f7a70157b50 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a60003310 con 0x7f7a70157b50 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.541+0000 7f7a4bfff640 10 monclient(hunting): dump: 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.556 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2591422024 0 0) 0x7f7a40003610 con 0x7f7a70164d00 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a7013bf30 con 0x7f7a70164d00 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a64003330 con 0x7f7a70164d00 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 10 monclient(hunting): dump: 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.557 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3501683262 0 0) 0x7f7a700a71f0 con 0x7f7a70157b50 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 >> v1:10.20.193.167:6789/0 conn(0x7f7a70164d00 legacy=0x7f7a70136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 >> v1:10.20.193.155:6789/0 conn(0x7f7a70157780 legacy=0x7f7a701479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 1 monclient: found mon.a 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a700a74d0 con 0x7f7a70157b50 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 5 monclient: authenticate success, global_id 30876 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 10 monclient: _renew_subs 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a700a77b0 con 0x7f7a70157b50 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 10 client.30876.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 10 monclient: _renew_subs 2026-02-25T15:19:32.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a701474d0 con 0x7f7a70157b50 2026-02-25T15:19:32.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.542+0000 7f7a75e74640 1 librados: init done 2026-02-25T15:19:32.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.543+0000 7f7a75e74640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.543+0000 7f7a75e74640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.543+0000 7f7a75e74640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:32.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.543+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a700b5750 con 0x7f7a70157b50 2026-02-25T15:19:32.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.551+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a60002f40 con 0x7f7a70157b50 2026-02-25T15:19:32.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.551+0000 7f7a4bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.551+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f7a60004d20 con 0x7f7a70157b50 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.551+0000 7f7a4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.551+0000 7f7a4bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.551+0000 7f7a4bfff640 10 monclient: dump: 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.562 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.551+0000 7f7a6dffb640 4 set_mon_vals no callback set 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.551+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f7a6001db90 con 0x7f7a70157b50 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.552+0000 7f7a6f7fe640 10 monclient: get_auth_request con 0x7f7a40077ef0 auth_method 0 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.552+0000 7f7a4bfff640 10 client.30876.objecter ms_handle_connect 0x7f7a40077ef0 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.552+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f7a60093010 con 0x7f7a70157b50 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.552+0000 7f7a4bfff640 10 client.30876.objecter ms_dispatch2 0x7f7a70000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.552+0000 7f7a4bfff640 3 client.30876.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.552+0000 7f7a4bfff640 3 client.30876.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:32.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.552+0000 7f7a4bfff640 20 client.30876.objecter dump_active .. 0 homeless 2026-02-25T15:19:32.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.638+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7a6005da40 con 0x7f7a70157b50 2026-02-25T15:19:32.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.638+0000 7f7a4bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.638+0000 7f7a4bfff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:32.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.743+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f7a700b5470 con 0x7f7a40077ef0 2026-02-25T15:19:32.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.743+0000 7f7a4bfff640 1 -- 10.20.193.78:0/621757804 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f7a700b5470 con 0x7f7a40077ef0 2026-02-25T15:19:32.746 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 2 to deep-scrub 2026-02-25T15:19:32.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 10 librados: watch_flush enter 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 10 librados: watch_flush exit 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 20 client.30876.objecter shutdown clearing up homeless session... 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 10 client.30876.objecter successfully canceled tick 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7a40077ef0 legacy=0x7f7a400983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 10 monclient: shutdown 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 >> v1:10.20.193.78:6789/0 conn(0x7f7a70157b50 legacy=0x7f7a7013b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 shutdown_connections 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 >> 10.20.193.78:0/621757804 conn(0x7f7a700b2ef0 msgr2=0x7f7a700b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 shutdown_connections 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 1 -- 10.20.193.78:0/621757804 wait complete. 2026-02-25T15:19:32.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.744+0000 7f7a75e74640 1 librados: shutdown 2026-02-25T15:19:32.755 INFO:tasks.ceph:Scrubbing osd.6 2026-02-25T15:19:32.755 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.822+0000 7fd6e4a01640 10 monclient: get_monmap_and_config 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.822+0000 7fd6e4a01640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.822+0000 7fd6e4a01640 10 monclient: monmap: 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:32.823568+0000 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:32.823568+0000 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.825 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.826 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.826 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.826 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.826 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 1 Processor -- start 2026-02-25T15:19:32.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 1 -- start start 2026-02-25T15:19:32.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 10 monclient: init 2026-02-25T15:19:32.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:32.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 10 monclient(hunting): picked mon.noname-c con 0x7fd6e015e2a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 10 monclient(hunting): picked mon.noname-b con 0x7fd6e0059e10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 10 monclient(hunting): picked mon.noname-a con 0x7fd6e01a5660 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e0162df0 con 0x7fd6e01a5660 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e01630d0 con 0x7fd6e0059e10 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e01633b0 con 0x7fd6e015e2a0 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.823+0000 7fd6e4a01640 10 monclient(hunting): authenticate will time out at 3742.412758s 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.824+0000 7fd6ddd74640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fd6e0059e10 0x7fd6e015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46238/0 (socket says 10.20.193.78:46238) 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.824+0000 7fd6ddd74640 1 -- 10.20.193.78:0/661144039 learned_addr learned my addr 10.20.193.78:0/661144039 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822777984 0 0) 0x7fd6e01630d0 con 0x7fd6e0059e10 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): my global_id is 30169 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6cc003610 con 0x7fd6e0059e10 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046486005 0 0) 0x7fd6e0162df0 con 0x7fd6e01a5660 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): my global_id is 30879 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6e01630d0 con 0x7fd6e01a5660 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637201746 0 0) 0x7fd6e01633b0 con 0x7fd6e015e2a0 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.830 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 10 monclient(hunting): my global_id is 27716 2026-02-25T15:19:32.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.825+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6e0162df0 con 0x7fd6e015e2a0 2026-02-25T15:19:32.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3045351477 0 0) 0x7fd6cc003610 con 0x7fd6e0059e10 2026-02-25T15:19:32.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 >> v1:10.20.193.167:6789/0 conn(0x7fd6e015e2a0 legacy=0x7fd6e005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 >> v1:10.20.193.78:6789/0 conn(0x7fd6e01a5660 legacy=0x7fd6e01c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 1 monclient: found mon.noname-b 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e0163690 con 0x7fd6e0059e10 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd6c8002df0 con 0x7fd6e0059e10 2026-02-25T15:19:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: dump: 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.838 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6e4a01640 5 monclient: authenticate success, global_id 30169 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6e4a01640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6c8002fc0 con 0x7fd6e0059e10 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 1 -- 10.20.193.78:0/661144039 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd6c8003400 con 0x7fd6e0059e10 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6dd573640 10 monclient: dump: 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.839 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6e4a01640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.827+0000 7fd6e4a01640 4 set_mon_vals no callback set 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 10 monclient: shutdown 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 1 -- 10.20.193.78:0/661144039 >> v1:10.20.193.155:6789/0 conn(0x7fd6e0059e10 legacy=0x7fd6e015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 1 -- 10.20.193.78:0/661144039 shutdown_connections 2026-02-25T15:19:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 1 -- 10.20.193.78:0/661144039 >> 10.20.193.78:0/661144039 conn(0x7fd6e00b2f60 msgr2=0x7fd6e00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 1 -- 10.20.193.78:0/661144039 shutdown_connections 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 1 -- 10.20.193.78:0/661144039 wait complete. 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.828+0000 7fd6e4a01640 10 monclient: monmap: 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.841 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 librados: starting msgr at 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 librados: starting objecter 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 Processor -- start 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 -- start start 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 librados: setting wanted keys 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 librados: calling monclient init 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 10 monclient: init 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 10 monclient(hunting): picked mon.noname-c con 0x7fd6e0059e10 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 10 monclient(hunting): picked mon.noname-a con 0x7fd6e015e2a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 10 monclient(hunting): picked mon.noname-b con 0x7fd6e01a5660 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e012af90 con 0x7fd6e015e2a0 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e0120ee0 con 0x7fd6e01a5660 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e00573c0 con 0x7fd6e0059e10 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6e4a01640 10 monclient(hunting): authenticate will time out at 3742.418643s 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6ddd74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd6e015e2a0 0x7fd6e005c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:50484/0 (socket says 10.20.193.78:50484) 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.829+0000 7fd6ddd74640 1 -- 10.20.193.78:0/3973521837 learned_addr learned my addr 10.20.193.78:0/3973521837 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.830+0000 7fd6c6ffd640 10 client.?.objecter ms_handle_connect 0x7fd6e015e2a0 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.830+0000 7fd6c6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.830+0000 7fd6c6ffd640 10 client.?.objecter ms_handle_connect 0x7fd6e0059e10 2026-02-25T15:19:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.830+0000 7fd6c6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.830+0000 7fd6c6ffd640 10 client.?.objecter ms_handle_connect 0x7fd6e01a5660 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.830+0000 7fd6c6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338402727 0 0) 0x7fd6e012af90 con 0x7fd6e015e2a0 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): my global_id is 30882 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ac003610 con 0x7fd6e015e2a0 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493750169 0 0) 0x7fd6e00573c0 con 0x7fd6e0059e10 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): my global_id is 27719 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6e012af90 con 0x7fd6e0059e10 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174108630 0 0) 0x7fd6e0120ee0 con 0x7fd6e01a5660 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 10 monclient(hunting): my global_id is 30172 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.831+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6e00573c0 con 0x7fd6e01a5660 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4194827135 0 0) 0x7fd6e012af90 con 0x7fd6e0059e10 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6e0120ee0 con 0x7fd6e0059e10 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd6d4003060 con 0x7fd6e0059e10 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2947491806 0 0) 0x7fd6ac003610 con 0x7fd6e015e2a0 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6e012af90 con 0x7fd6e015e2a0 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd6c8003310 con 0x7fd6e015e2a0 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.833+0000 7fd6c6ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.847 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.834+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 976503369 0 0) 0x7fd6e00573c0 con 0x7fd6e01a5660 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.834+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6ac003610 con 0x7fd6e01a5660 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.834+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd6d0003430 con 0x7fd6e01a5660 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.834+0000 7fd6c6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.834+0000 7fd6c6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.834+0000 7fd6c6ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.848 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.849 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.849 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.849 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.849 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.849 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.849 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.849 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1134841380 0 0) 0x7fd6e0120ee0 con 0x7fd6e0059e10 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 >> v1:10.20.193.155:6789/0 conn(0x7fd6e01a5660 legacy=0x7fd6e01207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 >> v1:10.20.193.78:6789/0 conn(0x7fd6e015e2a0 legacy=0x7fd6e005c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 1 monclient: found mon.c 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e00576a0 con 0x7fd6e0059e10 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 5 monclient: authenticate success, global_id 27719 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 10 monclient: _renew_subs 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e0057980 con 0x7fd6e0059e10 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 10 client.27719.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 10 monclient: _renew_subs 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd6e005bbb0 con 0x7fd6e0059e10 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 1 librados: init done 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 10 client.27719.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 15 client.27719.objecter _session_command_op_assign -1 1 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 20 client.27719.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 10 client.27719.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.835+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd6e0057c60 con 0x7fd6e0059e10 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.840+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6e0057c60 con 0x7fd6e0059e10 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.840+0000 7fd6c6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.840+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd6d40038a0 con 0x7fd6e0059e10 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.840+0000 7fd6c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.840+0000 7fd6c6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.840+0000 7fd6dcd72640 4 set_mon_vals no callback set 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.840+0000 7fd6c6ffd640 10 monclient: dump: 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.855 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.843+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fd6d401c570 con 0x7fd6e0059e10 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.844+0000 7fd6ddd74640 10 monclient: get_auth_request con 0x7fd6ac077dd0 auth_method 0 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.844+0000 7fd6c6ffd640 10 client.27719.objecter ms_handle_connect 0x7fd6ac077dd0 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fd6d4091cf0 con 0x7fd6e0059e10 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 10 client.27719.objecter ms_dispatch2 0x7fd6e0000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 3 client.27719.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:32.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 3 client.27719.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 10 client.27719.objecter checking command 1 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 20 client.27719.objecter _get_session s=0x7fd6ac0a2080 osd=6 3 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 20 client.27719.objecter put_session s=0x7fd6ac0a2080 osd=6 3 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 15 client.27719.objecter _session_command_op_remove -1 1 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 20 client.27719.objecter _get_session s=0x7fd6ac0a2080 osd=6 3 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 20 client.27719.objecter get_session s=0x7fd6ac0a2080 osd=6 3 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 15 client.27719.objecter _session_command_op_assign 6 1 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 20 client.27719.objecter put_session s=0x7fd6ac0a2080 osd=6 4 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 10 client.27719.objecter _send_command 1 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.167:6812/762620751 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6ac0c4430 con 0x7fd6ac0a2730 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 20 client.27719.objecter dump_active .. 0 homeless 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6ded76640 10 monclient: get_auth_request con 0x7fd6ac0a2730 auth_method 0 2026-02-25T15:19:32.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7fd6d4058390 con 0x7fd6e0059e10 2026-02-25T15:19:32.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.845+0000 7fd6c6ffd640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:32.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.846+0000 7fd6c6ffd640 10 client.27719.objecter ms_handle_connect 0x7fd6ac0a2730 2026-02-25T15:19:32.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.856+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== osd.6 v1:10.20.193.167:6812/762620751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd6ac0c4430 con 0x7fd6ac0a2730 2026-02-25T15:19:32.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.856+0000 7fd6c6ffd640 10 client.27719.objecter ms_dispatch2 0x7fd6e0000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:32.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.856+0000 7fd6c6ffd640 10 client.27719.objecter _finish_command 1 = system:0 2026-02-25T15:19:32.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.856+0000 7fd6c6ffd640 20 client.27719.objecter put_session s=0x7fd6ac0a2080 osd=6 4 2026-02-25T15:19:32.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.856+0000 7fd6c6ffd640 15 client.27719.objecter _session_command_op_remove 6 1 2026-02-25T15:19:32.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 10 client.27719.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:32.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 15 client.27719.objecter _session_command_op_assign -1 2 2026-02-25T15:19:32.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 20 client.27719.objecter _get_session s=0x7fd6ac0a2080 osd=6 3 2026-02-25T15:19:32.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 20 client.27719.objecter put_session s=0x7fd6ac0a2080 osd=6 3 2026-02-25T15:19:32.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 20 client.27719.objecter _get_session s=0x7fd6ac0a2080 osd=6 3 2026-02-25T15:19:32.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 15 client.27719.objecter _session_command_op_remove -1 2 2026-02-25T15:19:32.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 20 client.27719.objecter get_session s=0x7fd6ac0a2080 osd=6 3 2026-02-25T15:19:32.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 15 client.27719.objecter _session_command_op_assign 6 2 2026-02-25T15:19:32.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 20 client.27719.objecter put_session s=0x7fd6ac0a2080 osd=6 4 2026-02-25T15:19:32.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 10 client.27719.objecter _send_command 2 2026-02-25T15:19:32.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.863+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 --> v1:10.20.193.167:6812/762620751 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6e01645f0 con 0x7fd6ac0a2730 2026-02-25T15:19:32.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6c6ffd640 1 -- 10.20.193.78:0/3973521837 <== osd.6 v1:10.20.193.167:6812/762620751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd6e01645f0 con 0x7fd6ac0a2730 2026-02-25T15:19:32.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6c6ffd640 10 client.27719.objecter ms_dispatch2 0x7fd6e0000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:32.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6c6ffd640 10 client.27719.objecter _finish_command 2 = system:0 2026-02-25T15:19:32.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6c6ffd640 20 client.27719.objecter put_session s=0x7fd6ac0a2080 osd=6 4 2026-02-25T15:19:32.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6c6ffd640 15 client.27719.objecter _session_command_op_remove 6 2 2026-02-25T15:19:32.874 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:32.874 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:32.874 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 10 librados: watch_flush enter 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 10 librados: watch_flush exit 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 10 client.27719.objecter close_session for osd.6 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 >> v1:10.20.193.167:6812/762620751 conn(0x7fd6ac0a2730 legacy=0x7fd6ac0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 20 client.27719.objecter put_session s=0x7fd6ac0a2080 osd=6 1 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 20 client.27719.objecter shutdown clearing up homeless session... 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 10 client.27719.objecter successfully canceled tick 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 >> v1:10.20.193.78:6800/3497602169 conn(0x7fd6ac077dd0 legacy=0x7fd6ac098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 10 monclient: shutdown 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 >> v1:10.20.193.167:6789/0 conn(0x7fd6e0059e10 legacy=0x7fd6e0056bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6ded76640 1 -- 10.20.193.78:0/3973521837 reap_dead start 2026-02-25T15:19:32.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 shutdown_connections 2026-02-25T15:19:32.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 >> 10.20.193.78:0/3973521837 conn(0x7fd6e00b2f60 msgr2=0x7fd6e00b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 shutdown_connections 2026-02-25T15:19:32.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 1 -- 10.20.193.78:0/3973521837 wait complete. 2026-02-25T15:19:32.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.871+0000 7fd6e4a01640 1 librados: shutdown 2026-02-25T15:19:32.881 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-25T15:19:32.947 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.945+0000 7f802ea54640 10 monclient: get_monmap_and_config 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.945+0000 7f802ea54640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.945+0000 7f802ea54640 10 monclient: monmap: 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:32.946496+0000 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:32.946496+0000 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.948 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 1 Processor -- start 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 1 -- start start 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 10 monclient: init 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 10 monclient(hunting): picked mon.noname-a con 0x7f8028157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 10 monclient(hunting): picked mon.noname-c con 0x7f8028157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 10 monclient(hunting): picked mon.noname-b con 0x7f8028164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802805de70 con 0x7f8028157780 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028055b20 con 0x7f8028164d00 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028055e00 con 0x7f8028157b50 2026-02-25T15:19:32.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802ea54640 10 monclient(hunting): authenticate will time out at 3742.535656s 2026-02-25T15:19:32.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.946+0000 7f802cfca640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f8028164d00 0x7f80281c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46256/0 (socket says 10.20.193.78:46256) 2026-02-25T15:19:32.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.947+0000 7f802cfca640 1 -- 10.20.193.78:0/4212321454 learned_addr learned my addr 10.20.193.78:0/4212321454 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1667496904 0 0) 0x7f8028055b20 con 0x7f8028164d00 2026-02-25T15:19:32.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 10 monclient(hunting): my global_id is 30175 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f800c003610 con 0x7f8028164d00 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1169712546 0 0) 0x7f802805de70 con 0x7f8028157780 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 10 monclient(hunting): my global_id is 30885 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.948+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8028055b20 con 0x7f8028157780 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220724227 0 0) 0x7f8028055e00 con 0x7f8028157b50 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient(hunting): my global_id is 27722 2026-02-25T15:19:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f802805de70 con 0x7f8028157b50 2026-02-25T15:19:32.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2516472150 0 0) 0x7f800c003610 con 0x7f8028164d00 2026-02-25T15:19:32.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 >> v1:10.20.193.167:6789/0 conn(0x7f8028157b50 legacy=0x7f80281645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 >> v1:10.20.193.78:6789/0 conn(0x7f8028157780 legacy=0x7f8028056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 1 monclient: found mon.noname-b 2026-02-25T15:19:32.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80280560e0 con 0x7f8028164d00 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f801c003170 con 0x7f8028164d00 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f8026ffd640 10 monclient: dump: 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f802ea54640 5 monclient: authenticate success, global_id 30175 2026-02-25T15:19:32.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.949+0000 7f802ea54640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f801c003340 con 0x7f8028164d00 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f8026ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f8026ffd640 1 -- 10.20.193.78:0/4212321454 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f801c003780 con 0x7f8028164d00 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f8026ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f8026ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f8026ffd640 10 monclient: dump: 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.955 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f802ea54640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f802ea54640 4 set_mon_vals no callback set 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f802ea54640 10 monclient: shutdown 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f802ea54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.950+0000 7f802ea54640 1 -- 10.20.193.78:0/4212321454 >> v1:10.20.193.155:6789/0 conn(0x7f8028164d00 legacy=0x7f80281c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 -- 10.20.193.78:0/4212321454 shutdown_connections 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 -- 10.20.193.78:0/4212321454 >> 10.20.193.78:0/4212321454 conn(0x7f80280b2ef0 msgr2=0x7f80280b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 -- 10.20.193.78:0/4212321454 shutdown_connections 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 -- 10.20.193.78:0/4212321454 wait complete. 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 10 monclient: build_initial_monmap 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 10 monclient: monmap: 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:32.956 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 librados: starting msgr at 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 librados: starting objecter 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 Processor -- start 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 -- start start 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 librados: setting wanted keys 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 1 librados: calling monclient init 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.951+0000 7f802ea54640 10 monclient: init 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 10 monclient(hunting): picked mon.noname-b con 0x7f8028157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 10 monclient(hunting): picked mon.noname-a con 0x7f8028157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 10 monclient(hunting): picked mon.noname-c con 0x7f8028164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028149740 con 0x7f8028157b50 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028149460 con 0x7f8028157780 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80280aae10 con 0x7f8028164d00 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f802ea54640 10 monclient(hunting): authenticate will time out at 3742.541208s 2026-02-25T15:19:32.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f8027fff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f8028157780 0x7f802813c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46262/0 (socket says 10.20.193.78:46262) 2026-02-25T15:19:32.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f8027fff640 1 -- 10.20.193.78:0/3041480126 learned_addr learned my addr 10.20.193.78:0/3041480126 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:32.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f8024ff9640 10 client.?.objecter ms_handle_connect 0x7f8028157780 2026-02-25T15:19:32.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f8024ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f8024ff9640 10 client.?.objecter ms_handle_connect 0x7f8028164d00 2026-02-25T15:19:32.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f8024ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f8024ff9640 10 client.?.objecter ms_handle_connect 0x7f8028157b50 2026-02-25T15:19:32.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.952+0000 7f8024ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367622965 0 0) 0x7f8028149460 con 0x7f8028157780 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): my global_id is 30178 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff8003610 con 0x7f8028157780 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546113783 0 0) 0x7f80280aae10 con 0x7f8028164d00 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): my global_id is 27725 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8028149460 con 0x7f8028164d00 2026-02-25T15:19:32.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2249243506 0 0) 0x7f8028149740 con 0x7f8028157b50 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 10 monclient(hunting): my global_id is 30888 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.953+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80280aae10 con 0x7f8028157b50 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.955+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3567173422 0 0) 0x7f7ff8003610 con 0x7f8028157780 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.955+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8028149740 con 0x7f8028157780 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.955+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8014003190 con 0x7f8028157780 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.955+0000 7f8024ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.955+0000 7f8024ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.955+0000 7f8024ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.961 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.955+0000 7f8024ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 670648796 0 0) 0x7f8028149460 con 0x7f8028164d00 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ff8003610 con 0x7f8028164d00 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f801c003690 con 0x7f8028164d00 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3278948343 0 0) 0x7f80280aae10 con 0x7f8028157b50 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8028149460 con 0x7f8028157b50 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8018003060 con 0x7f8028157b50 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:32.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.956+0000 7f8024ff9640 10 monclient(hunting): dump: 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 890705363 0 0) 0x7f8028149740 con 0x7f8028157780 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 >> v1:10.20.193.167:6789/0 conn(0x7f8028164d00 legacy=0x7f80280acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 >> v1:10.20.193.78:6789/0 conn(0x7f8028157b50 legacy=0x7f8028147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 1 monclient: found mon.b 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80280ab0f0 con 0x7f8028157780 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 10 monclient: _finish_auth 0 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:19:32.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f8024ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 5 monclient: authenticate success, global_id 30178 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 10 monclient: _renew_subs 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f80280ab3d0 con 0x7f8028157780 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 10 client.30178.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 10 monclient: _renew_subs 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8028133020 con 0x7f8028157780 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 1 librados: init done 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:32.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.957+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802805d760 con 0x7f8028157780 2026-02-25T15:19:32.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.965+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80140034e0 con 0x7f8028157780 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.965+0000 7f8024ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.965+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8014003b50 con 0x7f8028157780 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.965+0000 7f8024ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.965+0000 7f8024ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.965+0000 7f80267fc640 4 set_mon_vals no callback set 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.965+0000 7f8024ff9640 10 monclient: dump: 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:32.968 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:32.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.966+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f8014003d30 con 0x7f8028157780 2026-02-25T15:19:32.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.967+0000 7f80277fe640 10 monclient: get_auth_request con 0x7f7ff8077dd0 auth_method 0 2026-02-25T15:19:32.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.967+0000 7f8024ff9640 10 client.30178.objecter ms_handle_connect 0x7f7ff8077dd0 2026-02-25T15:19:32.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.967+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f8014093260 con 0x7f8028157780 2026-02-25T15:19:32.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.967+0000 7f8024ff9640 10 client.30178.objecter ms_dispatch2 0x7f8028000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:32.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.967+0000 7f8024ff9640 3 client.30178.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:32.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.967+0000 7f8024ff9640 3 client.30178.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:32.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:32.967+0000 7f8024ff9640 20 client.30178.objecter dump_active .. 0 homeless 2026-02-25T15:19:33.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.052+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f801405dc90 con 0x7f8028157780 2026-02-25T15:19:33.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.052+0000 7f8024ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.052+0000 7f8024ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:33.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.157+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f80281332b0 con 0x7f7ff8077dd0 2026-02-25T15:19:33.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.157+0000 7f8024ff9640 1 -- 10.20.193.78:0/3041480126 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7f8018005890 con 0x7f7ff8077dd0 2026-02-25T15:19:33.160 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 6 to deep-scrub 2026-02-25T15:19:33.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 10 librados: watch_flush enter 2026-02-25T15:19:33.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 10 librados: watch_flush exit 2026-02-25T15:19:33.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 20 client.30178.objecter shutdown clearing up homeless session... 2026-02-25T15:19:33.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 10 client.30178.objecter successfully canceled tick 2026-02-25T15:19:33.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 >> v1:10.20.193.78:6800/3497602169 conn(0x7f7ff8077dd0 legacy=0x7f7ff8098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 10 monclient: shutdown 2026-02-25T15:19:33.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:33.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 >> v1:10.20.193.155:6789/0 conn(0x7f8028157780 legacy=0x7f802813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 shutdown_connections 2026-02-25T15:19:33.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 >> 10.20.193.78:0/3041480126 conn(0x7f80280b2ef0 msgr2=0x7f802813dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:33.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 shutdown_connections 2026-02-25T15:19:33.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 1 -- 10.20.193.78:0/3041480126 wait complete. 2026-02-25T15:19:33.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.158+0000 7f802ea54640 1 librados: shutdown 2026-02-25T15:19:33.170 INFO:tasks.ceph:Scrubbing osd.10 2026-02-25T15:19:33.170 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:33.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.239+0000 7f490d7bb640 10 monclient: get_monmap_and_config 2026-02-25T15:19:33.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.239+0000 7f490d7bb640 10 monclient: build_initial_monmap 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.239+0000 7f490d7bb640 10 monclient: monmap: 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:33.240074+0000 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:33.240074+0000 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:33.242 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:33.243 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.239+0000 7f490d7bb640 1 Processor -- start 2026-02-25T15:19:33.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.239+0000 7f490d7bb640 1 -- start start 2026-02-25T15:19:33.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.239+0000 7f490d7bb640 10 monclient: init 2026-02-25T15:19:33.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:33.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 10 monclient(hunting): picked mon.noname-b con 0x7f490815e2a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 10 monclient(hunting): picked mon.noname-c con 0x7f4908059e10 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 10 monclient(hunting): picked mon.noname-a con 0x7f49081a5660 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4908162df0 con 0x7f49081a5660 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49081630d0 con 0x7f490815e2a0 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49081633b0 con 0x7f4908059e10 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f490d7bb640 10 monclient(hunting): authenticate will time out at 3742.829283s 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f49067fc640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f4908059e10 0x7f490815ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41616/0 (socket says 10.20.193.78:41616) 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f49077fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f49081a5660 0x7f49081c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40592/0 (socket says 10.20.193.78:40592) 2026-02-25T15:19:33.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.240+0000 7f49067fc640 1 -- 10.20.193.78:0/4100155112 learned_addr learned my addr 10.20.193.78:0/4100155112 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179763665 0 0) 0x7f49081633b0 con 0x7f4908059e10 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): my global_id is 27728 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f4003610 con 0x7f4908059e10 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119643790 0 0) 0x7f4908162df0 con 0x7f49081a5660 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): my global_id is 30891 2026-02-25T15:19:33.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49081633b0 con 0x7f49081a5660 2026-02-25T15:19:33.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022789406 0 0) 0x7f49081630d0 con 0x7f490815e2a0 2026-02-25T15:19:33.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 10 monclient(hunting): my global_id is 30181 2026-02-25T15:19:33.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.242+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4908162df0 con 0x7f490815e2a0 2026-02-25T15:19:33.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2988282591 0 0) 0x7f48f4003610 con 0x7f4908059e10 2026-02-25T15:19:33.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 >> v1:10.20.193.155:6789/0 conn(0x7f490815e2a0 legacy=0x7f490805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 >> v1:10.20.193.78:6789/0 conn(0x7f49081a5660 legacy=0x7f49081c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:33.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 1 monclient: found mon.noname-c 2026-02-25T15:19:33.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:33.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4908163690 con 0x7f4908059e10 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f490d7bb640 5 monclient: authenticate success, global_id 27728 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f48f0002df0 con 0x7f4908059e10 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f490d7bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f4905ffb640 10 monclient: dump: 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.257 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.243+0000 7f490d7bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48f0002fc0 con 0x7f4908059e10 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f4905ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:33.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f4905ffb640 1 -- 10.20.193.78:0/4100155112 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f48f0003400 con 0x7f4908059e10 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 4 set_mon_vals no callback set 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f4905ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f4905ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f4905ffb640 10 monclient: dump: 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.259 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 10 monclient: shutdown 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 1 -- 10.20.193.78:0/4100155112 >> v1:10.20.193.167:6789/0 conn(0x7f4908059e10 legacy=0x7f490815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 1 -- 10.20.193.78:0/4100155112 shutdown_connections 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 1 -- 10.20.193.78:0/4100155112 >> 10.20.193.78:0/4100155112 conn(0x7f49080b2f60 msgr2=0x7f49080b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 1 -- 10.20.193.78:0/4100155112 shutdown_connections 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.244+0000 7f490d7bb640 1 -- 10.20.193.78:0/4100155112 wait complete. 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient: build_initial_monmap 2026-02-25T15:19:33.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient: monmap: 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 librados: starting msgr at 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 librados: starting objecter 2026-02-25T15:19:33.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 Processor -- start 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 -- start start 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 librados: setting wanted keys 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 librados: calling monclient init 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient: init 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient(hunting): picked mon.noname-c con 0x7f4908059e10 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient(hunting): picked mon.noname-b con 0x7f490815e2a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient(hunting): picked mon.noname-a con 0x7f49081a5660 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49080a9310 con 0x7f49081a5660 2026-02-25T15:19:33.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490812e0d0 con 0x7f490815e2a0 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490812e3b0 con 0x7f4908059e10 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.245+0000 7f490d7bb640 10 monclient(hunting): authenticate will time out at 3742.834904s 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.246+0000 7f4906ffd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f4908059e10 0x7f490805bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41626/0 (socket says 10.20.193.78:41626) 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.246+0000 7f49077fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f49081a5660 0x7f490812d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40606/0 (socket says 10.20.193.78:40606) 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.246+0000 7f4906ffd640 1 -- 10.20.193.78:0/875163960 learned_addr learned my addr 10.20.193.78:0/875163960 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.246+0000 7f48e77fe640 10 client.?.objecter ms_handle_connect 0x7f49081a5660 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.246+0000 7f48e77fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.246+0000 7f48e77fe640 10 client.?.objecter ms_handle_connect 0x7f4908059e10 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.246+0000 7f48e77fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 client.?.objecter ms_handle_connect 0x7f490815e2a0 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985923409 0 0) 0x7f49080a9310 con 0x7f49081a5660 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 monclient(hunting): my global_id is 30894 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d4003610 con 0x7f49081a5660 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047256496 0 0) 0x7f490812e3b0 con 0x7f4908059e10 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 10 monclient(hunting): my global_id is 27731 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.247+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49080a9310 con 0x7f4908059e10 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.248+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174051567 0 0) 0x7f490812e0d0 con 0x7f490815e2a0 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.248+0000 7f48e77fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.248+0000 7f48e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.248+0000 7f48e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.248+0000 7f48e77fe640 10 monclient(hunting): my global_id is 30184 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.248+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f490812e3b0 con 0x7f490815e2a0 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.249+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 384508827 0 0) 0x7f48d4003610 con 0x7f49081a5660 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.249+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f490812e0d0 con 0x7f49081a5660 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.249+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f48f8003430 con 0x7f49081a5660 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.249+0000 7f48e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.249+0000 7f48e77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.249+0000 7f48e77fe640 10 monclient(hunting): dump: 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.249+0000 7f48e77fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.250+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 71374800 0 0) 0x7f49080a9310 con 0x7f4908059e10 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.250+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48d4003610 con 0x7f4908059e10 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.250+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f48fc0030c0 con 0x7f4908059e10 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.250+0000 7f48e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.250+0000 7f48e77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.250+0000 7f48e77fe640 10 monclient(hunting): dump: 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.267 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1903216321 0 0) 0x7f490812e3b0 con 0x7f490815e2a0 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49080a9310 con 0x7f490815e2a0 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f48f0003310 con 0x7f490815e2a0 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 10 monclient(hunting): dump: 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.268 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1878490381 0 0) 0x7f490812e0d0 con 0x7f49081a5660 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 >> v1:10.20.193.167:6789/0 conn(0x7f4908059e10 legacy=0x7f490805bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 >> v1:10.20.193.155:6789/0 conn(0x7f490815e2a0 legacy=0x7f4908191100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 1 monclient: found mon.a 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490812b710 con 0x7f49081a5660 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f48e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 5 monclient: authenticate success, global_id 30894 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 10 monclient: _renew_subs 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f490812b9f0 con 0x7f49081a5660 2026-02-25T15:19:33.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 10 client.30894.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 10 monclient: _renew_subs 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f490812c1f0 con 0x7f49081a5660 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 1 librados: init done 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 10 client.30894.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 15 client.30894.objecter _session_command_op_assign -1 1 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 20 client.30894.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 10 client.30894.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:33.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.251+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4908191810 con 0x7f49081a5660 2026-02-25T15:19:33.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.259+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4908191810 con 0x7f49081a5660 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.260+0000 7f48e77fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.260+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f48f8004df0 con 0x7f49081a5660 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.260+0000 7f48e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.260+0000 7f48e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.260+0000 7f48e77fe640 10 monclient: dump: 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.274 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.260+0000 7f49057fa640 4 set_mon_vals no callback set 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.260+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f48f801dc60 con 0x7f49081a5660 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.261+0000 7f4906ffd640 10 monclient: get_auth_request con 0x7f48d4077e70 auth_method 0 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.261+0000 7f48e77fe640 10 client.30894.objecter ms_handle_connect 0x7f48d4077e70 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f48f80932f0 con 0x7f49081a5660 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 10 client.30894.objecter ms_dispatch2 0x7f4908000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:33.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 3 client.30894.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 3 client.30894.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 10 client.30894.objecter checking command 1 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 20 client.30894.objecter _get_session s=0x7f48d40a2120 osd=10 3 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 20 client.30894.objecter put_session s=0x7f48d40a2120 osd=10 3 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 15 client.30894.objecter _session_command_op_remove -1 1 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 20 client.30894.objecter _get_session s=0x7f48d40a2120 osd=10 3 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 20 client.30894.objecter get_session s=0x7f48d40a2120 osd=10 3 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 15 client.30894.objecter _session_command_op_assign 10 1 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 20 client.30894.objecter put_session s=0x7f48d40a2120 osd=10 4 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 10 client.30894.objecter _send_command 1 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.167:6804/601461155 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48d40c4430 con 0x7f48d40a27d0 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 20 client.30894.objecter dump_active .. 0 homeless 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f48f8059990 con 0x7f49081a5660 2026-02-25T15:19:33.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f48e77fe640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:33.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.262+0000 7f49067fc640 10 monclient: get_auth_request con 0x7f48d40a27d0 auth_method 0 2026-02-25T15:19:33.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.263+0000 7f48e77fe640 10 client.30894.objecter ms_handle_connect 0x7f48d40a27d0 2026-02-25T15:19:33.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.272+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== osd.10 v1:10.20.193.167:6804/601461155 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f48d40c4430 con 0x7f48d40a27d0 2026-02-25T15:19:33.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.272+0000 7f48e77fe640 10 client.30894.objecter ms_dispatch2 0x7f4908000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:33.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.272+0000 7f48e77fe640 10 client.30894.objecter _finish_command 1 = system:0 2026-02-25T15:19:33.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.272+0000 7f48e77fe640 20 client.30894.objecter put_session s=0x7f48d40a2120 osd=10 4 2026-02-25T15:19:33.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.272+0000 7f48e77fe640 15 client.30894.objecter _session_command_op_remove 10 1 2026-02-25T15:19:33.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 10 client.30894.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:33.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 15 client.30894.objecter _session_command_op_assign -1 2 2026-02-25T15:19:33.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 20 client.30894.objecter _get_session s=0x7f48d40a2120 osd=10 3 2026-02-25T15:19:33.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 20 client.30894.objecter put_session s=0x7f48d40a2120 osd=10 3 2026-02-25T15:19:33.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 20 client.30894.objecter _get_session s=0x7f48d40a2120 osd=10 3 2026-02-25T15:19:33.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 15 client.30894.objecter _session_command_op_remove -1 2 2026-02-25T15:19:33.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 20 client.30894.objecter get_session s=0x7f48d40a2120 osd=10 3 2026-02-25T15:19:33.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 15 client.30894.objecter _session_command_op_assign 10 2 2026-02-25T15:19:33.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 20 client.30894.objecter put_session s=0x7f48d40a2120 osd=10 4 2026-02-25T15:19:33.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 10 client.30894.objecter _send_command 2 2026-02-25T15:19:33.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.280+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 --> v1:10.20.193.167:6804/601461155 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f49080b73f0 con 0x7f48d40a27d0 2026-02-25T15:19:33.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f48e77fe640 1 -- 10.20.193.78:0/875163960 <== osd.10 v1:10.20.193.167:6804/601461155 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f49080b73f0 con 0x7f48d40a27d0 2026-02-25T15:19:33.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f48e77fe640 10 client.30894.objecter ms_dispatch2 0x7f4908000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:33.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f48e77fe640 10 client.30894.objecter _finish_command 2 = system:0 2026-02-25T15:19:33.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f48e77fe640 20 client.30894.objecter put_session s=0x7f48d40a2120 osd=10 4 2026-02-25T15:19:33.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f48e77fe640 15 client.30894.objecter _session_command_op_remove 10 2 2026-02-25T15:19:33.290 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:33.290 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:33.291 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:33.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 10 librados: watch_flush enter 2026-02-25T15:19:33.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 10 librados: watch_flush exit 2026-02-25T15:19:33.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 10 client.30894.objecter close_session for osd.10 2026-02-25T15:19:33.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 >> v1:10.20.193.167:6804/601461155 conn(0x7f48d40a27d0 legacy=0x7f48d40c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 20 client.30894.objecter put_session s=0x7f48d40a2120 osd=10 1 2026-02-25T15:19:33.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 20 client.30894.objecter shutdown clearing up homeless session... 2026-02-25T15:19:33.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 10 client.30894.objecter successfully canceled tick 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 >> v1:10.20.193.78:6800/3497602169 conn(0x7f48d4077e70 legacy=0x7f48d4098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 10 monclient: shutdown 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 >> v1:10.20.193.78:6789/0 conn(0x7f49081a5660 legacy=0x7f490812d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f49077fe640 1 -- 10.20.193.78:0/875163960 reap_dead start 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 shutdown_connections 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 >> 10.20.193.78:0/875163960 conn(0x7f49080b2f60 msgr2=0x7f490815d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 shutdown_connections 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.287+0000 7f490d7bb640 1 -- 10.20.193.78:0/875163960 wait complete. 2026-02-25T15:19:33.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.288+0000 7f490d7bb640 1 librados: shutdown 2026-02-25T15:19:33.298 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-25T15:19:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.364+0000 7f4661646640 10 monclient: get_monmap_and_config 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.364+0000 7f4661646640 10 monclient: build_initial_monmap 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.364+0000 7f4661646640 10 monclient: monmap: 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:33.365335+0000 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:33.365335+0000 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:33.367 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:33.368 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:33.368 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.364+0000 7f4661646640 1 Processor -- start 2026-02-25T15:19:33.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.364+0000 7f4661646640 1 -- start start 2026-02-25T15:19:33.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.364+0000 7f4661646640 10 monclient: init 2026-02-25T15:19:33.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:33.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:33.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 10 monclient(hunting): picked mon.noname-a con 0x7f465c157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:33.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 10 monclient(hunting): picked mon.noname-c con 0x7f465c157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 10 monclient(hunting): picked mon.noname-b con 0x7f465c164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c05de70 con 0x7f465c157780 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c055b20 con 0x7f465c164d00 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c055e00 con 0x7f465c157b50 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f4661646640 10 monclient(hunting): authenticate will time out at 3742.954484s 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f465affd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f465c157780 0x7f465c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40622/0 (socket says 10.20.193.78:40622) 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.365+0000 7f465affd640 1 -- 10.20.193.78:0/3428549105 learned_addr learned my addr 10.20.193.78:0/3428549105 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611281523 0 0) 0x7f465c05de70 con 0x7f465c157780 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): my global_id is 30897 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4648003610 con 0x7f465c157780 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346053935 0 0) 0x7f465c055e00 con 0x7f465c157b50 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): my global_id is 27734 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f465c05de70 con 0x7f465c157b50 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399307427 0 0) 0x7f465c055b20 con 0x7f465c164d00 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 10 monclient(hunting): my global_id is 30187 2026-02-25T15:19:33.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.367+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f465c055e00 con 0x7f465c164d00 2026-02-25T15:19:33.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3562898023 0 0) 0x7f465c05de70 con 0x7f465c157b50 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 >> v1:10.20.193.155:6789/0 conn(0x7f465c164d00 legacy=0x7f465c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 >> v1:10.20.193.78:6789/0 conn(0x7f465c157780 legacy=0x7f465c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 1 monclient: found mon.noname-c 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c0560e0 con 0x7f465c157b50 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:33.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4644002df0 con 0x7f465c157b50 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4659ffb640 10 monclient: dump: 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.380 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4661646640 5 monclient: authenticate success, global_id 27734 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.368+0000 7f4661646640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.369+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4644002fc0 con 0x7f465c157b50 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.369+0000 7f4659ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.369+0000 7f4661646640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.369+0000 7f4659ffb640 1 -- 10.20.193.78:0/3428549105 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4644003400 con 0x7f465c157b50 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.369+0000 7f4661646640 4 set_mon_vals no callback set 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.369+0000 7f4659ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.369+0000 7f4659ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:33.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.369+0000 7f4659ffb640 10 monclient: dump: 2026-02-25T15:19:33.382 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.382 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.382 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.382 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.382 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.382 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.382 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.383 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.383 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.383 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 10 monclient: shutdown 2026-02-25T15:19:33.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:33.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 -- 10.20.193.78:0/3428549105 >> v1:10.20.193.167:6789/0 conn(0x7f465c157b50 legacy=0x7f465c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 -- 10.20.193.78:0/3428549105 shutdown_connections 2026-02-25T15:19:33.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 -- 10.20.193.78:0/3428549105 >> 10.20.193.78:0/3428549105 conn(0x7f465c0b2ef0 msgr2=0x7f465c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 -- 10.20.193.78:0/3428549105 shutdown_connections 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 -- 10.20.193.78:0/3428549105 wait complete. 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 10 monclient: build_initial_monmap 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 10 monclient: monmap: 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:33.384 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 librados: starting msgr at 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 librados: starting objecter 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 Processor -- start 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 -- start start 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 librados: setting wanted keys 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 1 librados: calling monclient init 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.370+0000 7f4661646640 10 monclient: init 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:33.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 10 monclient(hunting): picked mon.noname-a con 0x7f465c157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 10 monclient(hunting): picked mon.noname-b con 0x7f465c157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 10 monclient(hunting): picked mon.noname-c con 0x7f465c164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c1487c0 con 0x7f465c157780 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c148aa0 con 0x7f465c157b50 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c148d80 con 0x7f465c164d00 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f4661646640 10 monclient(hunting): authenticate will time out at 3742.960308s 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f465a7fc640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f465c157b50 0x7f465c058b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:37084/0 (socket says 10.20.193.78:37084) 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f465a7fc640 1 -- 10.20.193.78:0/2387090545 learned_addr learned my addr 10.20.193.78:0/2387090545 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f463b7fe640 10 client.?.objecter ms_handle_connect 0x7f465c157b50 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f463b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f463b7fe640 10 client.?.objecter ms_handle_connect 0x7f465c157780 2026-02-25T15:19:33.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.371+0000 7f463b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.372+0000 7f463b7fe640 10 client.?.objecter ms_handle_connect 0x7f465c164d00 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.372+0000 7f463b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228601889 0 0) 0x7f465c1487c0 con 0x7f465c157780 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): my global_id is 30900 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4628003610 con 0x7f465c157780 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672017131 0 0) 0x7f465c148aa0 con 0x7f465c157b50 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): my global_id is 30190 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f465c1487c0 con 0x7f465c157b50 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210977969 0 0) 0x7f465c148d80 con 0x7f465c164d00 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 10 monclient(hunting): my global_id is 27737 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.373+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f465c148aa0 con 0x7f465c164d00 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1399351897 0 0) 0x7f465c148aa0 con 0x7f465c164d00 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f465c148d80 con 0x7f465c164d00 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f464c003330 con 0x7f465c164d00 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1889601196 0 0) 0x7f465c1487c0 con 0x7f465c157b50 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f465c148aa0 con 0x7f465c157b50 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f46440033d0 con 0x7f465c157b50 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.390 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3195287297 0 0) 0x7f4628003610 con 0x7f465c157780 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f465c1487c0 con 0x7f465c157780 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f46500030b0 con 0x7f465c157780 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.375+0000 7f463b7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.391 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.392 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.392 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.392 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.392 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.392 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.392 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.392 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2617232755 0 0) 0x7f465c148d80 con 0x7f465c164d00 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 >> v1:10.20.193.155:6789/0 conn(0x7f465c157b50 legacy=0x7f465c058b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 >> v1:10.20.193.78:6789/0 conn(0x7f465c157780 legacy=0x7f465c05c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 1 monclient: found mon.c 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c05b900 con 0x7f465c164d00 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:33.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f463b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 5 monclient: authenticate success, global_id 27737 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 10 monclient: _renew_subs 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f465c148290 con 0x7f465c164d00 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 10 client.27737.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 10 monclient: _renew_subs 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f465c05c9f0 con 0x7f465c164d00 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.377+0000 7f4661646640 1 librados: init done 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.378+0000 7f4661646640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.378+0000 7f4661646640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.378+0000 7f4661646640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.378+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c05e250 con 0x7f465c164d00 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.385+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f464c003a80 con 0x7f465c164d00 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.385+0000 7f463b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.385+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f464c003dd0 con 0x7f465c164d00 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.385+0000 7f463b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.385+0000 7f463b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.385+0000 7f463b7fe640 10 monclient: dump: 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.397 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.398 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.385+0000 7f46597fa640 4 set_mon_vals no callback set 2026-02-25T15:19:33.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.386+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f464c01cc40 con 0x7f465c164d00 2026-02-25T15:19:33.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.387+0000 7f465affd640 10 monclient: get_auth_request con 0x7f4628077ed0 auth_method 0 2026-02-25T15:19:33.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.387+0000 7f463b7fe640 10 client.27737.objecter ms_handle_connect 0x7f4628077ed0 2026-02-25T15:19:33.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.471+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f464c092270 con 0x7f465c164d00 2026-02-25T15:19:33.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.471+0000 7f463b7fe640 10 client.27737.objecter ms_dispatch2 0x7f465c000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:33.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.471+0000 7f463b7fe640 3 client.27737.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:33.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.471+0000 7f463b7fe640 3 client.27737.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:33.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.471+0000 7f463b7fe640 20 client.27737.objecter dump_active .. 0 homeless 2026-02-25T15:19:33.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.473+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f465c05e250 con 0x7f465c164d00 2026-02-25T15:19:33.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.473+0000 7f463b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.473+0000 7f463b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:33.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.584+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7f465c05b740 con 0x7f4628077ed0 2026-02-25T15:19:33.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.584+0000 7f463b7fe640 1 -- 10.20.193.78:0/2387090545 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (unknown 3896554461 0 0) 0x7f46500058e0 con 0x7f4628077ed0 2026-02-25T15:19:33.587 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 10 to deep-scrub 2026-02-25T15:19:33.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 10 librados: watch_flush enter 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 10 librados: watch_flush exit 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 20 client.27737.objecter shutdown clearing up homeless session... 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 10 client.27737.objecter successfully canceled tick 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 >> v1:10.20.193.78:6800/3497602169 conn(0x7f4628077ed0 legacy=0x7f4628098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 10 monclient: shutdown 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 >> v1:10.20.193.167:6789/0 conn(0x7f465c164d00 legacy=0x7f465c128150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 shutdown_connections 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 >> 10.20.193.78:0/2387090545 conn(0x7f465c0b2ef0 msgr2=0x7f465c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:33.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 shutdown_connections 2026-02-25T15:19:33.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 1 -- 10.20.193.78:0/2387090545 wait complete. 2026-02-25T15:19:33.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.586+0000 7f4661646640 1 librados: shutdown 2026-02-25T15:19:33.597 INFO:tasks.ceph:Scrubbing osd.14 2026-02-25T15:19:33.598 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:33.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.666+0000 7fdd57199640 10 monclient: get_monmap_and_config 2026-02-25T15:19:33.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.666+0000 7fdd57199640 10 monclient: build_initial_monmap 2026-02-25T15:19:33.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.666+0000 7fdd57199640 10 monclient: monmap: 2026-02-25T15:19:33.669 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:33.669 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.669 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:33.667319+0000 2026-02-25T15:19:33.669 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:33.667319+0000 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.666+0000 7fdd57199640 1 Processor -- start 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.666+0000 7fdd57199640 1 -- start start 2026-02-25T15:19:33.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.666+0000 7fdd57199640 10 monclient: init 2026-02-25T15:19:33.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 10 monclient(hunting): picked mon.noname-c con 0x7fdd5015e2a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 10 monclient(hunting): picked mon.noname-b con 0x7fdd50059e10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 10 monclient(hunting): picked mon.noname-a con 0x7fdd501a5660 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd50162df0 con 0x7fdd501a5660 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd501630d0 con 0x7fdd50059e10 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd501633b0 con 0x7fdd5015e2a0 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd57199640 10 monclient(hunting): authenticate will time out at 3743.256473s 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd47fff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fdd50059e10 0x7fdd5015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:37086/0 (socket says 10.20.193.78:37086) 2026-02-25T15:19:33.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd47fff640 1 -- 10.20.193.78:0/655765915 learned_addr learned my addr 10.20.193.78:0/655765915 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.667+0000 7fdd5570f640 1 --1- 10.20.193.78:0/655765915 >> v1:10.20.193.78:6789/0 conn(0x7fdd501a5660 0x7fdd501c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40644/0 (socket says 10.20.193.78:40644) 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962933377 0 0) 0x7fdd501630d0 con 0x7fdd50059e10 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): my global_id is 30193 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd3c003610 con 0x7fdd50059e10 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027911803 0 0) 0x7fdd50162df0 con 0x7fdd501a5660 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): my global_id is 30903 2026-02-25T15:19:33.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd501630d0 con 0x7fdd501a5660 2026-02-25T15:19:33.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099854737 0 0) 0x7fdd501633b0 con 0x7fdd5015e2a0 2026-02-25T15:19:33.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 10 monclient(hunting): my global_id is 27740 2026-02-25T15:19:33.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.669+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd50162df0 con 0x7fdd5015e2a0 2026-02-25T15:19:33.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.670+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 14067157 0 0) 0x7fdd3c003610 con 0x7fdd50059e10 2026-02-25T15:19:33.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.670+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 >> v1:10.20.193.167:6789/0 conn(0x7fdd5015e2a0 legacy=0x7fdd5005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.670+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 >> v1:10.20.193.78:6789/0 conn(0x7fdd501a5660 legacy=0x7fdd501c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.670+0000 7fdd477fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:33.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 1 monclient: found mon.noname-b 2026-02-25T15:19:33.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:33.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:33.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd50163690 con 0x7fdd50059e10 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fdd38002df0 con 0x7fdd50059e10 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: dump: 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.683 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd57199640 5 monclient: authenticate success, global_id 30193 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd57199640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd38002fc0 con 0x7fdd50059e10 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 1 -- 10.20.193.78:0/655765915 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fdd38003400 con 0x7fdd50059e10 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:33.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd477fe640 10 monclient: dump: 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd57199640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:33.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.671+0000 7fdd57199640 4 set_mon_vals no callback set 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 10 monclient: shutdown 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 1 -- 10.20.193.78:0/655765915 >> v1:10.20.193.155:6789/0 conn(0x7fdd50059e10 legacy=0x7fdd5015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 1 -- 10.20.193.78:0/655765915 shutdown_connections 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 1 -- 10.20.193.78:0/655765915 >> 10.20.193.78:0/655765915 conn(0x7fdd500b2f60 msgr2=0x7fdd500b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 1 -- 10.20.193.78:0/655765915 shutdown_connections 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 1 -- 10.20.193.78:0/655765915 wait complete. 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 10 monclient: build_initial_monmap 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 10 monclient: monmap: 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:33.686 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 1 librados: starting msgr at 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 1 librados: starting objecter 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.672+0000 7fdd57199640 1 Processor -- start 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 1 -- start start 2026-02-25T15:19:33.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 1 librados: setting wanted keys 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 1 librados: calling monclient init 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 10 monclient: init 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 10 monclient(hunting): picked mon.noname-c con 0x7fdd50059e10 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 10 monclient(hunting): picked mon.noname-a con 0x7fdd5015e2a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 10 monclient(hunting): picked mon.noname-b con 0x7fdd501a5660 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5012b950 con 0x7fdd5015e2a0 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5012bc30 con 0x7fdd501a5660 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5012bf10 con 0x7fdd50059e10 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd57199640 10 monclient(hunting): authenticate will time out at 3743.262445s 2026-02-25T15:19:33.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd54f0e640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fdd50059e10 0x7fdd50121c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41650/0 (socket says 10.20.193.78:41650) 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd54f0e640 1 -- 10.20.193.78:0/1524861923 learned_addr learned my addr 10.20.193.78:0/1524861923 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd54f0e640 1 -- 10.20.193.78:0/1524861923 >> v1:10.20.193.167:6789/0 conn(0x7fdd50059e10 legacy=0x7fdd50121c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd54f0e640 1 -- 10.20.193.78:0/1524861923 >> v1:10.20.193.167:6789/0 conn(0x7fdd50059e10 legacy=0x7fdd50121c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd54f0e640 1 --1- 10.20.193.78:0/1524861923 >> v1:10.20.193.167:6789/0 conn(0x7fdd50059e10 0x7fdd50121c80 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd54f0e640 1 --1- 10.20.193.78:0/1524861923 >> v1:10.20.193.167:6789/0 conn(0x7fdd50059e10 0x7fdd50121c80 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd457fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.167:6789/0 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd457fa640 10 client.?.objecter ms_handle_connect 0x7fdd501a5660 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.673+0000 7fdd457fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.674+0000 7fdd457fa640 10 client.?.objecter ms_handle_connect 0x7fdd5015e2a0 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.674+0000 7fdd457fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.674+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9789729 0 0) 0x7fdd5012bc30 con 0x7fdd501a5660 2026-02-25T15:19:33.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.674+0000 7fdd457fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.674+0000 7fdd457fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.674+0000 7fdd457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.674+0000 7fdd457fa640 10 monclient(hunting): my global_id is 30196 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.674+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd20003610 con 0x7fdd501a5660 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.675+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132103450 0 0) 0x7fdd5012b950 con 0x7fdd5015e2a0 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.675+0000 7fdd457fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.675+0000 7fdd457fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.675+0000 7fdd457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.675+0000 7fdd457fa640 10 monclient(hunting): my global_id is 30906 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.675+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd5012bc30 con 0x7fdd5015e2a0 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.677+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 630992260 0 0) 0x7fdd20003610 con 0x7fdd501a5660 2026-02-25T15:19:33.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.677+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd5012b950 con 0x7fdd501a5660 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.677+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fdd4c003430 con 0x7fdd501a5660 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.677+0000 7fdd457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.677+0000 7fdd457fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.677+0000 7fdd457fa640 10 monclient(hunting): dump: 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.691 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.677+0000 7fdd457fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.678+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2499410334 0 0) 0x7fdd5012bc30 con 0x7fdd5015e2a0 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.678+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd20003610 con 0x7fdd5015e2a0 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.678+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fdd38003310 con 0x7fdd5015e2a0 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.678+0000 7fdd457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.678+0000 7fdd457fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.678+0000 7fdd457fa640 10 monclient(hunting): dump: 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.692 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1913995488 0 0) 0x7fdd5012b950 con 0x7fdd501a5660 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 >> v1:10.20.193.167:6789/0 conn(0x7fdd50059e10 legacy=0x7fdd50121c80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 >> v1:10.20.193.78:6789/0 conn(0x7fdd5015e2a0 legacy=0x7fdd50056bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 10 monclient: _finish_hunting 0 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 1 monclient: found mon.b 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:33.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd50127e40 con 0x7fdd501a5660 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 10 monclient: _finish_auth 0 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 10 monclient: _check_auth_tickets 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 5 monclient: authenticate success, global_id 30196 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 10 monclient: _renew_subs 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd50128120 con 0x7fdd501a5660 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 10 client.30196.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 10 monclient: _renew_subs 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd500572c0 con 0x7fdd501a5660 2026-02-25T15:19:33.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 1 librados: init done 2026-02-25T15:19:33.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 10 client.30196.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 15 client.30196.objecter _session_command_op_assign -1 1 2026-02-25T15:19:33.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 20 client.30196.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:33.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 10 client.30196.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:33.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:33.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.679+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.155:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdd50127c30 con 0x7fdd501a5660 2026-02-25T15:19:33.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.687+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd50127c30 con 0x7fdd501a5660 2026-02-25T15:19:33.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.687+0000 7fdd457fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:33.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.687+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fdd4c004df0 con 0x7fdd501a5660 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.687+0000 7fdd457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.687+0000 7fdd457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.687+0000 7fdd457fa640 10 monclient: dump: 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.698 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.687+0000 7fdd46ffd640 4 set_mon_vals no callback set 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.688+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fdd4c01dc60 con 0x7fdd501a5660 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.688+0000 7fdd54f0e640 10 monclient: get_auth_request con 0x7fdd20077c70 auth_method 0 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.688+0000 7fdd457fa640 10 client.30196.objecter ms_handle_connect 0x7fdd20077c70 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fdd4c093450 con 0x7fdd501a5660 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 10 client.30196.objecter ms_dispatch2 0x7fdd50000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 3 client.30196.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 3 client.30196.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 10 client.30196.objecter checking command 1 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 20 client.30196.objecter _get_session s=0x7fdd200a1f20 osd=14 3 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 20 client.30196.objecter put_session s=0x7fdd200a1f20 osd=14 3 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 15 client.30196.objecter _session_command_op_remove -1 1 2026-02-25T15:19:33.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 20 client.30196.objecter _get_session s=0x7fdd200a1f20 osd=14 3 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 20 client.30196.objecter get_session s=0x7fdd200a1f20 osd=14 3 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 15 client.30196.objecter _session_command_op_assign 14 1 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 20 client.30196.objecter put_session s=0x7fdd200a1f20 osd=14 4 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 10 client.30196.objecter _send_command 1 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.167:6800/376081176 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd200c4230 con 0x7fdd200a25d0 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 20 client.30196.objecter dump_active .. 0 homeless 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7fdd4c05d550 con 0x7fdd501a5660 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd457fa640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.689+0000 7fdd47fff640 10 monclient: get_auth_request con 0x7fdd200a25d0 auth_method 0 2026-02-25T15:19:33.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.690+0000 7fdd457fa640 10 client.30196.objecter ms_handle_connect 0x7fdd200a25d0 2026-02-25T15:19:33.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.700+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== osd.14 v1:10.20.193.167:6800/376081176 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fdd200c4230 con 0x7fdd200a25d0 2026-02-25T15:19:33.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.700+0000 7fdd457fa640 10 client.30196.objecter ms_dispatch2 0x7fdd50000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:33.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.700+0000 7fdd457fa640 10 client.30196.objecter _finish_command 1 = system:0 2026-02-25T15:19:33.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.700+0000 7fdd457fa640 20 client.30196.objecter put_session s=0x7fdd200a1f20 osd=14 4 2026-02-25T15:19:33.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.700+0000 7fdd457fa640 15 client.30196.objecter _session_command_op_remove 14 1 2026-02-25T15:19:33.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 10 client.30196.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:33.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 15 client.30196.objecter _session_command_op_assign -1 2 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 20 client.30196.objecter _get_session s=0x7fdd200a1f20 osd=14 3 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 20 client.30196.objecter put_session s=0x7fdd200a1f20 osd=14 3 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 20 client.30196.objecter _get_session s=0x7fdd200a1f20 osd=14 3 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 15 client.30196.objecter _session_command_op_remove -1 2 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 20 client.30196.objecter get_session s=0x7fdd200a1f20 osd=14 3 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 15 client.30196.objecter _session_command_op_assign 14 2 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 20 client.30196.objecter put_session s=0x7fdd200a1f20 osd=14 4 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 10 client.30196.objecter _send_command 2 2026-02-25T15:19:33.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.707+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 --> v1:10.20.193.167:6800/376081176 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdd501645f0 con 0x7fdd200a25d0 2026-02-25T15:19:33.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd457fa640 1 -- 10.20.193.78:0/1524861923 <== osd.14 v1:10.20.193.167:6800/376081176 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fdd501645f0 con 0x7fdd200a25d0 2026-02-25T15:19:33.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd457fa640 10 client.30196.objecter ms_dispatch2 0x7fdd50000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:33.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd457fa640 10 client.30196.objecter _finish_command 2 = system:0 2026-02-25T15:19:33.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd457fa640 20 client.30196.objecter put_session s=0x7fdd200a1f20 osd=14 4 2026-02-25T15:19:33.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd457fa640 15 client.30196.objecter _session_command_op_remove 14 2 2026-02-25T15:19:33.718 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:33.718 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:33.718 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:33.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 10 librados: watch_flush enter 2026-02-25T15:19:33.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 10 librados: watch_flush exit 2026-02-25T15:19:33.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 10 client.30196.objecter close_session for osd.14 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 >> v1:10.20.193.167:6800/376081176 conn(0x7fdd200a25d0 legacy=0x7fdd200c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 20 client.30196.objecter put_session s=0x7fdd200a1f20 osd=14 1 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 20 client.30196.objecter shutdown clearing up homeless session... 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 10 client.30196.objecter successfully canceled tick 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 >> v1:10.20.193.78:6800/3497602169 conn(0x7fdd20077c70 legacy=0x7fdd20098120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 10 monclient: shutdown 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 >> v1:10.20.193.155:6789/0 conn(0x7fdd501a5660 legacy=0x7fdd500b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd5570f640 1 -- 10.20.193.78:0/1524861923 reap_dead start 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 shutdown_connections 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 >> 10.20.193.78:0/1524861923 conn(0x7fdd500b2f60 msgr2=0x7fdd500b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:33.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 shutdown_connections 2026-02-25T15:19:33.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 1 -- 10.20.193.78:0/1524861923 wait complete. 2026-02-25T15:19:33.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.715+0000 7fdd57199640 1 librados: shutdown 2026-02-25T15:19:33.725 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient: get_monmap_and_config 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient: build_initial_monmap 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient: monmap: 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:33.790930+0000 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:33.790930+0000 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 1 Processor -- start 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 1 -- start start 2026-02-25T15:19:33.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient: init 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient(hunting): picked mon.noname-b con 0x7f8704157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient(hunting): picked mon.noname-c con 0x7f8704157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.790+0000 7f870b1fa640 10 monclient(hunting): picked mon.noname-a con 0x7f8704164d00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.791+0000 7f870b1fa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870405de70 con 0x7f8704164d00 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.791+0000 7f870b1fa640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8704055b20 con 0x7f8704157780 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.791+0000 7f870b1fa640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8704055e00 con 0x7f8704157b50 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.791+0000 7f870b1fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.791+0000 7f870b1fa640 10 monclient(hunting): authenticate will time out at 3743.380022s 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.791+0000 7f86fbfff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f8704157b50 0x7f87041645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41652/0 (socket says 10.20.193.78:41652) 2026-02-25T15:19:33.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.791+0000 7f86fbfff640 1 -- 10.20.193.78:0/561208147 learned_addr learned my addr 10.20.193.78:0/561208147 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290543082 0 0) 0x7f870405de70 con 0x7f8704164d00 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): my global_id is 30909 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f0003610 con 0x7f8704164d00 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89570946 0 0) 0x7f8704055e00 con 0x7f8704157b50 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): my global_id is 27743 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f870405de70 con 0x7f8704157b50 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2588255466 0 0) 0x7f8704055b20 con 0x7f8704157780 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 10 monclient(hunting): my global_id is 30199 2026-02-25T15:19:33.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.792+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8704055e00 con 0x7f8704157780 2026-02-25T15:19:33.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 72365043 0 0) 0x7f86f0003610 con 0x7f8704164d00 2026-02-25T15:19:33.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 >> v1:10.20.193.167:6789/0 conn(0x7f8704157b50 legacy=0x7f87041645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 >> v1:10.20.193.155:6789/0 conn(0x7f8704157780 legacy=0x7f8704056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:33.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 1 monclient: found mon.noname-a 2026-02-25T15:19:33.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87040560e0 con 0x7f8704164d00 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8700003170 con 0x7f8704164d00 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f86fb7fe640 10 monclient: dump: 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f870b1fa640 5 monclient: authenticate success, global_id 30909 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.794+0000 7f870b1fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8700003310 con 0x7f8704164d00 2026-02-25T15:19:33.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f86fb7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 4 set_mon_vals no callback set 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f86fb7fe640 1 -- 10.20.193.78:0/561208147 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8700003750 con 0x7f8704164d00 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f86fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f86fb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f86fb7fe640 10 monclient: dump: 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 10 monclient: shutdown 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 1 -- 10.20.193.78:0/561208147 >> v1:10.20.193.78:6789/0 conn(0x7f8704164d00 legacy=0x7f87041c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 1 -- 10.20.193.78:0/561208147 shutdown_connections 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 1 -- 10.20.193.78:0/561208147 >> 10.20.193.78:0/561208147 conn(0x7f87040b2ef0 msgr2=0x7f87040b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 1 -- 10.20.193.78:0/561208147 shutdown_connections 2026-02-25T15:19:33.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.795+0000 7f870b1fa640 1 -- 10.20.193.78:0/561208147 wait complete. 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient: build_initial_monmap 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient: monmap: 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 librados: starting msgr at 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 librados: starting objecter 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 Processor -- start 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 -- start start 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 librados: setting wanted keys 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 librados: calling monclient init 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient: init 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient(hunting): picked mon.noname-a con 0x7f8704157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient(hunting): picked mon.noname-c con 0x7f8704157b50 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient(hunting): picked mon.noname-b con 0x7f8704164d00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8704133b10 con 0x7f8704157780 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87041386b0 con 0x7f8704164d00 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8704138990 con 0x7f8704157b50 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f870b1fa640 10 monclient(hunting): authenticate will time out at 3743.385719s 2026-02-25T15:19:33.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f8708f6f640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f8704157780 0x7f8704133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40666/0 (socket says 10.20.193.78:40666) 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.796+0000 7f8708f6f640 1 -- 10.20.193.78:0/3002896694 learned_addr learned my addr 10.20.193.78:0/3002896694 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.797+0000 7f86f97fa640 10 client.?.objecter ms_handle_connect 0x7f8704157780 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.797+0000 7f86f97fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.797+0000 7f86f97fa640 10 client.?.objecter ms_handle_connect 0x7f8704157b50 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.797+0000 7f86f97fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.797+0000 7f86f97fa640 10 client.?.objecter ms_handle_connect 0x7f8704164d00 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.797+0000 7f86f97fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042146461 0 0) 0x7f8704133b10 con 0x7f8704157780 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): my global_id is 30912 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86d4003610 con 0x7f8704157780 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521454893 0 0) 0x7f8704138990 con 0x7f8704157b50 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): my global_id is 27746 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8704133b10 con 0x7f8704157b50 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235618807 0 0) 0x7f87041386b0 con 0x7f8704164d00 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 10 monclient(hunting): my global_id is 30202 2026-02-25T15:19:33.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.798+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8704138990 con 0x7f8704164d00 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2216428324 0 0) 0x7f8704133b10 con 0x7f8704157b50 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87041386b0 con 0x7f8704157b50 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f86ec002ff0 con 0x7f8704157b50 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 10 monclient(hunting): dump: 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.802 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2996134457 0 0) 0x7f86d4003610 con 0x7f8704157780 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8704133b10 con 0x7f8704157780 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f86f40031a0 con 0x7f8704157780 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.800+0000 7f86f97fa640 10 monclient(hunting): dump: 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.801+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1136047616 0 0) 0x7f8704138990 con 0x7f8704164d00 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.801+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86d4003610 con 0x7f8704164d00 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.801+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f8700003660 con 0x7f8704164d00 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.801+0000 7f86f97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.801+0000 7f86f97fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.801+0000 7f86f97fa640 10 monclient(hunting): dump: 2026-02-25T15:19:33.803 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2050051128 0 0) 0x7f87041386b0 con 0x7f8704157b50 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 >> v1:10.20.193.155:6789/0 conn(0x7f8704164d00 legacy=0x7f8704148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 >> v1:10.20.193.78:6789/0 conn(0x7f8704157780 legacy=0x7f8704133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 10 monclient: _finish_hunting 0 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 1 monclient: found mon.c 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8704138c70 con 0x7f8704157b50 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 10 monclient: _finish_auth 0 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 10 monclient: _check_auth_tickets 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f86f97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 5 monclient: authenticate success, global_id 27746 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 10 monclient: _renew_subs 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8704138f50 con 0x7f8704157b50 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 10 client.27746.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 10 monclient: _renew_subs 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f87040ad000 con 0x7f8704157b50 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 1 librados: init done 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:33.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.802+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870405e250 con 0x7f8704157b50 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.810+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f86ec0048d0 con 0x7f8704157b50 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.810+0000 7f86f97fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.810+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f86ec004c20 con 0x7f8704157b50 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.810+0000 7f86f97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.810+0000 7f86f97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.810+0000 7f86f97fa640 10 monclient: dump: 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:33.812 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:33.813 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:33.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.810+0000 7f86faffd640 4 set_mon_vals no callback set 2026-02-25T15:19:33.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.811+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f86ec01da90 con 0x7f8704157b50 2026-02-25T15:19:33.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.811+0000 7f8708f6f640 10 monclient: get_auth_request con 0x7f86d4077e20 auth_method 0 2026-02-25T15:19:33.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.811+0000 7f86f97fa640 10 client.27746.objecter ms_handle_connect 0x7f86d4077e20 2026-02-25T15:19:33.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.811+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f86ec0931b0 con 0x7f8704157b50 2026-02-25T15:19:33.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.811+0000 7f86f97fa640 10 client.27746.objecter ms_dispatch2 0x7f8704000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:33.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.811+0000 7f86f97fa640 3 client.27746.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:33.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.811+0000 7f86f97fa640 3 client.27746.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:33.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.812+0000 7f86f97fa640 20 client.27746.objecter dump_active .. 0 homeless 2026-02-25T15:19:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.897+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f870405e250 con 0x7f8704157b50 2026-02-25T15:19:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.897+0000 7f86f97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:33.897+0000 7f86f97fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:34.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.002+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7f87040b5160 con 0x7f86d4077e20 2026-02-25T15:19:34.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.002+0000 7f86f97fa640 1 -- 10.20.193.78:0/3002896694 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (unknown 1939288360 0 0) 0x7f87040b5160 con 0x7f86d4077e20 2026-02-25T15:19:34.005 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 14 to deep-scrub 2026-02-25T15:19:34.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 10 librados: watch_flush enter 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 10 librados: watch_flush exit 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 20 client.27746.objecter shutdown clearing up homeless session... 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 10 client.27746.objecter successfully canceled tick 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 >> v1:10.20.193.78:6800/3497602169 conn(0x7f86d4077e20 legacy=0x7f86d40982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 10 monclient: shutdown 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 >> v1:10.20.193.167:6789/0 conn(0x7f8704157b50 legacy=0x7f87041471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 shutdown_connections 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 >> 10.20.193.78:0/3002896694 conn(0x7f87040b2ef0 msgr2=0x7f870413db70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 shutdown_connections 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 1 -- 10.20.193.78:0/3002896694 wait complete. 2026-02-25T15:19:34.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.003+0000 7f870b1fa640 1 librados: shutdown 2026-02-25T15:19:34.014 INFO:tasks.ceph:Scrubbing osd.3 2026-02-25T15:19:34.014 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:34.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.080+0000 7f461fb8a640 10 monclient: get_monmap_and_config 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.080+0000 7f461fb8a640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.080+0000 7f461fb8a640 10 monclient: monmap: 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:34.081506+0000 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:34.081506+0000 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.083 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.084 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.084 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.084 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 1 Processor -- start 2026-02-25T15:19:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 1 -- start start 2026-02-25T15:19:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 10 monclient: init 2026-02-25T15:19:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 10 monclient(hunting): picked mon.noname-a con 0x7f4618159e10 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 10 monclient(hunting): picked mon.noname-c con 0x7f461815a1e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 10 monclient(hunting): picked mon.noname-b con 0x7f4618161ac0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4618055ab0 con 0x7f4618159e10 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4618055d50 con 0x7f4618161ac0 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4618056030 con 0x7f461815a1e0 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.081+0000 7f461fb8a640 10 monclient(hunting): authenticate will time out at 3743.670705s 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.082+0000 7f461d8ff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f4618159e10 0x7f4618059c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40682/0 (socket says 10.20.193.78:40682) 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.082+0000 7f461d8ff640 1 -- 10.20.193.78:0/3225429267 learned_addr learned my addr 10.20.193.78:0/3225429267 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288899894 0 0) 0x7f4618055ab0 con 0x7f4618159e10 2026-02-25T15:19:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 10 monclient(hunting): my global_id is 30915 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4600003610 con 0x7f4618159e10 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172683553 0 0) 0x7f4618055d50 con 0x7f4618161ac0 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 10 monclient(hunting): my global_id is 30205 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.083+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4618055ab0 con 0x7f4618161ac0 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.084+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498063518 0 0) 0x7f4618056030 con 0x7f461815a1e0 2026-02-25T15:19:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.084+0000 7f461c8fd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.084+0000 7f461c8fd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.084+0000 7f461c8fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.084+0000 7f461c8fd640 10 monclient(hunting): my global_id is 27749 2026-02-25T15:19:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.084+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4618055d50 con 0x7f461815a1e0 2026-02-25T15:19:34.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 853736899 0 0) 0x7f4600003610 con 0x7f4618159e10 2026-02-25T15:19:34.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 >> v1:10.20.193.167:6789/0 conn(0x7f461815a1e0 legacy=0x7f46181613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 >> v1:10.20.193.155:6789/0 conn(0x7f4618161ac0 legacy=0x7f461815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 1 monclient: found mon.noname-a 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4618056310 con 0x7f4618159e10 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4608002df0 con 0x7f4618159e10 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: dump: 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461fb8a640 5 monclient: authenticate success, global_id 30915 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461fb8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4608002fc0 con 0x7f4618159e10 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 1 -- 10.20.193.78:0/3225429267 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4608003400 con 0x7f4618159e10 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.085+0000 7f461c8fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461c8fd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461c8fd640 10 monclient: dump: 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.098 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 4 set_mon_vals no callback set 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 10 monclient: shutdown 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 1 -- 10.20.193.78:0/3225429267 >> v1:10.20.193.78:6789/0 conn(0x7f4618159e10 legacy=0x7f4618059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 1 -- 10.20.193.78:0/3225429267 shutdown_connections 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 1 -- 10.20.193.78:0/3225429267 >> 10.20.193.78:0/3225429267 conn(0x7f46180b2f60 msgr2=0x7f46180b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 1 -- 10.20.193.78:0/3225429267 shutdown_connections 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 1 -- 10.20.193.78:0/3225429267 wait complete. 2026-02-25T15:19:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 10 monclient: monmap: 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 1 librados: starting msgr at 2026-02-25T15:19:34.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 1 librados: starting objecter 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.086+0000 7f461fb8a640 1 Processor -- start 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 1 -- start start 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 1 librados: setting wanted keys 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 1 librados: calling monclient init 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 10 monclient: init 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 10 monclient(hunting): picked mon.noname-b con 0x7f4618159e10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 10 monclient(hunting): picked mon.noname-c con 0x7f461815a1e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 10 monclient(hunting): picked mon.noname-a con 0x7f4618161ac0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461805a020 con 0x7f4618161ac0 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46181fb050 con 0x7f4618159e10 2026-02-25T15:19:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46181fb330 con 0x7f461815a1e0 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461fb8a640 10 monclient(hunting): authenticate will time out at 3743.676500s 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461e100640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f4618161ac0 0x7f4618158130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40684/0 (socket says 10.20.193.78:40684) 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f461e100640 1 -- 10.20.193.78:0/2619044436 learned_addr learned my addr 10.20.193.78:0/2619044436 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f46067fc640 10 client.?.objecter ms_handle_connect 0x7f4618161ac0 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f46067fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f46067fc640 10 client.?.objecter ms_handle_connect 0x7f461815a1e0 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.087+0000 7f46067fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.088+0000 7f46067fc640 10 client.?.objecter ms_handle_connect 0x7f4618159e10 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.088+0000 7f46067fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.088+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419167886 0 0) 0x7f461805a020 con 0x7f4618161ac0 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.088+0000 7f46067fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.088+0000 7f46067fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.088+0000 7f46067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.088+0000 7f46067fc640 10 monclient(hunting): my global_id is 30918 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.088+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45e8003610 con 0x7f4618161ac0 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 244647336 0 0) 0x7f46181fb330 con 0x7f461815a1e0 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 10 monclient(hunting): my global_id is 27752 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f461805a020 con 0x7f461815a1e0 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956511649 0 0) 0x7f46181fb050 con 0x7f4618159e10 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 10 monclient(hunting): my global_id is 30208 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.089+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46181fb330 con 0x7f4618159e10 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.090+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2071906995 0 0) 0x7f45e8003610 con 0x7f4618161ac0 2026-02-25T15:19:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.090+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46181fb050 con 0x7f4618161ac0 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f46140033f0 con 0x7f4618161ac0 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): dump: 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3280935721 0 0) 0x7f46181fb330 con 0x7f4618159e10 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45e8003610 con 0x7f4618159e10 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4608003310 con 0x7f4618159e10 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): dump: 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4151931318 0 0) 0x7f461805a020 con 0x7f461815a1e0 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46181fb330 con 0x7f461815a1e0 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f460c003050 con 0x7f461815a1e0 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.091+0000 7f46067fc640 10 monclient(hunting): dump: 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1006953585 0 0) 0x7f46181fb050 con 0x7f4618161ac0 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 >> v1:10.20.193.167:6789/0 conn(0x7f461815a1e0 legacy=0x7f4618138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 >> v1:10.20.193.155:6789/0 conn(0x7f4618159e10 legacy=0x7f4618059910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 1 monclient: found mon.a 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46181fb610 con 0x7f4618161ac0 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f46067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 5 monclient: authenticate success, global_id 30918 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 10 monclient: _renew_subs 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46181fb8f0 con 0x7f4618161ac0 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 10 client.30918.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 10 monclient: _renew_subs 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4618163670 con 0x7f4618161ac0 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.092+0000 7f461fb8a640 1 librados: init done 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.093+0000 7f461fb8a640 10 client.30918.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.093+0000 7f461fb8a640 15 client.30918.objecter _session_command_op_assign -1 1 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.093+0000 7f461fb8a640 20 client.30918.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.093+0000 7f461fb8a640 10 client.30918.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.093+0000 7f461fb8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.093+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4618056c80 con 0x7f4618161ac0 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.102+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4618056c80 con 0x7f4618161ac0 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.102+0000 7f46067fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.102+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f4614003c20 con 0x7f4618161ac0 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.102+0000 7f46067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.102+0000 7f46067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.102+0000 7f4607fff640 4 set_mon_vals no callback set 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.102+0000 7f46067fc640 10 monclient: dump: 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.110 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.103+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f4614003e00 con 0x7f4618161ac0 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.103+0000 7f461d8ff640 10 monclient: get_auth_request con 0x7f45e8077ed0 auth_method 0 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.103+0000 7f46067fc640 10 client.30918.objecter ms_handle_connect 0x7f45e8077ed0 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f4614093340 con 0x7f4618161ac0 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 10 client.30918.objecter ms_dispatch2 0x7f4618000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 3 client.30918.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 3 client.30918.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 10 client.30918.objecter checking command 1 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 20 client.30918.objecter _get_session s=0x7f45e80a2180 osd=3 3 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 20 client.30918.objecter put_session s=0x7f45e80a2180 osd=3 3 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 15 client.30918.objecter _session_command_op_remove -1 1 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 20 client.30918.objecter _get_session s=0x7f45e80a2180 osd=3 3 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 20 client.30918.objecter get_session s=0x7f45e80a2180 osd=3 3 2026-02-25T15:19:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 15 client.30918.objecter _session_command_op_assign 3 1 2026-02-25T15:19:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 20 client.30918.objecter put_session s=0x7f45e80a2180 osd=3 4 2026-02-25T15:19:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 10 client.30918.objecter _send_command 1 2026-02-25T15:19:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.174:6804/3507256265 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45e80c4490 con 0x7f45e80a2830 2026-02-25T15:19:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 20 client.30918.objecter dump_active .. 0 homeless 2026-02-25T15:19:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f461405d440 con 0x7f4618161ac0 2026-02-25T15:19:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.104+0000 7f46067fc640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.105+0000 7f461d0fe640 10 monclient: get_auth_request con 0x7f45e80a2830 auth_method 0 2026-02-25T15:19:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.106+0000 7f46067fc640 10 client.30918.objecter ms_handle_connect 0x7f45e80a2830 2026-02-25T15:19:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.117+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== osd.3 v1:10.20.193.174:6804/3507256265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f45e80c4490 con 0x7f45e80a2830 2026-02-25T15:19:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.117+0000 7f46067fc640 10 client.30918.objecter ms_dispatch2 0x7f4618000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.117+0000 7f46067fc640 10 client.30918.objecter _finish_command 1 = system:0 2026-02-25T15:19:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.117+0000 7f46067fc640 20 client.30918.objecter put_session s=0x7f45e80a2180 osd=3 4 2026-02-25T15:19:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.117+0000 7f46067fc640 15 client.30918.objecter _session_command_op_remove 3 1 2026-02-25T15:19:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 10 client.30918.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 15 client.30918.objecter _session_command_op_assign -1 2 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 20 client.30918.objecter _get_session s=0x7f45e80a2180 osd=3 3 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 20 client.30918.objecter put_session s=0x7f45e80a2180 osd=3 3 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 20 client.30918.objecter _get_session s=0x7f45e80a2180 osd=3 3 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 15 client.30918.objecter _session_command_op_remove -1 2 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 20 client.30918.objecter get_session s=0x7f45e80a2180 osd=3 3 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 15 client.30918.objecter _session_command_op_assign 3 2 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 20 client.30918.objecter put_session s=0x7f45e80a2180 osd=3 4 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 10 client.30918.objecter _send_command 2 2026-02-25T15:19:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.124+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 --> v1:10.20.193.174:6804/3507256265 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4618058ea0 con 0x7f45e80a2830 2026-02-25T15:19:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f46067fc640 1 -- 10.20.193.78:0/2619044436 <== osd.3 v1:10.20.193.174:6804/3507256265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f4618058ea0 con 0x7f45e80a2830 2026-02-25T15:19:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f46067fc640 10 client.30918.objecter ms_dispatch2 0x7f4618000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f46067fc640 10 client.30918.objecter _finish_command 2 = system:0 2026-02-25T15:19:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f46067fc640 20 client.30918.objecter put_session s=0x7f45e80a2180 osd=3 4 2026-02-25T15:19:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f46067fc640 15 client.30918.objecter _session_command_op_remove 3 2 2026-02-25T15:19:34.135 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:34.135 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:34.135 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f461fb8a640 10 librados: watch_flush enter 2026-02-25T15:19:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f461fb8a640 10 librados: watch_flush exit 2026-02-25T15:19:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f461fb8a640 10 client.30918.objecter close_session for osd.3 2026-02-25T15:19:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 >> v1:10.20.193.174:6804/3507256265 conn(0x7f45e80a2830 legacy=0x7f45e80c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f461fb8a640 20 client.30918.objecter put_session s=0x7f45e80a2180 osd=3 1 2026-02-25T15:19:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f461fb8a640 20 client.30918.objecter shutdown clearing up homeless session... 2026-02-25T15:19:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.131+0000 7f461fb8a640 10 client.30918.objecter successfully canceled tick 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 >> v1:10.20.193.78:6800/3497602169 conn(0x7f45e8077ed0 legacy=0x7f45e8098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 10 monclient: shutdown 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 >> v1:10.20.193.78:6789/0 conn(0x7f4618161ac0 legacy=0x7f4618158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461e100640 1 -- 10.20.193.78:0/2619044436 reap_dead start 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 shutdown_connections 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 >> 10.20.193.78:0/2619044436 conn(0x7f46180b2f60 msgr2=0x7f4618159450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 shutdown_connections 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 1 -- 10.20.193.78:0/2619044436 wait complete. 2026-02-25T15:19:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.132+0000 7f461fb8a640 1 librados: shutdown 2026-02-25T15:19:34.143 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-25T15:19:34.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.208+0000 7fc4d07c3640 10 monclient: get_monmap_and_config 2026-02-25T15:19:34.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.208+0000 7fc4d07c3640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.208+0000 7fc4d07c3640 10 monclient: monmap: 2026-02-25T15:19:34.211 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.211 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.211 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:34.209584+0000 2026-02-25T15:19:34.211 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:34.209584+0000 2026-02-25T15:19:34.211 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.212 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.212 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.212 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.212 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.212 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 1 Processor -- start 2026-02-25T15:19:34.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 1 -- start start 2026-02-25T15:19:34.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 10 monclient: init 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 10 monclient(hunting): picked mon.noname-a con 0x7fc4c8157780 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 10 monclient(hunting): picked mon.noname-b con 0x7fc4c8157b50 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 10 monclient(hunting): picked mon.noname-c con 0x7fc4c8164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c805de70 con 0x7fc4c8157780 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c8055b20 con 0x7fc4c8157b50 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c8055e00 con 0x7fc4c8164d00 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.209+0000 7fc4d07c3640 10 monclient(hunting): authenticate will time out at 3743.798770s 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.210+0000 7fc4ced39640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fc4c8164d00 0x7fc4c81c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41688/0 (socket says 10.20.193.78:41688) 2026-02-25T15:19:34.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.210+0000 7fc4ced39640 1 -- 10.20.193.78:0/2220405075 learned_addr learned my addr 10.20.193.78:0/2220405075 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.210+0000 7fc4ced39640 1 -- 10.20.193.78:0/2220405075 >> v1:10.20.193.167:6789/0 conn(0x7fc4c8164d00 legacy=0x7fc4c81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.210+0000 7fc4ced39640 1 -- 10.20.193.78:0/2220405075 >> v1:10.20.193.167:6789/0 conn(0x7fc4c8164d00 legacy=0x7fc4c81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.210+0000 7fc4ced39640 1 --1- 10.20.193.78:0/2220405075 >> v1:10.20.193.167:6789/0 conn(0x7fc4c8164d00 0x7fc4c81c5980 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020162798 0 0) 0x7fc4c8055b20 con 0x7fc4c8157b50 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 10 monclient(hunting): my global_id is 30211 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4b0003610 con 0x7fc4c8157b50 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955013155 0 0) 0x7fc4c805de70 con 0x7fc4c8157780 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 10 monclient(hunting): my global_id is 30921 2026-02-25T15:19:34.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.211+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c8055b20 con 0x7fc4c8157780 2026-02-25T15:19:34.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1002319732 0 0) 0x7fc4b0003610 con 0x7fc4c8157b50 2026-02-25T15:19:34.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 >> v1:10.20.193.167:6789/0 conn(0x7fc4c8164d00 legacy=0x7fc4c81c5980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 >> v1:10.20.193.78:6789/0 conn(0x7fc4c8157780 legacy=0x7fc4c8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 1 monclient: found mon.noname-b 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c80560e0 con 0x7fc4c8157b50 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc4bc002df0 con 0x7fc4c8157b50 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4d07c3640 5 monclient: authenticate success, global_id 30211 2026-02-25T15:19:34.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4cd536640 10 monclient: dump: 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.224 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.213+0000 7fc4d07c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4bc003000 con 0x7fc4c8157b50 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4cd536640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4cd536640 1 -- 10.20.193.78:0/2220405075 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc4bc003440 con 0x7fc4c8157b50 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4cd536640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4cd536640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4cd536640 10 monclient: dump: 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.225 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 4 set_mon_vals no callback set 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 10 monclient: shutdown 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 1 -- 10.20.193.78:0/2220405075 >> v1:10.20.193.155:6789/0 conn(0x7fc4c8157b50 legacy=0x7fc4c81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 1 -- 10.20.193.78:0/2220405075 shutdown_connections 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 1 -- 10.20.193.78:0/2220405075 >> 10.20.193.78:0/2220405075 conn(0x7fc4c80b2ef0 msgr2=0x7fc4c80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 1 -- 10.20.193.78:0/2220405075 shutdown_connections 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 1 -- 10.20.193.78:0/2220405075 wait complete. 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.214+0000 7fc4d07c3640 10 monclient: monmap: 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.227 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 librados: starting msgr at 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 librados: starting objecter 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 Processor -- start 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 -- start start 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 librados: setting wanted keys 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 librados: calling monclient init 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 10 monclient: init 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 10 monclient(hunting): picked mon.noname-b con 0x7fc4c8157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 10 monclient(hunting): picked mon.noname-a con 0x7fc4c8157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 10 monclient(hunting): picked mon.noname-c con 0x7fc4c8164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c812bdc0 con 0x7fc4c8157b50 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c812c0a0 con 0x7fc4c8157780 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c812c380 con 0x7fc4c8164d00 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4d07c3640 10 monclient(hunting): authenticate will time out at 3743.804560s 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4cdd37640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc4c8157b50 0x7fc4c805c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40698/0 (socket says 10.20.193.78:40698) 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.215+0000 7fc4cdd37640 1 -- 10.20.193.78:0/1690506382 learned_addr learned my addr 10.20.193.78:0/1690506382 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 client.?.objecter ms_handle_connect 0x7fc4c8157b50 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 client.?.objecter ms_handle_connect 0x7fc4c8157780 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 client.?.objecter ms_handle_connect 0x7fc4c8164d00 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924192921 0 0) 0x7fc4c812bdc0 con 0x7fc4c8157b50 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 10 monclient(hunting): my global_id is 30924 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc498003610 con 0x7fc4c8157b50 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.216+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175632364 0 0) 0x7fc4c812c0a0 con 0x7fc4c8157780 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 10 monclient(hunting): my global_id is 30214 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c812bdc0 con 0x7fc4c8157780 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798344055 0 0) 0x7fc4c812c380 con 0x7fc4c8164d00 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 10 monclient(hunting): my global_id is 27755 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.217+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c812c0a0 con 0x7fc4c8164d00 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2486833914 0 0) 0x7fc4c812bdc0 con 0x7fc4c8157780 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4c812c380 con 0x7fc4c8157780 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc4b80030b0 con 0x7fc4c8157780 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 10 monclient(hunting): dump: 2026-02-25T15:19:34.231 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3079462631 0 0) 0x7fc498003610 con 0x7fc4c8157b50 2026-02-25T15:19:34.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4c812bdc0 con 0x7fc4c8157b50 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc4bc003390 con 0x7fc4c8157b50 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.219+0000 7fc4aeffd640 10 monclient(hunting): dump: 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.233 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3234092957 0 0) 0x7fc4c812c0a0 con 0x7fc4c8164d00 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc498003610 con 0x7fc4c8164d00 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc4c4003040 con 0x7fc4c8164d00 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 10 monclient(hunting): dump: 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.234 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.235 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.235 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.235 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.235 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 586773322 0 0) 0x7fc4c812c380 con 0x7fc4c8157780 2026-02-25T15:19:34.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 >> v1:10.20.193.167:6789/0 conn(0x7fc4c8164d00 legacy=0x7fc4c8148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 >> v1:10.20.193.78:6789/0 conn(0x7fc4c8157b50 legacy=0x7fc4c805c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 1 monclient: found mon.b 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c812c660 con 0x7fc4c8157780 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 5 monclient: authenticate success, global_id 30214 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 10 monclient: _renew_subs 2026-02-25T15:19:34.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c812c940 con 0x7fc4c8157780 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 10 client.30214.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 10 monclient: _renew_subs 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc4c812eb70 con 0x7fc4c8157780 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.220+0000 7fc4d07c3640 1 librados: init done 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.221+0000 7fc4d07c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.221+0000 7fc4d07c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.221+0000 7fc4d07c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.221+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c8059810 con 0x7fc4c8157780 2026-02-25T15:19:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.312+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4b8003700 con 0x7fc4c8157780 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.312+0000 7fc4aeffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.312+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fc4b8003a50 con 0x7fc4c8157780 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.312+0000 7fc4aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.312+0000 7fc4aeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.312+0000 7fc4aeffd640 10 monclient: dump: 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.315 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.316 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.316 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.312+0000 7fc4ccd35640 4 set_mon_vals no callback set 2026-02-25T15:19:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.313+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fc4b801c8c0 con 0x7fc4c8157780 2026-02-25T15:19:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.313+0000 7fc4cdd37640 10 monclient: get_auth_request con 0x7fc498077e20 auth_method 0 2026-02-25T15:19:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.313+0000 7fc4aeffd640 10 client.30214.objecter ms_handle_connect 0x7fc498077e20 2026-02-25T15:19:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.315+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fc4b8092040 con 0x7fc4c8157780 2026-02-25T15:19:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.315+0000 7fc4aeffd640 10 client.30214.objecter ms_dispatch2 0x7fc4c8000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.315+0000 7fc4aeffd640 3 client.30214.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.315+0000 7fc4aeffd640 3 client.30214.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.315+0000 7fc4aeffd640 20 client.30214.objecter dump_active .. 0 homeless 2026-02-25T15:19:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.316+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc4b805ca70 con 0x7fc4c8157780 2026-02-25T15:19:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.316+0000 7fc4aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.316+0000 7fc4aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:34.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.421+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc4c80b3640 con 0x7fc498077e20 2026-02-25T15:19:34.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.421+0000 7fc4aeffd640 1 -- 10.20.193.78:0/1690506382 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7fc4c80b3640 con 0x7fc498077e20 2026-02-25T15:19:34.424 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 3 to deep-scrub 2026-02-25T15:19:34.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 10 librados: watch_flush enter 2026-02-25T15:19:34.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 10 librados: watch_flush exit 2026-02-25T15:19:34.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 20 client.30214.objecter shutdown clearing up homeless session... 2026-02-25T15:19:34.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 10 client.30214.objecter successfully canceled tick 2026-02-25T15:19:34.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 >> v1:10.20.193.78:6800/3497602169 conn(0x7fc498077e20 legacy=0x7fc4980982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 10 monclient: shutdown 2026-02-25T15:19:34.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 >> v1:10.20.193.155:6789/0 conn(0x7fc4c8157780 legacy=0x7fc4c812d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 shutdown_connections 2026-02-25T15:19:34.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 >> 10.20.193.78:0/1690506382 conn(0x7fc4c80b2ef0 msgr2=0x7fc4c80ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 shutdown_connections 2026-02-25T15:19:34.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 1 -- 10.20.193.78:0/1690506382 wait complete. 2026-02-25T15:19:34.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.422+0000 7fc4d07c3640 1 librados: shutdown 2026-02-25T15:19:34.434 INFO:tasks.ceph:Scrubbing osd.7 2026-02-25T15:19:34.434 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:34.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.500+0000 7fd5014fe640 10 monclient: get_monmap_and_config 2026-02-25T15:19:34.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.500+0000 7fd5014fe640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.500+0000 7fd5014fe640 10 monclient: monmap: 2026-02-25T15:19:34.503 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.503 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.503 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:34.501642+0000 2026-02-25T15:19:34.503 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:34.501642+0000 2026-02-25T15:19:34.504 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.504 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.504 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.504 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.504 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.504 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 1 Processor -- start 2026-02-25T15:19:34.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 1 -- start start 2026-02-25T15:19:34.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 10 monclient: init 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 10 monclient(hunting): picked mon.noname-c con 0x7fd4fc15e2a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 10 monclient(hunting): picked mon.noname-a con 0x7fd4fc059e10 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 10 monclient(hunting): picked mon.noname-b con 0x7fd4fc1a5660 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4fc162df0 con 0x7fd4fc059e10 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4fc1630d0 con 0x7fd4fc1a5660 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4fc1633b0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.501+0000 7fd5014fe640 10 monclient(hunting): authenticate will time out at 3744.090788s 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.502+0000 7fd4faffd640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7fd4fc15e2a0 0x7fd4fc05da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41700/0 (socket says 10.20.193.78:41700) 2026-02-25T15:19:34.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.502+0000 7fd4faffd640 1 -- 10.20.193.78:0/1392659614 learned_addr learned my addr 10.20.193.78:0/1392659614 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416407552 0 0) 0x7fd4fc1630d0 con 0x7fd4fc1a5660 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): my global_id is 30217 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4e8003610 con 0x7fd4fc1a5660 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240889978 0 0) 0x7fd4fc1633b0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): my global_id is 27758 2026-02-25T15:19:34.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc1630d0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740663787 0 0) 0x7fd4fc162df0 con 0x7fd4fc059e10 2026-02-25T15:19:34.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 10 monclient(hunting): my global_id is 30927 2026-02-25T15:19:34.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.503+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc1633b0 con 0x7fd4fc059e10 2026-02-25T15:19:34.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2959466465 0 0) 0x7fd4e8003610 con 0x7fd4fc1a5660 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 >> v1:10.20.193.167:6789/0 conn(0x7fd4fc15e2a0 legacy=0x7fd4fc05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 >> v1:10.20.193.78:6789/0 conn(0x7fd4fc059e10 legacy=0x7fd4fc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 1 monclient: found mon.noname-b 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc163690 con 0x7fd4fc1a5660 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd4ec003170 con 0x7fd4fc1a5660 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd4f9ffb640 10 monclient: dump: 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.518 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd5014fe640 5 monclient: authenticate success, global_id 30217 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.505+0000 7fd5014fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4ec0033c0 con 0x7fd4fc1a5660 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd4f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd4f9ffb640 1 -- 10.20.193.78:0/1392659614 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd4ec003800 con 0x7fd4fc1a5660 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd4f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd4f9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd4f9ffb640 10 monclient: dump: 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.519 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 4 set_mon_vals no callback set 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 10 monclient: shutdown 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 1 -- 10.20.193.78:0/1392659614 >> v1:10.20.193.155:6789/0 conn(0x7fd4fc1a5660 legacy=0x7fd4fc1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 1 -- 10.20.193.78:0/1392659614 shutdown_connections 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 1 -- 10.20.193.78:0/1392659614 >> 10.20.193.78:0/1392659614 conn(0x7fd4fc0b2f60 msgr2=0x7fd4fc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 1 -- 10.20.193.78:0/1392659614 shutdown_connections 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.506+0000 7fd5014fe640 1 -- 10.20.193.78:0/1392659614 wait complete. 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient: monmap: 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:34.521 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 librados: starting msgr at 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 librados: starting objecter 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 Processor -- start 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 -- start start 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 librados: setting wanted keys 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 librados: calling monclient init 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient: init 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient(hunting): picked mon.noname-b con 0x7fd4fc059e10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient(hunting): picked mon.noname-a con 0x7fd4fc15e2a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient(hunting): picked mon.noname-c con 0x7fd4fc1a5660 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4fc0577b0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4fc191240 con 0x7fd4fc059e10 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4fc12bcc0 con 0x7fd4fc1a5660 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.507+0000 7fd5014fe640 10 monclient(hunting): authenticate will time out at 3744.096902s 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.508+0000 7fd4fa7fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd4fc15e2a0 0x7fd4fc12b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40714/0 (socket says 10.20.193.78:40714) 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.508+0000 7fd4fa7fc640 1 -- 10.20.193.78:0/1168301356 learned_addr learned my addr 10.20.193.78:0/1168301356 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.508+0000 7fd4db7fe640 10 client.?.objecter ms_handle_connect 0x7fd4fc15e2a0 2026-02-25T15:19:34.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.508+0000 7fd4db7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.508+0000 7fd4db7fe640 10 client.?.objecter ms_handle_connect 0x7fd4fc059e10 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.508+0000 7fd4db7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 client.?.objecter ms_handle_connect 0x7fd4fc1a5660 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511459421 0 0) 0x7fd4fc0577b0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 monclient(hunting): my global_id is 30930 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c8003610 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3861074882 0 0) 0x7fd4fc191240 con 0x7fd4fc059e10 2026-02-25T15:19:34.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 10 monclient(hunting): my global_id is 30220 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.509+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc0577b0 con 0x7fd4fc059e10 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.510+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1227121393 0 0) 0x7fd4fc12bcc0 con 0x7fd4fc1a5660 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.510+0000 7fd4db7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.510+0000 7fd4db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.510+0000 7fd4db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.510+0000 7fd4db7fe640 10 monclient(hunting): my global_id is 27761 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.510+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc191240 con 0x7fd4fc1a5660 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.511+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1350414085 0 0) 0x7fd4c8003610 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.511+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4fc12bcc0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.511+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd4e40030c0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.511+0000 7fd4db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.511+0000 7fd4db7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.511+0000 7fd4db7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.526 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.511+0000 7fd4db7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3152222813 0 0) 0x7fd4fc0577b0 con 0x7fd4fc059e10 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4c8003610 con 0x7fd4fc059e10 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd4f00030b0 con 0x7fd4fc059e10 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.527 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 209595062 0 0) 0x7fd4fc191240 con 0x7fd4fc1a5660 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4fc0577b0 con 0x7fd4fc1a5660 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd4ec003570 con 0x7fd4fc1a5660 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.512+0000 7fd4db7fe640 10 monclient(hunting): dump: 2026-02-25T15:19:34.528 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 971352525 0 0) 0x7fd4fc12bcc0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 >> v1:10.20.193.167:6789/0 conn(0x7fd4fc1a5660 legacy=0x7fd4fc129550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 >> v1:10.20.193.155:6789/0 conn(0x7fd4fc059e10 legacy=0x7fd4fc190b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 1 monclient: found mon.a 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc056950 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd4db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 5 monclient: authenticate success, global_id 30930 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 10 monclient: _renew_subs 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd4fc056c30 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 10 client.30930.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 10 monclient: _renew_subs 2026-02-25T15:19:34.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd4fc0571f0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 1 librados: init done 2026-02-25T15:19:34.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 10 client.30930.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 15 client.30930.objecter _session_command_op_assign -1 1 2026-02-25T15:19:34.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 20 client.30930.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:34.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 10 client.30930.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:34.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.513+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd4fc052f50 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.521+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4fc052f50 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.521+0000 7fd4db7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.521+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fd4e40038a0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.521+0000 7fd4db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.521+0000 7fd4db7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.521+0000 7fd4db7fe640 10 monclient: dump: 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.534 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.521+0000 7fd4f97fa640 4 set_mon_vals no callback set 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.522+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fd4e4003ab0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4faffd640 10 monclient: get_auth_request con 0x7fd4c8077e70 auth_method 0 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 10 client.30930.objecter ms_handle_connect 0x7fd4c8077e70 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fd4e40038a0 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 10 client.30930.objecter ms_dispatch2 0x7fd4fc000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 3 client.30930.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 3 client.30930.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 10 client.30930.objecter checking command 1 2026-02-25T15:19:34.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 20 client.30930.objecter _get_session s=0x7fd4c80a2120 osd=7 3 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 20 client.30930.objecter put_session s=0x7fd4c80a2120 osd=7 3 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 15 client.30930.objecter _session_command_op_remove -1 1 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 20 client.30930.objecter _get_session s=0x7fd4c80a2120 osd=7 3 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 20 client.30930.objecter get_session s=0x7fd4c80a2120 osd=7 3 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 15 client.30930.objecter _session_command_op_assign 7 1 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 20 client.30930.objecter put_session s=0x7fd4c80a2120 osd=7 4 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 10 client.30930.objecter _send_command 1 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.174:6809/463709274 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4c80c44d0 con 0x7fd4c80a27d0 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 20 client.30930.objecter dump_active .. 0 homeless 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7fd4e4059640 con 0x7fd4fc15e2a0 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.523+0000 7fd4db7fe640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.524+0000 7fd4fb7fe640 10 monclient: get_auth_request con 0x7fd4c80a27d0 auth_method 0 2026-02-25T15:19:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.524+0000 7fd4db7fe640 10 client.30930.objecter ms_handle_connect 0x7fd4c80a27d0 2026-02-25T15:19:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.534+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== osd.7 v1:10.20.193.174:6809/463709274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd4c80c44d0 con 0x7fd4c80a27d0 2026-02-25T15:19:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.534+0000 7fd4db7fe640 10 client.30930.objecter ms_dispatch2 0x7fd4fc000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.534+0000 7fd4db7fe640 10 client.30930.objecter _finish_command 1 = system:0 2026-02-25T15:19:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.534+0000 7fd4db7fe640 20 client.30930.objecter put_session s=0x7fd4c80a2120 osd=7 4 2026-02-25T15:19:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.534+0000 7fd4db7fe640 15 client.30930.objecter _session_command_op_remove 7 1 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 10 client.30930.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 15 client.30930.objecter _session_command_op_assign -1 2 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 20 client.30930.objecter _get_session s=0x7fd4c80a2120 osd=7 3 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 20 client.30930.objecter put_session s=0x7fd4c80a2120 osd=7 3 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 20 client.30930.objecter _get_session s=0x7fd4c80a2120 osd=7 3 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 15 client.30930.objecter _session_command_op_remove -1 2 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 20 client.30930.objecter get_session s=0x7fd4c80a2120 osd=7 3 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 15 client.30930.objecter _session_command_op_assign 7 2 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 20 client.30930.objecter put_session s=0x7fd4c80a2120 osd=7 4 2026-02-25T15:19:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 10 client.30930.objecter _send_command 2 2026-02-25T15:19:34.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.542+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 --> v1:10.20.193.174:6809/463709274 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd4fc058ea0 con 0x7fd4c80a27d0 2026-02-25T15:19:34.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd4db7fe640 1 -- 10.20.193.78:0/1168301356 <== osd.7 v1:10.20.193.174:6809/463709274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd4fc058ea0 con 0x7fd4c80a27d0 2026-02-25T15:19:34.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd4db7fe640 10 client.30930.objecter ms_dispatch2 0x7fd4fc000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:34.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd4db7fe640 10 client.30930.objecter _finish_command 2 = system:0 2026-02-25T15:19:34.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd4db7fe640 20 client.30930.objecter put_session s=0x7fd4c80a2120 osd=7 4 2026-02-25T15:19:34.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd4db7fe640 15 client.30930.objecter _session_command_op_remove 7 2 2026-02-25T15:19:34.553 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:34.553 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:34.553 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 10 librados: watch_flush enter 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 10 librados: watch_flush exit 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 10 client.30930.objecter close_session for osd.7 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 >> v1:10.20.193.174:6809/463709274 conn(0x7fd4c80a27d0 legacy=0x7fd4c80c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 20 client.30930.objecter put_session s=0x7fd4c80a2120 osd=7 1 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 20 client.30930.objecter shutdown clearing up homeless session... 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 10 client.30930.objecter successfully canceled tick 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 >> v1:10.20.193.78:6800/3497602169 conn(0x7fd4c8077e70 legacy=0x7fd4c8098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 10 monclient: shutdown 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 >> v1:10.20.193.78:6789/0 conn(0x7fd4fc15e2a0 legacy=0x7fd4fc12b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd4fb7fe640 1 -- 10.20.193.78:0/1168301356 reap_dead start 2026-02-25T15:19:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 shutdown_connections 2026-02-25T15:19:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 >> 10.20.193.78:0/1168301356 conn(0x7fd4fc0b2f60 msgr2=0x7fd4fc0593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 shutdown_connections 2026-02-25T15:19:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 1 -- 10.20.193.78:0/1168301356 wait complete. 2026-02-25T15:19:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.550+0000 7fd5014fe640 1 librados: shutdown 2026-02-25T15:19:34.561 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-25T15:19:34.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.626+0000 7f9a5f783640 10 monclient: get_monmap_and_config 2026-02-25T15:19:34.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.626+0000 7f9a5f783640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.626+0000 7f9a5f783640 10 monclient: monmap: 2026-02-25T15:19:34.629 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.629 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.629 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:34.627538+0000 2026-02-25T15:19:34.629 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:34.627538+0000 2026-02-25T15:19:34.630 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.630 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.630 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.630 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.630 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.630 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 1 Processor -- start 2026-02-25T15:19:34.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 1 -- start start 2026-02-25T15:19:34.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 10 monclient: init 2026-02-25T15:19:34.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:34.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 10 monclient(hunting): picked mon.noname-c con 0x7f9a581566e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 10 monclient(hunting): picked mon.noname-b con 0x7f9a58160c00 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 10 monclient(hunting): picked mon.noname-a con 0x7f9a58156ab0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a58058480 con 0x7f9a58156ab0 2026-02-25T15:19:34.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a58058760 con 0x7f9a58160c00 2026-02-25T15:19:34.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.627+0000 7f9a5f783640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a580b0f90 con 0x7f9a581566e0 2026-02-25T15:19:34.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.628+0000 7f9a5f783640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.628+0000 7f9a5f783640 10 monclient(hunting): authenticate will time out at 3744.217009s 2026-02-25T15:19:34.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.628+0000 7f9a5dcf9640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9a58156ab0 0x7f9a58055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40722/0 (socket says 10.20.193.78:40722) 2026-02-25T15:19:34.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.628+0000 7f9a5dcf9640 1 -- 10.20.193.78:0/1567135184 learned_addr learned my addr 10.20.193.78:0/1567135184 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766453668 0 0) 0x7f9a58058480 con 0x7f9a58156ab0 2026-02-25T15:19:34.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 10 monclient(hunting): my global_id is 30933 2026-02-25T15:19:34.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a40003610 con 0x7f9a58156ab0 2026-02-25T15:19:34.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906123635 0 0) 0x7f9a58058760 con 0x7f9a58160c00 2026-02-25T15:19:34.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 10 monclient(hunting): my global_id is 30223 2026-02-25T15:19:34.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.629+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a58058480 con 0x7f9a58160c00 2026-02-25T15:19:34.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.630+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089438515 0 0) 0x7f9a580b0f90 con 0x7f9a581566e0 2026-02-25T15:19:34.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.630+0000 7f9a47fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.630+0000 7f9a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.630+0000 7f9a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.630+0000 7f9a47fff640 10 monclient(hunting): my global_id is 27764 2026-02-25T15:19:34.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.630+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a58058760 con 0x7f9a581566e0 2026-02-25T15:19:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3320173495 0 0) 0x7f9a40003610 con 0x7f9a58156ab0 2026-02-25T15:19:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 >> v1:10.20.193.167:6789/0 conn(0x7f9a581566e0 legacy=0x7f9a580b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 >> v1:10.20.193.155:6789/0 conn(0x7f9a58160c00 legacy=0x7f9a58057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 1 monclient: found mon.noname-a 2026-02-25T15:19:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a580b1270 con 0x7f9a58156ab0 2026-02-25T15:19:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9a54003170 con 0x7f9a58156ab0 2026-02-25T15:19:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a47fff640 10 monclient: dump: 2026-02-25T15:19:34.652 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.653 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.653 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.653 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.653 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.653 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.653 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.654 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.654 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a5f783640 5 monclient: authenticate success, global_id 30933 2026-02-25T15:19:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.631+0000 7f9a5f783640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a54003340 con 0x7f9a58156ab0 2026-02-25T15:19:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a47fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a47fff640 1 -- 10.20.193.78:0/1567135184 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9a54003780 con 0x7f9a58156ab0 2026-02-25T15:19:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a47fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a47fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a47fff640 10 monclient: dump: 2026-02-25T15:19:34.655 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.656 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.656 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.656 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.656 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.656 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.656 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.657 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.657 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.657 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:34.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 4 set_mon_vals no callback set 2026-02-25T15:19:34.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 10 monclient: shutdown 2026-02-25T15:19:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 1 -- 10.20.193.78:0/1567135184 >> v1:10.20.193.78:6789/0 conn(0x7f9a58156ab0 legacy=0x7f9a58055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 1 -- 10.20.193.78:0/1567135184 shutdown_connections 2026-02-25T15:19:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 1 -- 10.20.193.78:0/1567135184 >> 10.20.193.78:0/1567135184 conn(0x7f9a580b2ef0 msgr2=0x7f9a580b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 1 -- 10.20.193.78:0/1567135184 shutdown_connections 2026-02-25T15:19:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.632+0000 7f9a5f783640 1 -- 10.20.193.78:0/1567135184 wait complete. 2026-02-25T15:19:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 10 monclient: monmap: 2026-02-25T15:19:34.659 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.659 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:34.659 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:34.659 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:34.659 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.659 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:34.659 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 1 librados: starting msgr at 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 1 librados: starting objecter 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 1 Processor -- start 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 1 -- start start 2026-02-25T15:19:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 1 librados: setting wanted keys 2026-02-25T15:19:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 1 librados: calling monclient init 2026-02-25T15:19:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.633+0000 7f9a5f783640 10 monclient: init 2026-02-25T15:19:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 10 monclient(hunting): picked mon.noname-a con 0x7f9a581566e0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 10 monclient(hunting): picked mon.noname-b con 0x7f9a58156ab0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 10 monclient(hunting): picked mon.noname-c con 0x7f9a58160c00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5812d470 con 0x7f9a581566e0 2026-02-25T15:19:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5805d400 con 0x7f9a58156ab0 2026-02-25T15:19:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a580ae7e0 con 0x7f9a58160c00 2026-02-25T15:19:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5f783640 10 monclient(hunting): authenticate will time out at 3744.223262s 2026-02-25T15:19:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5dcf9640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f9a58160c00 0x7f9a580af5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41728/0 (socket says 10.20.193.78:41728) 2026-02-25T15:19:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5dcf9640 1 -- 10.20.193.78:0/2926325974 learned_addr learned my addr 10.20.193.78:0/2926325974 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a5ccf7640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f9a58156ab0 0x7f9a5805c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:37164/0 (socket says 10.20.193.78:37164) 2026-02-25T15:19:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a45ffb640 10 client.?.objecter ms_handle_connect 0x7f9a58156ab0 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a45ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a45ffb640 10 client.?.objecter ms_handle_connect 0x7f9a58160c00 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.634+0000 7f9a45ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 client.?.objecter ms_handle_connect 0x7f9a581566e0 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658181341 0 0) 0x7f9a5805d400 con 0x7f9a58156ab0 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 monclient(hunting): my global_id is 30226 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a28003610 con 0x7f9a58156ab0 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248028493 0 0) 0x7f9a580ae7e0 con 0x7f9a58160c00 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 10 monclient(hunting): my global_id is 27767 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.635+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a5805d400 con 0x7f9a58160c00 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.636+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834690918 0 0) 0x7f9a5812d470 con 0x7f9a581566e0 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.636+0000 7f9a45ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.636+0000 7f9a45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.636+0000 7f9a45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.636+0000 7f9a45ffb640 10 monclient(hunting): my global_id is 30936 2026-02-25T15:19:34.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.636+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a580ae7e0 con 0x7f9a581566e0 2026-02-25T15:19:34.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.637+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2205351186 0 0) 0x7f9a28003610 con 0x7f9a58156ab0 2026-02-25T15:19:34.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a5812d470 con 0x7f9a58156ab0 2026-02-25T15:19:34.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9a4c002fe0 con 0x7f9a58156ab0 2026-02-25T15:19:34.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:34.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:34.665 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.666 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2415307161 0 0) 0x7f9a5805d400 con 0x7f9a58160c00 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a28003610 con 0x7f9a58160c00 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9a54003690 con 0x7f9a58160c00 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.638+0000 7f9a45ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.667 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 425716635 0 0) 0x7f9a580ae7e0 con 0x7f9a581566e0 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a5805d400 con 0x7f9a581566e0 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9a48003060 con 0x7f9a581566e0 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 10 monclient(hunting): dump: 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.668 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 130267098 0 0) 0x7f9a5812d470 con 0x7f9a58156ab0 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 >> v1:10.20.193.167:6789/0 conn(0x7f9a58160c00 legacy=0x7f9a580af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 >> v1:10.20.193.78:6789/0 conn(0x7f9a581566e0 legacy=0x7f9a5812cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 1 monclient: found mon.b 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a580aeac0 con 0x7f9a58156ab0 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a45ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 5 monclient: authenticate success, global_id 30226 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 10 monclient: _renew_subs 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a580aeda0 con 0x7f9a58156ab0 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 10 client.30226.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 10 monclient: _renew_subs 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a5805d170 con 0x7f9a58156ab0 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.639+0000 7f9a5f783640 1 librados: init done 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.640+0000 7f9a5f783640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.640+0000 7f9a5f783640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.640+0000 7f9a5f783640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:34.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.640+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5815d8f0 con 0x7f9a58156ab0 2026-02-25T15:19:34.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.730+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a4c003180 con 0x7f9a58156ab0 2026-02-25T15:19:34.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.730+0000 7f9a45ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.730+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f9a4c003860 con 0x7f9a58156ab0 2026-02-25T15:19:34.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.730+0000 7f9a45ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.730+0000 7f9a45ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:34.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.730+0000 7f9a45ffb640 10 monclient: dump: 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.730+0000 7f9a477fe640 4 set_mon_vals no callback set 2026-02-25T15:19:34.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.731+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f9a4c003a40 con 0x7f9a58156ab0 2026-02-25T15:19:34.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.732+0000 7f9a5d4f8640 10 monclient: get_auth_request con 0x7f9a28077e70 auth_method 0 2026-02-25T15:19:34.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.732+0000 7f9a45ffb640 10 client.30226.objecter ms_handle_connect 0x7f9a28077e70 2026-02-25T15:19:34.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.733+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f9a4c0930b0 con 0x7f9a58156ab0 2026-02-25T15:19:34.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.733+0000 7f9a45ffb640 10 client.30226.objecter ms_dispatch2 0x7f9a58000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:34.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.733+0000 7f9a45ffb640 3 client.30226.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:34.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.733+0000 7f9a45ffb640 3 client.30226.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:34.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.733+0000 7f9a45ffb640 20 client.30226.objecter dump_active .. 0 homeless 2026-02-25T15:19:34.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.735+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9a4c003860 con 0x7f9a58156ab0 2026-02-25T15:19:34.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.735+0000 7f9a45ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.735+0000 7f9a45ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:34.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.841+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f9a5805d6e0 con 0x7f9a28077e70 2026-02-25T15:19:34.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.841+0000 7f9a45ffb640 1 -- 10.20.193.78:0/2926325974 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7f9a5805d6e0 con 0x7f9a28077e70 2026-02-25T15:19:34.844 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 7 to deep-scrub 2026-02-25T15:19:34.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 10 librados: watch_flush enter 2026-02-25T15:19:34.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 10 librados: watch_flush exit 2026-02-25T15:19:34.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 20 client.30226.objecter shutdown clearing up homeless session... 2026-02-25T15:19:34.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 10 client.30226.objecter successfully canceled tick 2026-02-25T15:19:34.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 >> v1:10.20.193.78:6800/3497602169 conn(0x7f9a28077e70 legacy=0x7f9a28098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 10 monclient: shutdown 2026-02-25T15:19:34.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 >> v1:10.20.193.155:6789/0 conn(0x7f9a58156ab0 legacy=0x7f9a5805c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 shutdown_connections 2026-02-25T15:19:34.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 >> 10.20.193.78:0/2926325974 conn(0x7f9a580b2ef0 msgr2=0x7f9a58057850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 shutdown_connections 2026-02-25T15:19:34.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 1 -- 10.20.193.78:0/2926325974 wait complete. 2026-02-25T15:19:34.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.842+0000 7f9a5f783640 1 librados: shutdown 2026-02-25T15:19:34.854 INFO:tasks.ceph:Scrubbing osd.11 2026-02-25T15:19:34.854 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:34.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.920+0000 7f3b90e2b640 10 monclient: get_monmap_and_config 2026-02-25T15:19:34.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.920+0000 7f3b90e2b640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.920+0000 7f3b90e2b640 10 monclient: monmap: 2026-02-25T15:19:34.924 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.924 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.925 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:34.921828+0000 2026-02-25T15:19:34.925 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:34.921828+0000 2026-02-25T15:19:34.925 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.925 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.925 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.925 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.925 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.926 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.921+0000 7f3b90e2b640 1 Processor -- start 2026-02-25T15:19:34.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.921+0000 7f3b90e2b640 1 -- start start 2026-02-25T15:19:34.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.921+0000 7f3b90e2b640 10 monclient: init 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 10 monclient(hunting): picked mon.noname-a con 0x7f3b8c1667a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 10 monclient(hunting): picked mon.noname-b con 0x7f3b8c165cf0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 10 monclient(hunting): picked mon.noname-c con 0x7f3b8c159b10 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c05e260 con 0x7f3b8c1667a0 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c164540 con 0x7f3b8c165cf0 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c164820 con 0x7f3b8c159b10 2026-02-25T15:19:34.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b90e2b640 10 monclient(hunting): authenticate will time out at 3744.511438s 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b8a575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3b8c1667a0 0x7f3b8c1655e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40726/0 (socket says 10.20.193.78:40726) 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.922+0000 7f3b8a575640 1 -- 10.20.193.78:0/490149341 learned_addr learned my addr 10.20.193.78:0/490149341 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137221810 0 0) 0x7f3b8c05e260 con 0x7f3b8c1667a0 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 10 monclient(hunting): my global_id is 30939 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b78003610 con 0x7f3b8c1667a0 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1845367087 0 0) 0x7f3b8c164820 con 0x7f3b8c159b10 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.935 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 10 monclient(hunting): my global_id is 27770 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.924+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b8c05e260 con 0x7f3b8c159b10 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1949145158 0 0) 0x7f3b78003610 con 0x7f3b8c1667a0 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 >> v1:10.20.193.167:6789/0 conn(0x7f3b8c159b10 legacy=0x7f3b8c1c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 >> v1:10.20.193.155:6789/0 conn(0x7f3b8c165cf0 legacy=0x7f3b8c159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 1 monclient: found mon.noname-a 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c164b00 con 0x7f3b8c1667a0 2026-02-25T15:19:34.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3b80002df0 con 0x7f3b8c1667a0 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b89573640 10 monclient: dump: 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.937 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b90e2b640 5 monclient: authenticate success, global_id 30939 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.925+0000 7f3b90e2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.926+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b80003000 con 0x7f3b8c1667a0 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.926+0000 7f3b89573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.926+0000 7f3b89573640 1 -- 10.20.193.78:0/490149341 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3b80003440 con 0x7f3b8c1667a0 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.926+0000 7f3b89573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.926+0000 7f3b89573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.926+0000 7f3b89573640 10 monclient: dump: 2026-02-25T15:19:34.938 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.926+0000 7f3b90e2b640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.926+0000 7f3b90e2b640 4 set_mon_vals no callback set 2026-02-25T15:19:34.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 10 monclient: shutdown 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 -- 10.20.193.78:0/490149341 >> v1:10.20.193.78:6789/0 conn(0x7f3b8c1667a0 legacy=0x7f3b8c1655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 -- 10.20.193.78:0/490149341 shutdown_connections 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 -- 10.20.193.78:0/490149341 >> 10.20.193.78:0/490149341 conn(0x7f3b8c0b2f60 msgr2=0x7f3b8c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 -- 10.20.193.78:0/490149341 shutdown_connections 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 -- 10.20.193.78:0/490149341 wait complete. 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 10 monclient: build_initial_monmap 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 10 monclient: monmap: 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:34.940 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 librados: starting msgr at 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 librados: starting objecter 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 Processor -- start 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 -- start start 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 librados: setting wanted keys 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 1 librados: calling monclient init 2026-02-25T15:19:34.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.927+0000 7f3b90e2b640 10 monclient: init 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 10 monclient(hunting): picked mon.noname-c con 0x7f3b8c159b10 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 10 monclient(hunting): picked mon.noname-a con 0x7f3b8c165cf0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 10 monclient(hunting): picked mon.noname-b con 0x7f3b8c1667a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c1fb9b0 con 0x7f3b8c165cf0 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c1fbc90 con 0x7f3b8c1667a0 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c055ab0 con 0x7f3b8c159b10 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b90e2b640 10 monclient(hunting): authenticate will time out at 3744.517509s 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b89d74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3b8c165cf0 0x7f3b8c1fdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40728/0 (socket says 10.20.193.78:40728) 2026-02-25T15:19:34.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b89d74640 1 -- 10.20.193.78:0/2472856848 learned_addr learned my addr 10.20.193.78:0/2472856848 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b72ffd640 10 client.?.objecter ms_handle_connect 0x7f3b8c165cf0 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.928+0000 7f3b72ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 client.?.objecter ms_handle_connect 0x7f3b8c159b10 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 client.?.objecter ms_handle_connect 0x7f3b8c1667a0 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363392854 0 0) 0x7f3b8c1fb9b0 con 0x7f3b8c165cf0 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 monclient(hunting): my global_id is 30942 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b58003610 con 0x7f3b8c165cf0 2026-02-25T15:19:34.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569003583 0 0) 0x7f3b8c055ab0 con 0x7f3b8c159b10 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 10 monclient(hunting): my global_id is 27773 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.929+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b8c1fb9b0 con 0x7f3b8c159b10 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.930+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366674376 0 0) 0x7f3b8c1fbc90 con 0x7f3b8c1667a0 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.930+0000 7f3b72ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.930+0000 7f3b72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.930+0000 7f3b72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.930+0000 7f3b72ffd640 10 monclient(hunting): my global_id is 30232 2026-02-25T15:19:34.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.930+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b8c055ab0 con 0x7f3b8c1667a0 2026-02-25T15:19:34.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2859001023 0 0) 0x7f3b58003610 con 0x7f3b8c165cf0 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b8c1fbc90 con 0x7f3b8c165cf0 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3b74003160 con 0x7f3b8c165cf0 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.949 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3188755252 0 0) 0x7f3b8c1fb9b0 con 0x7f3b8c159b10 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b58003610 con 0x7f3b8c159b10 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3b80003350 con 0x7f3b8c159b10 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.932+0000 7f3b72ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:34.950 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3513848583 0 0) 0x7f3b8c055ab0 con 0x7f3b8c1667a0 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b8c1fb9b0 con 0x7f3b8c1667a0 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3b7c003430 con 0x7f3b8c1667a0 2026-02-25T15:19:34.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 10 monclient(hunting): dump: 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.952 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 469259947 0 0) 0x7f3b8c1fbc90 con 0x7f3b8c165cf0 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 >> v1:10.20.193.167:6789/0 conn(0x7f3b8c159b10 legacy=0x7f3b8c1fb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 >> v1:10.20.193.155:6789/0 conn(0x7f3b8c1667a0 legacy=0x7f3b8c058230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 1 monclient: found mon.a 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c055d90 con 0x7f3b8c165cf0 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:34.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 5 monclient: authenticate success, global_id 30942 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 10 monclient: _renew_subs 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c1fc530 con 0x7f3b8c165cf0 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 10 client.30942.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 10 monclient: _renew_subs 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b8c1ff4c0 con 0x7f3b8c165cf0 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.933+0000 7f3b90e2b640 1 librados: init done 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.934+0000 7f3b90e2b640 10 client.30942.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:34.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.934+0000 7f3b90e2b640 15 client.30942.objecter _session_command_op_assign -1 1 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.934+0000 7f3b90e2b640 20 client.30942.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.934+0000 7f3b90e2b640 10 client.30942.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.934+0000 7f3b90e2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.934+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3b8c1fbf70 con 0x7f3b8c165cf0 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.942+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b8c1fbf70 con 0x7f3b8c165cf0 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.942+0000 7f3b72ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.942+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f3b740039b0 con 0x7f3b8c165cf0 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.942+0000 7f3b72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.942+0000 7f3b88d72640 4 set_mon_vals no callback set 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.942+0000 7f3b72ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.942+0000 7f3b72ffd640 10 monclient: dump: 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:34.955 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.943+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f3b74003bc0 con 0x7f3b8c165cf0 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.943+0000 7f3b8a575640 10 monclient: get_auth_request con 0x7f3b58077ed0 auth_method 0 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.943+0000 7f3b72ffd640 10 client.30942.objecter ms_handle_connect 0x7f3b58077ed0 2026-02-25T15:19:34.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f3b740039b0 con 0x7f3b8c165cf0 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 10 client.30942.objecter ms_dispatch2 0x7f3b8c000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 3 client.30942.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 3 client.30942.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 10 client.30942.objecter checking command 1 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 20 client.30942.objecter _get_session s=0x7f3b580a21e0 osd=11 3 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 20 client.30942.objecter put_session s=0x7f3b580a21e0 osd=11 3 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 15 client.30942.objecter _session_command_op_remove -1 1 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 20 client.30942.objecter _get_session s=0x7f3b580a21e0 osd=11 3 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 20 client.30942.objecter get_session s=0x7f3b580a21e0 osd=11 3 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 15 client.30942.objecter _session_command_op_assign 11 1 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 20 client.30942.objecter put_session s=0x7f3b580a21e0 osd=11 4 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 10 client.30942.objecter _send_command 1 2026-02-25T15:19:34.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.944+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.174:6800/1887691036 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b580c44f0 con 0x7f3b580a2890 2026-02-25T15:19:34.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.945+0000 7f3b72ffd640 20 client.30942.objecter dump_active .. 0 homeless 2026-02-25T15:19:34.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.945+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f3b74059730 con 0x7f3b8c165cf0 2026-02-25T15:19:34.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.945+0000 7f3b72ffd640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:34.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.945+0000 7f3b8ad76640 10 monclient: get_auth_request con 0x7f3b580a2890 auth_method 0 2026-02-25T15:19:34.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.946+0000 7f3b72ffd640 10 client.30942.objecter ms_handle_connect 0x7f3b580a2890 2026-02-25T15:19:34.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.955+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== osd.11 v1:10.20.193.174:6800/1887691036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f3b580c44f0 con 0x7f3b580a2890 2026-02-25T15:19:34.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.955+0000 7f3b72ffd640 10 client.30942.objecter ms_dispatch2 0x7f3b8c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:34.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.955+0000 7f3b72ffd640 10 client.30942.objecter _finish_command 1 = system:0 2026-02-25T15:19:34.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.955+0000 7f3b72ffd640 20 client.30942.objecter put_session s=0x7f3b580a21e0 osd=11 4 2026-02-25T15:19:34.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.955+0000 7f3b72ffd640 15 client.30942.objecter _session_command_op_remove 11 1 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 10 client.30942.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 15 client.30942.objecter _session_command_op_assign -1 2 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 20 client.30942.objecter _get_session s=0x7f3b580a21e0 osd=11 3 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 20 client.30942.objecter put_session s=0x7f3b580a21e0 osd=11 3 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 20 client.30942.objecter _get_session s=0x7f3b580a21e0 osd=11 3 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 15 client.30942.objecter _session_command_op_remove -1 2 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 20 client.30942.objecter get_session s=0x7f3b580a21e0 osd=11 3 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 15 client.30942.objecter _session_command_op_assign 11 2 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 20 client.30942.objecter put_session s=0x7f3b580a21e0 osd=11 4 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 10 client.30942.objecter _send_command 2 2026-02-25T15:19:34.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.962+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 --> v1:10.20.193.174:6800/1887691036 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3b8c058940 con 0x7f3b580a2890 2026-02-25T15:19:34.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b72ffd640 1 -- 10.20.193.78:0/2472856848 <== osd.11 v1:10.20.193.174:6800/1887691036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f3b8c058940 con 0x7f3b580a2890 2026-02-25T15:19:34.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b72ffd640 10 client.30942.objecter ms_dispatch2 0x7f3b8c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:34.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b72ffd640 10 client.30942.objecter _finish_command 2 = system:0 2026-02-25T15:19:34.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b72ffd640 20 client.30942.objecter put_session s=0x7f3b580a21e0 osd=11 4 2026-02-25T15:19:34.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b72ffd640 15 client.30942.objecter _session_command_op_remove 11 2 2026-02-25T15:19:34.973 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:34.973 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:34.973 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:34.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 10 librados: watch_flush enter 2026-02-25T15:19:34.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 10 librados: watch_flush exit 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 10 client.30942.objecter close_session for osd.11 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 >> v1:10.20.193.174:6800/1887691036 conn(0x7f3b580a2890 legacy=0x7f3b580c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 20 client.30942.objecter put_session s=0x7f3b580a21e0 osd=11 1 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 20 client.30942.objecter shutdown clearing up homeless session... 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 10 client.30942.objecter successfully canceled tick 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 >> v1:10.20.193.78:6800/3497602169 conn(0x7f3b58077ed0 legacy=0x7f3b58098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 10 monclient: shutdown 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 >> v1:10.20.193.78:6789/0 conn(0x7f3b8c165cf0 legacy=0x7f3b8c1fdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:34.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b8ad76640 1 -- 10.20.193.78:0/2472856848 reap_dead start 2026-02-25T15:19:34.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 shutdown_connections 2026-02-25T15:19:34.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 >> 10.20.193.78:0/2472856848 conn(0x7f3b8c0b2f60 msgr2=0x7f3b8c153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:34.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 shutdown_connections 2026-02-25T15:19:34.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 1 -- 10.20.193.78:0/2472856848 wait complete. 2026-02-25T15:19:34.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:34.970+0000 7f3b90e2b640 1 librados: shutdown 2026-02-25T15:19:34.980 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-25T15:19:35.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.047+0000 7f6de63c3640 10 monclient: get_monmap_and_config 2026-02-25T15:19:35.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.047+0000 7f6de63c3640 10 monclient: build_initial_monmap 2026-02-25T15:19:35.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.047+0000 7f6de63c3640 10 monclient: monmap: 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:35.048006+0000 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:35.048006+0000 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:35.050 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.047+0000 7f6de63c3640 1 Processor -- start 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.047+0000 7f6de63c3640 1 -- start start 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.047+0000 7f6de63c3640 10 monclient: init 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 10 monclient(hunting): picked mon.noname-b con 0x7f6de01566e0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 10 monclient(hunting): picked mon.noname-a con 0x7f6de0160c00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 10 monclient(hunting): picked mon.noname-c con 0x7f6de0156ab0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de0058480 con 0x7f6de0160c00 2026-02-25T15:19:35.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de0058760 con 0x7f6de01566e0 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de00b0f90 con 0x7f6de0156ab0 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6de63c3640 10 monclient(hunting): authenticate will time out at 3744.637219s 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6ddffff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f6de01566e0 0x7f6de00b4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:37198/0 (socket says 10.20.193.78:37198) 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.048+0000 7f6ddffff640 1 -- 10.20.193.78:0/913561686 learned_addr learned my addr 10.20.193.78:0/913561686 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775716537 0 0) 0x7f6de0058760 con 0x7f6de01566e0 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 10 monclient(hunting): my global_id is 30235 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dc4003610 con 0x7f6de01566e0 2026-02-25T15:19:35.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644936057 0 0) 0x7f6de0058480 con 0x7f6de0160c00 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 10 monclient(hunting): my global_id is 30945 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.049+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de0058760 con 0x7f6de0160c00 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.050+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516730375 0 0) 0x7f6de00b0f90 con 0x7f6de0156ab0 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.050+0000 7f6ddeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.050+0000 7f6ddeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.050+0000 7f6ddeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.050+0000 7f6ddeffd640 10 monclient(hunting): my global_id is 27776 2026-02-25T15:19:35.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.050+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de0058480 con 0x7f6de0156ab0 2026-02-25T15:19:35.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1661958803 0 0) 0x7f6de0058480 con 0x7f6de0156ab0 2026-02-25T15:19:35.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 >> v1:10.20.193.155:6789/0 conn(0x7f6de01566e0 legacy=0x7f6de00b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 >> v1:10.20.193.78:6789/0 conn(0x7f6de0160c00 legacy=0x7f6de0057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 10 monclient: _finish_hunting 0 2026-02-25T15:19:35.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 1 monclient: found mon.noname-c 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de00b1270 con 0x7f6de0156ab0 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 10 monclient: _finish_auth 0 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 10 monclient: _check_auth_tickets 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6dd4003150 con 0x7f6de0156ab0 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6ddeffd640 10 monclient: dump: 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.063 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6de63c3640 5 monclient: authenticate success, global_id 27776 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.051+0000 7f6de63c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 <== mon.2 v1:10.20.193.167:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6dd4003320 con 0x7f6de0156ab0 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6ddeffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:35.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6ddeffd640 1 -- 10.20.193.78:0/913561686 <== mon.2 v1:10.20.193.167:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6dd4003760 con 0x7f6de0156ab0 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6ddeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6ddeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6ddeffd640 10 monclient: dump: 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.065 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 4 set_mon_vals no callback set 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 10 monclient: shutdown 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 1 -- 10.20.193.78:0/913561686 >> v1:10.20.193.167:6789/0 conn(0x7f6de0156ab0 legacy=0x7f6de0055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 1 -- 10.20.193.78:0/913561686 shutdown_connections 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 1 -- 10.20.193.78:0/913561686 >> 10.20.193.78:0/913561686 conn(0x7f6de00b2ef0 msgr2=0x7f6de00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 1 -- 10.20.193.78:0/913561686 shutdown_connections 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.052+0000 7f6de63c3640 1 -- 10.20.193.78:0/913561686 wait complete. 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient: build_initial_monmap 2026-02-25T15:19:35.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient: monmap: 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 librados: starting msgr at 2026-02-25T15:19:35.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 librados: starting objecter 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 Processor -- start 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 -- start start 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 librados: setting wanted keys 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 librados: calling monclient init 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient: init 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient(hunting): picked mon.noname-c con 0x7f6de01566e0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient(hunting): picked mon.noname-b con 0x7f6de0156ab0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient(hunting): picked mon.noname-a con 0x7f6de0160c00 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de00a71f0 con 0x7f6de0160c00 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de00a74d0 con 0x7f6de0156ab0 2026-02-25T15:19:35.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de00a77b0 con 0x7f6de01566e0 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.053+0000 7f6de63c3640 10 monclient(hunting): authenticate will time out at 3744.642997s 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.054+0000 7f6ddffff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f6de01566e0 0x7f6de00ac7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41766/0 (socket says 10.20.193.78:41766) 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.054+0000 7f6ddffff640 1 -- 10.20.193.78:0/1109375599 learned_addr learned my addr 10.20.193.78:0/1109375599 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.054+0000 7f6ddcff9640 10 client.?.objecter ms_handle_connect 0x7f6de0160c00 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.054+0000 7f6ddcff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.054+0000 7f6ddcff9640 10 client.?.objecter ms_handle_connect 0x7f6de01566e0 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.054+0000 7f6ddcff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.054+0000 7f6ddcff9640 10 client.?.objecter ms_handle_connect 0x7f6de0156ab0 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.054+0000 7f6ddcff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339622883 0 0) 0x7f6de00a71f0 con 0x7f6de0160c00 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): my global_id is 30948 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6db0003610 con 0x7f6de0160c00 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989456684 0 0) 0x7f6de00a77b0 con 0x7f6de01566e0 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): my global_id is 27779 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de00a71f0 con 0x7f6de01566e0 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119855322 0 0) 0x7f6de00a74d0 con 0x7f6de0156ab0 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 10 monclient(hunting): my global_id is 30238 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.055+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de00a77b0 con 0x7f6de0156ab0 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3861180283 0 0) 0x7f6de00a71f0 con 0x7f6de01566e0 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6de00a74d0 con 0x7f6de01566e0 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6dcc0030b0 con 0x7f6de01566e0 2026-02-25T15:19:35.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 10 monclient(hunting): dump: 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.072 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 901589101 0 0) 0x7f6db0003610 con 0x7f6de0160c00 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6de00a71f0 con 0x7f6de0160c00 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6dd4003670 con 0x7f6de0160c00 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.057+0000 7f6ddcff9640 10 monclient(hunting): dump: 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.073 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.058+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3678764583 0 0) 0x7f6de00a77b0 con 0x7f6de0156ab0 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.058+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6db0003610 con 0x7f6de0156ab0 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.058+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6dd0002fc0 con 0x7f6de0156ab0 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.058+0000 7f6ddcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.058+0000 7f6ddcff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.058+0000 7f6ddcff9640 10 monclient(hunting): dump: 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.074 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3664984214 0 0) 0x7f6de00a74d0 con 0x7f6de01566e0 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 >> v1:10.20.193.155:6789/0 conn(0x7f6de0156ab0 legacy=0x7f6de00a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 >> v1:10.20.193.78:6789/0 conn(0x7f6de0160c00 legacy=0x7f6de014a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 10 monclient: _finish_hunting 0 2026-02-25T15:19:35.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 1 monclient: found mon.c 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de00a7a90 con 0x7f6de01566e0 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 10 monclient: _finish_auth 0 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 10 monclient: _check_auth_tickets 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6ddcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 5 monclient: authenticate success, global_id 27779 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 10 monclient: _renew_subs 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6de00a7d70 con 0x7f6de01566e0 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 10 client.27779.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 10 monclient: _renew_subs 2026-02-25T15:19:35.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6de00ad180 con 0x7f6de01566e0 2026-02-25T15:19:35.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 1 librados: init done 2026-02-25T15:19:35.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.059+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de015a520 con 0x7f6de01566e0 2026-02-25T15:19:35.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.150+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6dcc003250 con 0x7f6de01566e0 2026-02-25T15:19:35.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.150+0000 7f6ddcff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:35.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.150+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f6dcc004af0 con 0x7f6de01566e0 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.150+0000 7f6ddcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.150+0000 7f6ddcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.150+0000 7f6ddcff9640 10 monclient: dump: 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.153 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.154 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.154 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.150+0000 7f6dde7fc640 4 set_mon_vals no callback set 2026-02-25T15:19:35.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.150+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f6dcc01d9a0 con 0x7f6de01566e0 2026-02-25T15:19:35.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.151+0000 7f6ddf7fe640 10 monclient: get_auth_request con 0x7f6db0077e70 auth_method 0 2026-02-25T15:19:35.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.151+0000 7f6ddcff9640 10 client.27779.objecter ms_handle_connect 0x7f6db0077e70 2026-02-25T15:19:35.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.152+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f6dcc0931d0 con 0x7f6de01566e0 2026-02-25T15:19:35.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.152+0000 7f6ddcff9640 10 client.27779.objecter ms_dispatch2 0x7f6de0000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:35.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.152+0000 7f6ddcff9640 3 client.27779.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:35.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.152+0000 7f6ddcff9640 3 client.27779.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:35.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.152+0000 7f6ddcff9640 20 client.27779.objecter dump_active .. 0 homeless 2026-02-25T15:19:35.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.153+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6dcc05dc00 con 0x7f6de01566e0 2026-02-25T15:19:35.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.153+0000 7f6ddcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.153+0000 7f6ddcff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:35.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.260+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f6de0056060 con 0x7f6db0077e70 2026-02-25T15:19:35.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.260+0000 7f6ddcff9640 1 -- 10.20.193.78:0/1109375599 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (unknown 2412662492 0 0) 0x7f6de0056060 con 0x7f6db0077e70 2026-02-25T15:19:35.263 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 11 to deep-scrub 2026-02-25T15:19:35.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 10 librados: watch_flush enter 2026-02-25T15:19:35.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 10 librados: watch_flush exit 2026-02-25T15:19:35.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 20 client.27779.objecter shutdown clearing up homeless session... 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 10 client.27779.objecter successfully canceled tick 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 >> v1:10.20.193.78:6800/3497602169 conn(0x7f6db0077e70 legacy=0x7f6db0098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 10 monclient: shutdown 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 >> v1:10.20.193.167:6789/0 conn(0x7f6de01566e0 legacy=0x7f6de00ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 shutdown_connections 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 >> 10.20.193.78:0/1109375599 conn(0x7f6de00b2ef0 msgr2=0x7f6de015da80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 shutdown_connections 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 1 -- 10.20.193.78:0/1109375599 wait complete. 2026-02-25T15:19:35.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.261+0000 7f6de63c3640 1 librados: shutdown 2026-02-25T15:19:35.272 INFO:tasks.ceph:Scrubbing osd.15 2026-02-25T15:19:35.272 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:19:35.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.339+0000 7f0a36b02640 10 monclient: get_monmap_and_config 2026-02-25T15:19:35.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.339+0000 7f0a36b02640 10 monclient: build_initial_monmap 2026-02-25T15:19:35.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.339+0000 7f0a36b02640 10 monclient: monmap: 2026-02-25T15:19:35.342 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:35.342 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.342 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:35.340207+0000 2026-02-25T15:19:35.342 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:35.340207+0000 2026-02-25T15:19:35.342 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:35.343 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.343 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:35.343 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:35.343 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:35.343 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.339+0000 7f0a36b02640 1 Processor -- start 2026-02-25T15:19:35.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.339+0000 7f0a36b02640 1 -- start start 2026-02-25T15:19:35.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.339+0000 7f0a36b02640 10 monclient: init 2026-02-25T15:19:35.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:35.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:35.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 10 monclient(hunting): picked mon.noname-b con 0x7f0a3015b1b0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 10 monclient(hunting): picked mon.noname-a con 0x7f0a300b16d0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 10 monclient(hunting): picked mon.noname-c con 0x7f0a300b0b10 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3005aa60 con 0x7f0a300b16d0 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a300b5090 con 0x7f0a3015b1b0 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a300b5370 con 0x7f0a300b0b10 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.340+0000 7f0a36b02640 10 monclient(hunting): authenticate will time out at 3744.929694s 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.341+0000 7f0a27fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f0a300b16d0 0x7f0a300b0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40754/0 (socket says 10.20.193.78:40754) 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.341+0000 7f0a27fff640 1 -- 10.20.193.78:0/3663774020 learned_addr learned my addr 10.20.193.78:0/3663774020 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:35.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 465675280 0 0) 0x7f0a18002910 con 0x7f0a300b16d0 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): my global_id is 30951 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a1c003610 con 0x7f0a300b16d0 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456329067 0 0) 0x7f0a300b5090 con 0x7f0a3015b1b0 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): my global_id is 30241 2026-02-25T15:19:35.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a18002910 con 0x7f0a3015b1b0 2026-02-25T15:19:35.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262841390 0 0) 0x7f0a300b5370 con 0x7f0a300b0b10 2026-02-25T15:19:35.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 10 monclient(hunting): my global_id is 27782 2026-02-25T15:19:35.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.342+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a300b5090 con 0x7f0a300b0b10 2026-02-25T15:19:35.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1419056957 0 0) 0x7f0a1c003610 con 0x7f0a300b16d0 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 >> v1:10.20.193.167:6789/0 conn(0x7f0a300b0b10 legacy=0x7f0a301c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 >> v1:10.20.193.155:6789/0 conn(0x7f0a3015b1b0 legacy=0x7f0a3005a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 1 monclient: found mon.noname-a 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a300b5650 con 0x7f0a300b16d0 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:35.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0a18002fc0 con 0x7f0a300b16d0 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a277fe640 10 monclient: dump: 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.359 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a36b02640 5 monclient: authenticate success, global_id 30951 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.344+0000 7f0a36b02640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a18003190 con 0x7f0a300b16d0 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a277fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:35.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a277fe640 1 -- 10.20.193.78:0/3663774020 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0a18004990 con 0x7f0a300b16d0 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 4 set_mon_vals no callback set 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a277fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a277fe640 10 monclient: dump: 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.361 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 10 monclient: shutdown 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 1 -- 10.20.193.78:0/3663774020 >> v1:10.20.193.78:6789/0 conn(0x7f0a300b16d0 legacy=0x7f0a300b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 1 -- 10.20.193.78:0/3663774020 shutdown_connections 2026-02-25T15:19:35.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 1 -- 10.20.193.78:0/3663774020 >> 10.20.193.78:0/3663774020 conn(0x7f0a300b37d0 msgr2=0x7f0a300b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 1 -- 10.20.193.78:0/3663774020 shutdown_connections 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.345+0000 7f0a36b02640 1 -- 10.20.193.78:0/3663774020 wait complete. 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 10 monclient: build_initial_monmap 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 10 monclient: monmap: 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:35.363 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 1 librados: starting msgr at 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 1 librados: starting objecter 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 1 Processor -- start 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 1 -- start start 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 1 librados: setting wanted keys 2026-02-25T15:19:35.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 1 librados: calling monclient init 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.346+0000 7f0a36b02640 10 monclient: init 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 10 monclient(hunting): picked mon.noname-b con 0x7f0a300b0b10 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 10 monclient(hunting): picked mon.noname-a con 0x7f0a300b16d0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 10 monclient(hunting): picked mon.noname-c con 0x7f0a3015b1b0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a30114cd0 con 0x7f0a300b16d0 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a300ae310 con 0x7f0a300b0b10 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a300ae5f0 con 0x7f0a3015b1b0 2026-02-25T15:19:35.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a36b02640 10 monclient(hunting): authenticate will time out at 3744.936110s 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a35078640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f0a3015b1b0 0x7f0a30120080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41786/0 (socket says 10.20.193.78:41786) 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a35078640 1 -- 10.20.193.78:0/3360975442 learned_addr learned my addr 10.20.193.78:0/3360975442 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a257fa640 10 client.?.objecter ms_handle_connect 0x7f0a3015b1b0 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.347+0000 7f0a257fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.348+0000 7f0a257fa640 10 client.?.objecter ms_handle_connect 0x7f0a300b0b10 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.348+0000 7f0a257fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 client.?.objecter ms_handle_connect 0x7f0a300b16d0 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920700943 0 0) 0x7f0a300ae5f0 con 0x7f0a3015b1b0 2026-02-25T15:19:35.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 monclient(hunting): my global_id is 27785 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a00003610 con 0x7f0a3015b1b0 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209741438 0 0) 0x7f0a300ae310 con 0x7f0a300b0b10 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 10 monclient(hunting): my global_id is 30244 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.349+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a300ae5f0 con 0x7f0a300b0b10 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.350+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861747897 0 0) 0x7f0a30114cd0 con 0x7f0a300b16d0 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.350+0000 7f0a257fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.350+0000 7f0a257fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.350+0000 7f0a257fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.350+0000 7f0a257fa640 10 monclient(hunting): my global_id is 30954 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.350+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a300ae310 con 0x7f0a300b16d0 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.351+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3336961604 0 0) 0x7f0a00003610 con 0x7f0a3015b1b0 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.351+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a30114cd0 con 0x7f0a3015b1b0 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.351+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0a2c003470 con 0x7f0a3015b1b0 2026-02-25T15:19:35.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.351+0000 7f0a257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.351+0000 7f0a257fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.351+0000 7f0a257fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.369 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.351+0000 7f0a257fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 718622039 0 0) 0x7f0a300ae5f0 con 0x7f0a300b0b10 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a00003610 con 0x7f0a300b0b10 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0a20002ff0 con 0x7f0a300b0b10 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.370 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3717111768 0 0) 0x7f0a300ae310 con 0x7f0a300b16d0 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a300ae5f0 con 0x7f0a300b16d0 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0a18002d30 con 0x7f0a300b16d0 2026-02-25T15:19:35.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.352+0000 7f0a257fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.372 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3869000371 0 0) 0x7f0a30114cd0 con 0x7f0a3015b1b0 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 >> v1:10.20.193.155:6789/0 conn(0x7f0a300b0b10 legacy=0x7f0a301145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 >> v1:10.20.193.78:6789/0 conn(0x7f0a300b16d0 legacy=0x7f0a3011f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 10 monclient: _finish_hunting 0 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 1 monclient: found mon.c 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a300ae8d0 con 0x7f0a3015b1b0 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 10 monclient: _finish_auth 0 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 10 monclient: _check_auth_tickets 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 5 monclient: authenticate success, global_id 27785 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 10 monclient: _renew_subs 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a300aebb0 con 0x7f0a3015b1b0 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 10 client.27785.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 10 monclient: _renew_subs 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a300af590 con 0x7f0a3015b1b0 2026-02-25T15:19:35.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 1 librados: init done 2026-02-25T15:19:35.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 10 client.27785.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 15 client.27785.objecter _session_command_op_assign -1 1 2026-02-25T15:19:35.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 20 client.27785.objecter _get_session osd=-1 returning homeless 2026-02-25T15:19:35.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 10 client.27785.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:35.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.353+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.167:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0a300b6310 con 0x7f0a3015b1b0 2026-02-25T15:19:35.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.361+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a300b6310 con 0x7f0a3015b1b0 2026-02-25T15:19:35.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.361+0000 7f0a257fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:35.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.361+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f0a2c003d30 con 0x7f0a3015b1b0 2026-02-25T15:19:35.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.361+0000 7f0a257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.361+0000 7f0a257fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:35.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.361+0000 7f0a257fa640 10 monclient: dump: 2026-02-25T15:19:35.378 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.378 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.361+0000 7f0a26ffd640 4 set_mon_vals no callback set 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.362+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f0a2c003f40 con 0x7f0a3015b1b0 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.362+0000 7f0a34877640 10 monclient: get_auth_request con 0x7f0a00077ed0 auth_method 0 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 10 client.27785.objecter ms_handle_connect 0x7f0a00077ed0 2026-02-25T15:19:35.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f0a2c003d30 con 0x7f0a3015b1b0 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 10 client.27785.objecter ms_dispatch2 0x7f0a30000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 3 client.27785.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 3 client.27785.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 10 client.27785.objecter checking command 1 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 20 client.27785.objecter _get_session s=0x7f0a000a2180 osd=15 3 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 20 client.27785.objecter put_session s=0x7f0a000a2180 osd=15 3 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 15 client.27785.objecter _session_command_op_remove -1 1 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 20 client.27785.objecter _get_session s=0x7f0a000a2180 osd=15 3 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 20 client.27785.objecter get_session s=0x7f0a000a2180 osd=15 3 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 15 client.27785.objecter _session_command_op_assign 15 1 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 20 client.27785.objecter put_session s=0x7f0a000a2180 osd=15 4 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 10 client.27785.objecter _send_command 1 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.174:6808/2760611848 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a000c4490 con 0x7f0a000a2830 2026-02-25T15:19:35.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a257fa640 20 client.27785.objecter dump_active .. 0 homeless 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.363+0000 7f0a27fff640 10 monclient: get_auth_request con 0x7f0a000a2830 auth_method 0 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.364+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_get_version_reply(handle=1 version=352) ==== 24+0+0 (unknown 3760828714 0 0) 0x7f0a2c059a90 con 0x7f0a3015b1b0 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.364+0000 7f0a257fa640 10 monclient: handle_get_version_reply finishing 1 version 352 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.365+0000 7f0a257fa640 10 client.27785.objecter ms_handle_connect 0x7f0a000a2830 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.374+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== osd.15 v1:10.20.193.174:6808/2760611848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f0a000c4490 con 0x7f0a000a2830 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.374+0000 7f0a257fa640 10 client.27785.objecter ms_dispatch2 0x7f0a30000b90 command_reply(tid 1: 0 ) 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.374+0000 7f0a257fa640 10 client.27785.objecter _finish_command 1 = system:0 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.374+0000 7f0a257fa640 20 client.27785.objecter put_session s=0x7f0a000a2180 osd=15 4 2026-02-25T15:19:35.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.374+0000 7f0a257fa640 15 client.27785.objecter _session_command_op_remove 15 1 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 10 client.27785.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 15 client.27785.objecter _session_command_op_assign -1 2 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 20 client.27785.objecter _get_session s=0x7f0a000a2180 osd=15 3 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 20 client.27785.objecter put_session s=0x7f0a000a2180 osd=15 3 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 20 client.27785.objecter _get_session s=0x7f0a000a2180 osd=15 3 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 15 client.27785.objecter _session_command_op_remove -1 2 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 20 client.27785.objecter get_session s=0x7f0a000a2180 osd=15 3 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 15 client.27785.objecter _session_command_op_assign 15 2 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 20 client.27785.objecter put_session s=0x7f0a000a2180 osd=15 4 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 10 client.27785.objecter _send_command 2 2026-02-25T15:19:35.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.381+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 --> v1:10.20.193.174:6808/2760611848 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0a3005a1a0 con 0x7f0a000a2830 2026-02-25T15:19:35.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a257fa640 1 -- 10.20.193.78:0/3360975442 <== osd.15 v1:10.20.193.174:6808/2760611848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f0a3005a1a0 con 0x7f0a000a2830 2026-02-25T15:19:35.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a257fa640 10 client.27785.objecter ms_dispatch2 0x7f0a30000b90 command_reply(tid 2: 0 ) 2026-02-25T15:19:35.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a257fa640 10 client.27785.objecter _finish_command 2 = system:0 2026-02-25T15:19:35.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a257fa640 20 client.27785.objecter put_session s=0x7f0a000a2180 osd=15 4 2026-02-25T15:19:35.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a257fa640 15 client.27785.objecter _session_command_op_remove 15 2 2026-02-25T15:19:35.392 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-25T15:19:35.392 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:19:35.392 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-25T15:19:35.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 10 librados: watch_flush enter 2026-02-25T15:19:35.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 10 librados: watch_flush exit 2026-02-25T15:19:35.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 10 client.27785.objecter close_session for osd.15 2026-02-25T15:19:35.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 >> v1:10.20.193.174:6808/2760611848 conn(0x7f0a000a2830 legacy=0x7f0a000c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 20 client.27785.objecter put_session s=0x7f0a000a2180 osd=15 1 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 20 client.27785.objecter shutdown clearing up homeless session... 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 10 client.27785.objecter successfully canceled tick 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 >> v1:10.20.193.78:6800/3497602169 conn(0x7f0a00077ed0 legacy=0x7f0a00098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 10 monclient: shutdown 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 >> v1:10.20.193.167:6789/0 conn(0x7f0a3015b1b0 legacy=0x7f0a30120080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a35078640 1 -- 10.20.193.78:0/3360975442 reap_dead start 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 shutdown_connections 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 >> 10.20.193.78:0/3360975442 conn(0x7f0a300b37d0 msgr2=0x7f0a3005f720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:35.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 shutdown_connections 2026-02-25T15:19:35.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 1 -- 10.20.193.78:0/3360975442 wait complete. 2026-02-25T15:19:35.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.389+0000 7f0a36b02640 1 librados: shutdown 2026-02-25T15:19:35.400 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-25T15:19:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.465+0000 7f1faee01640 10 monclient: get_monmap_and_config 2026-02-25T15:19:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.465+0000 7f1faee01640 10 monclient: build_initial_monmap 2026-02-25T15:19:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.465+0000 7f1faee01640 10 monclient: monmap: 2026-02-25T15:19:35.468 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:35.468 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.468 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:35.466403+0000 2026-02-25T15:19:35.468 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:35.466403+0000 2026-02-25T15:19:35.468 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:35.469 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.469 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:35.469 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:35.469 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:35.469 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 1 Processor -- start 2026-02-25T15:19:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 1 -- start start 2026-02-25T15:19:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 10 monclient: init 2026-02-25T15:19:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 10 monclient(hunting): picked mon.noname-b con 0x7f1fa8157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 10 monclient(hunting): picked mon.noname-a con 0x7f1fa8157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 10 monclient(hunting): picked mon.noname-c con 0x7f1fa8164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa805de70 con 0x7f1fa8157b50 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa8055b20 con 0x7f1fa8157780 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa8055e00 con 0x7f1fa8164d00 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.466+0000 7f1faee01640 10 monclient(hunting): authenticate will time out at 3745.055785s 2026-02-25T15:19:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.467+0000 7f1facb76640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f1fa8157780 0x7f1fa8056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:37250/0 (socket says 10.20.193.78:37250) 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.467+0000 7f1facb76640 1 -- 10.20.193.78:0/3726936506 learned_addr learned my addr 10.20.193.78:0/3726936506 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 894468138 0 0) 0x7f1fa8055b20 con 0x7f1fa8157780 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): my global_id is 30247 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f94003610 con 0x7f1fa8157780 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265139197 0 0) 0x7f1fa805de70 con 0x7f1fa8157b50 2026-02-25T15:19:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): my global_id is 30957 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa8055b20 con 0x7f1fa8157b50 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262788643 0 0) 0x7f1fa8055e00 con 0x7f1fa8164d00 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 10 monclient(hunting): my global_id is 27788 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.468+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa805de70 con 0x7f1fa8164d00 2026-02-25T15:19:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2325648491 0 0) 0x7f1f94003610 con 0x7f1fa8157780 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 >> v1:10.20.193.167:6789/0 conn(0x7f1fa8164d00 legacy=0x7f1fa81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 >> v1:10.20.193.78:6789/0 conn(0x7f1fa8157b50 legacy=0x7f1fa81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 1 monclient: found mon.noname-b 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa80560e0 con 0x7f1fa8157780 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1f98002df0 con 0x7f1fa8157780 2026-02-25T15:19:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1f9f7fe640 10 monclient: dump: 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1faee01640 5 monclient: authenticate success, global_id 30247 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.469+0000 7f1faee01640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f98002fc0 con 0x7f1fa8157780 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1f9f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1f9f7fe640 1 -- 10.20.193.78:0/3726936506 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1f98003400 con 0x7f1fa8157780 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1faee01640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1faee01640 4 set_mon_vals no callback set 2026-02-25T15:19:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1f9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1f9f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1f9f7fe640 10 monclient: dump: 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.484 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1faee01640 10 monclient: shutdown 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1faee01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.470+0000 7f1faee01640 1 -- 10.20.193.78:0/3726936506 >> v1:10.20.193.155:6789/0 conn(0x7f1fa8157780 legacy=0x7f1fa8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 -- 10.20.193.78:0/3726936506 shutdown_connections 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 -- 10.20.193.78:0/3726936506 >> 10.20.193.78:0/3726936506 conn(0x7f1fa80b2ef0 msgr2=0x7f1fa80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 -- 10.20.193.78:0/3726936506 shutdown_connections 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 -- 10.20.193.78:0/3726936506 wait complete. 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 10 monclient: build_initial_monmap 2026-02-25T15:19:35.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 10 monclient: monmap: 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:35.486 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 librados: starting msgr at 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 librados: starting objecter 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 Processor -- start 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 -- start start 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 librados: setting wanted keys 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 1 librados: calling monclient init 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.471+0000 7f1faee01640 10 monclient: init 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 10 monclient(hunting): picked mon.noname-b con 0x7f1fa8157780 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:35.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 10 monclient(hunting): picked mon.noname-a con 0x7f1fa8157b50 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 10 monclient(hunting): picked mon.noname-c con 0x7f1fa8164d00 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa80affd0 con 0x7f1fa8157b50 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa8136ac0 con 0x7f1fa8157780 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa8136da0 con 0x7f1fa8164d00 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1faee01640 10 monclient(hunting): authenticate will time out at 3745.061198s 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1facb76640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f1fa8157780 0x7f1fa80af8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:37254/0 (socket says 10.20.193.78:37254) 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1facb76640 1 -- 10.20.193.78:0/750110726 learned_addr learned my addr 10.20.193.78:0/750110726 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1f9d7fa640 10 client.?.objecter ms_handle_connect 0x7f1fa8157b50 2026-02-25T15:19:35.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1f9d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1f9d7fa640 10 client.?.objecter ms_handle_connect 0x7f1fa8157780 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1f9d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1f9d7fa640 10 client.?.objecter ms_handle_connect 0x7f1fa8164d00 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.472+0000 7f1f9d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723951945 0 0) 0x7f1fa8136ac0 con 0x7f1fa8157780 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): my global_id is 30250 2026-02-25T15:19:35.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f78003610 con 0x7f1fa8157780 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065072042 0 0) 0x7f1fa8136da0 con 0x7f1fa8164d00 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): my global_id is 27791 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa8136ac0 con 0x7f1fa8164d00 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047436501 0 0) 0x7f1fa80affd0 con 0x7f1fa8157b50 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 10 monclient(hunting): my global_id is 30960 2026-02-25T15:19:35.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.473+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa8136da0 con 0x7f1fa8157b50 2026-02-25T15:19:35.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2541413721 0 0) 0x7f1f78003610 con 0x7f1fa8157780 2026-02-25T15:19:35.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fa80affd0 con 0x7f1fa8157780 2026-02-25T15:19:35.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1f98003310 con 0x7f1fa8157780 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.496 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1777347986 0 0) 0x7f1fa8136ac0 con 0x7f1fa8164d00 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f78003610 con 0x7f1fa8164d00 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1fa4003330 con 0x7f1fa8164d00 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.475+0000 7f1f9d7fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.497 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.476+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1240782053 0 0) 0x7f1fa8136da0 con 0x7f1fa8157b50 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.476+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fa8136ac0 con 0x7f1fa8157b50 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.476+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1f90003070 con 0x7f1fa8157b50 2026-02-25T15:19:35.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.476+0000 7f1f9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.476+0000 7f1f9d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.476+0000 7f1f9d7fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.499 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3678210113 0 0) 0x7f1f78003610 con 0x7f1fa8164d00 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 >> v1:10.20.193.155:6789/0 conn(0x7f1fa8157780 legacy=0x7f1fa80af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 >> v1:10.20.193.78:6789/0 conn(0x7f1fa8157b50 legacy=0x7f1fa8137b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 1 monclient: found mon.c 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa8137080 con 0x7f1fa8164d00 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 10 monclient: _finish_auth 0 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1f9d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 5 monclient: authenticate success, global_id 27791 2026-02-25T15:19:35.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 10 monclient: _renew_subs 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa8137360 con 0x7f1fa8164d00 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 10 client.27791.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 10 monclient: _renew_subs 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1fa8139f00 con 0x7f1fa8164d00 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 1 librados: init done 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.477+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa80a3070 con 0x7f1fa8164d00 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.482+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1fa40038e0 con 0x7f1fa8164d00 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.482+0000 7f1f9d7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.482+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f1fa4003c30 con 0x7f1fa8164d00 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.482+0000 7f1f9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.482+0000 7f1f9d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.482+0000 7f1f9d7fa640 10 monclient: dump: 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.502 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.482+0000 7f1f9effd640 4 set_mon_vals no callback set 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.485+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f1fa401c900 con 0x7f1fa8164d00 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.486+0000 7f1facb76640 10 monclient: get_auth_request con 0x7f1f78077f60 auth_method 0 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.486+0000 7f1f9d7fa640 10 client.27791.objecter ms_handle_connect 0x7f1f78077f60 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.486+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f1fa40921d0 con 0x7f1fa8164d00 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.486+0000 7f1f9d7fa640 10 client.27791.objecter ms_dispatch2 0x7f1fa8000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.486+0000 7f1f9d7fa640 3 client.27791.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.486+0000 7f1f9d7fa640 3 client.27791.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.486+0000 7f1f9d7fa640 20 client.27791.objecter dump_active .. 0 homeless 2026-02-25T15:19:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.573+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f1fa405cc00 con 0x7f1fa8164d00 2026-02-25T15:19:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.573+0000 7f1f9d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.573+0000 7f1f9d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.682+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7f1fa80b4ff0 con 0x7f1f78077f60 2026-02-25T15:19:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.682+0000 7f1f9d7fa640 1 -- 10.20.193.78:0/750110726 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (unknown 337234985 0 0) 0x7f1fa80b4ff0 con 0x7f1f78077f60 2026-02-25T15:19:35.685 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 15 to deep-scrub 2026-02-25T15:19:35.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 10 librados: watch_flush enter 2026-02-25T15:19:35.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 10 librados: watch_flush exit 2026-02-25T15:19:35.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 20 client.27791.objecter shutdown clearing up homeless session... 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 10 client.27791.objecter successfully canceled tick 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 >> v1:10.20.193.78:6800/3497602169 conn(0x7f1f78077f60 legacy=0x7f1f78098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 10 monclient: shutdown 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 >> v1:10.20.193.167:6789/0 conn(0x7f1fa8164d00 legacy=0x7f1fa805c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 shutdown_connections 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 >> 10.20.193.78:0/750110726 conn(0x7f1fa80b2ef0 msgr2=0x7f1fa813bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 shutdown_connections 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 1 -- 10.20.193.78:0/750110726 wait complete. 2026-02-25T15:19:35.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.684+0000 7f1faee01640 1 librados: shutdown 2026-02-25T15:19:35.696 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:19:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.760+0000 7f511b22c640 10 monclient: get_monmap_and_config 2026-02-25T15:19:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.760+0000 7f511b22c640 10 monclient: build_initial_monmap 2026-02-25T15:19:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.760+0000 7f511b22c640 10 monclient: monmap: 2026-02-25T15:19:35.763 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:35.763 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:35.761273+0000 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:35.761273+0000 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.760+0000 7f511b22c640 1 Processor -- start 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.760+0000 7f511b22c640 1 -- start start 2026-02-25T15:19:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.760+0000 7f511b22c640 10 monclient: init 2026-02-25T15:19:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 10 monclient(hunting): picked mon.noname-c con 0x7f5114058da0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 10 monclient(hunting): picked mon.noname-b con 0x7f51140b0410 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 10 monclient(hunting): picked mon.noname-a con 0x7f51141626a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51141655c0 con 0x7f51141626a0 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51140b12b0 con 0x7f51140b0410 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51140b1590 con 0x7f5114058da0 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f511b22c640 10 monclient(hunting): authenticate will time out at 3745.350382s 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f510bfff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7f51140b0410 0x7f5114164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:37258/0 (socket says 10.20.193.78:37258) 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f510bfff640 1 -- 10.20.193.78:0/797755133 learned_addr learned my addr 10.20.193.78:0/797755133 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:35.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.761+0000 7f51197a2640 1 --1- 10.20.193.78:0/797755133 >> v1:10.20.193.78:6789/0 conn(0x7f51141626a0 0x7f51141c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40778/0 (socket says 10.20.193.78:40778) 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.762+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 508783228 0 0) 0x7f51140b12b0 con 0x7f51140b0410 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.762+0000 7f510b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.762+0000 7f510b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.762+0000 7f510b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.762+0000 7f510b7fe640 10 monclient(hunting): my global_id is 30253 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5100003610 con 0x7f51140b0410 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417525797 0 0) 0x7f51140b1590 con 0x7f5114058da0 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 10 monclient(hunting): my global_id is 27794 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51140b12b0 con 0x7f5114058da0 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3449031937 0 0) 0x7f51141655c0 con 0x7f51141626a0 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 10 monclient(hunting): my global_id is 30963 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.763+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51140b1590 con 0x7f51141626a0 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2940374936 0 0) 0x7f5100003610 con 0x7f51140b0410 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 >> v1:10.20.193.167:6789/0 conn(0x7f5114058da0 legacy=0x7f51141647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 >> v1:10.20.193.78:6789/0 conn(0x7f51141626a0 legacy=0x7f51141c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:19:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 1 monclient: found mon.noname-b 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.155:6789/0 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51140b1870 con 0x7f51140b0410 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f50fc002df0 con 0x7f51140b0410 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f510b7fe640 10 monclient: dump: 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.775 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f511b22c640 5 monclient: authenticate success, global_id 30253 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.764+0000 7f511b22c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:35.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 <== mon.1 v1:10.20.193.155:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50fc003040 con 0x7f51140b0410 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f510b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f510b7fe640 1 -- 10.20.193.78:0/797755133 <== mon.1 v1:10.20.193.155:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f50fc003480 con 0x7f51140b0410 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f510b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f510b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f510b7fe640 10 monclient: dump: 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.777 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 4 set_mon_vals no callback set 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 10 monclient: shutdown 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 1 -- 10.20.193.78:0/797755133 >> v1:10.20.193.155:6789/0 conn(0x7f51140b0410 legacy=0x7f5114164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 1 -- 10.20.193.78:0/797755133 shutdown_connections 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 1 -- 10.20.193.78:0/797755133 >> 10.20.193.78:0/797755133 conn(0x7f51140b65f0 msgr2=0x7f51140b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:35.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 1 -- 10.20.193.78:0/797755133 shutdown_connections 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.765+0000 7f511b22c640 1 -- 10.20.193.78:0/797755133 wait complete. 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 10 monclient: build_initial_monmap 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 10 monclient: monmap: 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:35.779 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 1 librados: starting msgr at 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 1 librados: starting objecter 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 1 Processor -- start 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 1 -- start start 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 1 librados: setting wanted keys 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 1 librados: calling monclient init 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.766+0000 7f511b22c640 10 monclient: init 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:35.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 10 monclient(hunting): picked mon.noname-a con 0x7f5114058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 10 monclient(hunting): picked mon.noname-c con 0x7f51140b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 10 monclient(hunting): picked mon.noname-b con 0x7f51141626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51141634a0 con 0x7f5114058da0 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511405c0a0 con 0x7f51141626a0 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511405c380 con 0x7f51140b0410 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f511b22c640 10 monclient(hunting): authenticate will time out at 3745.356226s 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f510bfff640 1 --1- >> v1:10.20.193.167:6789/0 conn(0x7f51140b0410 0x7f5114162d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.167:6789/0 says I am v1:10.20.193.78:41828/0 (socket says 10.20.193.78:41828) 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f510bfff640 1 -- 10.20.193.78:0/1700798344 learned_addr learned my addr 10.20.193.78:0/1700798344 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f51097fa640 10 client.?.objecter ms_handle_connect 0x7f51140b0410 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f51097fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f51097fa640 10 client.?.objecter ms_handle_connect 0x7f51141626a0 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.767+0000 7f51097fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 client.?.objecter ms_handle_connect 0x7f5114058da0 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973715164 0 0) 0x7f511405c380 con 0x7f51140b0410 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 monclient(hunting): my global_id is 27797 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e4003610 con 0x7f51140b0410 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033656558 0 0) 0x7f511405c0a0 con 0x7f51141626a0 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 10 monclient(hunting): my global_id is 30256 2026-02-25T15:19:35.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.768+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f511405c380 con 0x7f51141626a0 2026-02-25T15:19:35.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.769+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055728730 0 0) 0x7f51141634a0 con 0x7f5114058da0 2026-02-25T15:19:35.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.769+0000 7f51097fa640 10 monclient(hunting): _negotiate 2026-02-25T15:19:35.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.769+0000 7f51097fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:35.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.769+0000 7f51097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:35.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.769+0000 7f51097fa640 10 monclient(hunting): my global_id is 30966 2026-02-25T15:19:35.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.769+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f511405c0a0 con 0x7f5114058da0 2026-02-25T15:19:35.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 161058994 0 0) 0x7f511405c380 con 0x7f51141626a0 2026-02-25T15:19:35.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51141634a0 con 0x7f51141626a0 2026-02-25T15:19:35.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5110003330 con 0x7f51141626a0 2026-02-25T15:19:35.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:35.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1577435787 0 0) 0x7f50e4003610 con 0x7f51140b0410 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f511405c380 con 0x7f51140b0410 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f50fc003390 con 0x7f51140b0410 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.771+0000 7f51097fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.788 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 662806630 0 0) 0x7f511405c0a0 con 0x7f5114058da0 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50e4003610 con 0x7f5114058da0 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f51040030b0 con 0x7f5114058da0 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 10 monclient(hunting): dump: 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.789 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2685478000 0 0) 0x7f51141634a0 con 0x7f51141626a0 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 >> v1:10.20.193.167:6789/0 conn(0x7f51140b0410 legacy=0x7f5114162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 >> v1:10.20.193.78:6789/0 conn(0x7f5114058da0 legacy=0x7f51141fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 10 monclient: _finish_hunting 0 2026-02-25T15:19:35.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 1 monclient: found mon.b 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511405c660 con 0x7f51141626a0 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 10 monclient: _finish_auth 0 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 10 monclient: _check_auth_tickets 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f51097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 5 monclient: authenticate success, global_id 30256 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 10 monclient: _renew_subs 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f511405c940 con 0x7f51141626a0 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 10 client.30256.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 10 monclient: _renew_subs 2026-02-25T15:19:35.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:35.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f511405bc20 con 0x7f51141626a0 2026-02-25T15:19:35.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.772+0000 7f511b22c640 1 librados: init done 2026-02-25T15:19:35.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.773+0000 7f511b22c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.773+0000 7f511b22c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.773+0000 7f511b22c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:35.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.773+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51140b28b0 con 0x7f51141626a0 2026-02-25T15:19:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.865+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5110004c50 con 0x7f51141626a0 2026-02-25T15:19:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.865+0000 7f51097fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.865+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7f5110004fa0 con 0x7f51141626a0 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.865+0000 7f51097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.865+0000 7f51097fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.865+0000 7f51097fa640 10 monclient: dump: 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:35.869 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:35.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.865+0000 7f510affd640 4 set_mon_vals no callback set 2026-02-25T15:19:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.865+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7f511001de10 con 0x7f51141626a0 2026-02-25T15:19:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.866+0000 7f5118fa1640 10 monclient: get_auth_request con 0x7f50e4077ed0 auth_method 0 2026-02-25T15:19:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.866+0000 7f51097fa640 10 client.30256.objecter ms_handle_connect 0x7f50e4077ed0 2026-02-25T15:19:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.867+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7f51100933f0 con 0x7f51141626a0 2026-02-25T15:19:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.867+0000 7f51097fa640 10 client.30256.objecter ms_dispatch2 0x7f5114000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.867+0000 7f51097fa640 3 client.30256.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.867+0000 7f51097fa640 3 client.30256.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.867+0000 7f51097fa640 20 client.30256.objecter dump_active .. 0 homeless 2026-02-25T15:19:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.868+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f511005de20 con 0x7f51141626a0 2026-02-25T15:19:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.868+0000 7f51097fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:35.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.868+0000 7f51097fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.972+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51140b25d0 con 0x7f50e4077ed0 2026-02-25T15:19:35.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.973+0000 7f51097fa640 1 -- 10.20.193.78:0/1700798344 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125410 (unknown 2965378022 0 4113109361) 0x7f51140b25d0 con 0x7f50e4077ed0 2026-02-25T15:19:35.977 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:19:35.977 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-25T15:19:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 10 librados: watch_flush enter 2026-02-25T15:19:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 10 librados: watch_flush exit 2026-02-25T15:19:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 20 client.30256.objecter shutdown clearing up homeless session... 2026-02-25T15:19:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 10 client.30256.objecter successfully canceled tick 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 >> v1:10.20.193.78:6800/3497602169 conn(0x7f50e4077ed0 legacy=0x7f50e4098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 10 monclient: shutdown 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 >> v1:10.20.193.155:6789/0 conn(0x7f51141626a0 legacy=0x7f51141faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 shutdown_connections 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 >> 10.20.193.78:0/1700798344 conn(0x7f51140b65f0 msgr2=0x7f5114059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 shutdown_connections 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 1 -- 10.20.193.78:0/1700798344 wait complete. 2026-02-25T15:19:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:35.974+0000 7f511b22c640 1 librados: shutdown 2026-02-25T15:19:35.985 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2026-02-25T15:19:34.808162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":562072,"kb_used_data":112664,"kb_used_omap":24545,"kb_used_meta":424606,"kb_avail":1509387368,"statfs":{"total":1546188226560,"available":1545612664832,"internally_reserved":0,"allocated":115367936,"data_stored":73505504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134460,"internal_metadata":434797188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":103,"apply_latency_ms":103,"commit_latency_ns":103000000,"apply_latency_ns":103000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.532998"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.294519+0000","last_change":"2026-02-25T15:19:32.294519+0000","last_active":"2026-02-25T15:19:32.294519+0000","last_peered":"2026-02-25T15:19:32.294519+0000","last_clean":"2026-02-25T15:19:32.294519+0000","last_became_active":"2026-02-25T15:13:41.228177+0000","last_became_peered":"2026-02-25T15:13:41.228177+0000","last_unstale":"2026-02-25T15:19:32.294519+0000","last_undegraded":"2026-02-25T15:19:32.294519+0000","last_fullsized":"2026-02-25T15:19:32.294519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.292814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.292814+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.292814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:31:11.741837+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.382064+0000","last_change":"2026-02-25T15:19:32.382064+0000","last_active":"2026-02-25T15:19:32.382064+0000","last_peered":"2026-02-25T15:19:32.382064+0000","last_clean":"2026-02-25T15:19:32.382064+0000","last_became_active":"2026-02-25T15:13:41.568996+0000","last_became_peered":"2026-02-25T15:13:41.568996+0000","last_unstale":"2026-02-25T15:19:32.382064+0000","last_undegraded":"2026-02-25T15:19:32.382064+0000","last_fullsized":"2026-02-25T15:19:32.382064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.381095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.381095+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.381095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:49:58.654066+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.695504+0000","last_change":"2026-02-25T15:13:41.273148+0000","last_active":"2026-02-25T15:19:28.695504+0000","last_peered":"2026-02-25T15:19:28.695504+0000","last_clean":"2026-02-25T15:19:28.695504+0000","last_became_active":"2026-02-25T15:13:41.269950+0000","last_became_peered":"2026-02-25T15:13:41.269950+0000","last_unstale":"2026-02-25T15:19:28.695504+0000","last_undegraded":"2026-02-25T15:19:28.695504+0000","last_fullsized":"2026-02-25T15:19:28.695504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:33:46.151980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":649,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.467994+0000","last_change":"2026-02-25T15:13:40.992594+0000","last_active":"2026-02-25T15:19:28.467994+0000","last_peered":"2026-02-25T15:19:28.467994+0000","last_clean":"2026-02-25T15:19:28.467994+0000","last_became_active":"2026-02-25T15:13:40.989776+0000","last_became_peered":"2026-02-25T15:13:40.989776+0000","last_unstale":"2026-02-25T15:19:28.467994+0000","last_undegraded":"2026-02-25T15:19:28.467994+0000","last_fullsized":"2026-02-25T15:19:28.467994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:55:46.397970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":648,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.470997+0000","last_change":"2026-02-25T15:13:41.092568+0000","last_active":"2026-02-25T15:19:28.470997+0000","last_peered":"2026-02-25T15:19:28.470997+0000","last_clean":"2026-02-25T15:19:28.470997+0000","last_became_active":"2026-02-25T15:13:41.090430+0000","last_became_peered":"2026-02-25T15:13:41.090430+0000","last_unstale":"2026-02-25T15:19:28.470997+0000","last_undegraded":"2026-02-25T15:19:28.470997+0000","last_fullsized":"2026-02-25T15:19:28.470997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:14:22.171630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":648,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.469415+0000","last_change":"2026-02-25T15:13:41.057696+0000","last_active":"2026-02-25T15:19:28.469415+0000","last_peered":"2026-02-25T15:19:28.469415+0000","last_clean":"2026-02-25T15:19:28.469415+0000","last_became_active":"2026-02-25T15:13:41.036970+0000","last_became_peered":"2026-02-25T15:13:41.036970+0000","last_unstale":"2026-02-25T15:19:28.469415+0000","last_undegraded":"2026-02-25T15:19:28.469415+0000","last_fullsized":"2026-02-25T15:19:28.469415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:39:06.670127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.467115+0000","last_change":"2026-02-25T15:13:41.099282+0000","last_active":"2026-02-25T15:19:28.467115+0000","last_peered":"2026-02-25T15:19:28.467115+0000","last_clean":"2026-02-25T15:19:28.467115+0000","last_became_active":"2026-02-25T15:13:41.097058+0000","last_became_peered":"2026-02-25T15:13:41.097058+0000","last_unstale":"2026-02-25T15:19:28.467115+0000","last_undegraded":"2026-02-25T15:19:28.467115+0000","last_fullsized":"2026-02-25T15:19:28.467115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:45:41.954587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":651,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.467155+0000","last_change":"2026-02-25T15:13:40.983728+0000","last_active":"2026-02-25T15:19:28.467155+0000","last_peered":"2026-02-25T15:19:28.467155+0000","last_clean":"2026-02-25T15:19:28.467155+0000","last_became_active":"2026-02-25T15:13:40.967270+0000","last_became_peered":"2026-02-25T15:13:40.967270+0000","last_unstale":"2026-02-25T15:19:28.467155+0000","last_undegraded":"2026-02-25T15:19:28.467155+0000","last_fullsized":"2026-02-25T15:19:28.467155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:08:51.542526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.467354+0000","last_change":"2026-02-25T15:13:42.531762+0000","last_active":"2026-02-25T15:19:28.467354+0000","last_peered":"2026-02-25T15:19:28.467354+0000","last_clean":"2026-02-25T15:19:28.467354+0000","last_became_active":"2026-02-25T15:13:42.528480+0000","last_became_peered":"2026-02-25T15:13:42.528480+0000","last_unstale":"2026-02-25T15:19:28.467354+0000","last_undegraded":"2026-02-25T15:19:28.467354+0000","last_fullsized":"2026-02-25T15:19:28.467354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:29:51.951525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":650,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.697669+0000","last_change":"2026-02-25T15:13:40.710531+0000","last_active":"2026-02-25T15:19:28.697669+0000","last_peered":"2026-02-25T15:19:28.697669+0000","last_clean":"2026-02-25T15:19:28.697669+0000","last_became_active":"2026-02-25T15:13:40.708195+0000","last_became_peered":"2026-02-25T15:13:40.708195+0000","last_unstale":"2026-02-25T15:19:28.697669+0000","last_undegraded":"2026-02-25T15:19:28.697669+0000","last_fullsized":"2026-02-25T15:19:28.697669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:38:22.786132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.697328+0000","last_change":"2026-02-25T15:13:41.101698+0000","last_active":"2026-02-25T15:19:28.697328+0000","last_peered":"2026-02-25T15:19:28.697328+0000","last_clean":"2026-02-25T15:19:28.697328+0000","last_became_active":"2026-02-25T15:13:41.096638+0000","last_became_peered":"2026-02-25T15:13:41.096638+0000","last_unstale":"2026-02-25T15:19:28.697328+0000","last_undegraded":"2026-02-25T15:19:28.697328+0000","last_fullsized":"2026-02-25T15:19:28.697328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:46:32.563058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:31.416214+0000","last_change":"2026-02-25T15:19:31.416214+0000","last_active":"2026-02-25T15:19:31.416214+0000","last_peered":"2026-02-25T15:19:31.416214+0000","last_clean":"2026-02-25T15:19:31.416214+0000","last_became_active":"2026-02-25T15:13:40.929107+0000","last_became_peered":"2026-02-25T15:13:40.929107+0000","last_unstale":"2026-02-25T15:19:31.416214+0000","last_undegraded":"2026-02-25T15:19:31.416214+0000","last_fullsized":"2026-02-25T15:19:31.416214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:31.414445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:31.414445+0000","last_clean_scrub_stamp":"2026-02-25T15:19:31.414445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:04:15.554489+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.115952+0000","last_change":"2026-02-25T15:13:41.276463+0000","last_active":"2026-02-25T15:19:28.115952+0000","last_peered":"2026-02-25T15:19:28.115952+0000","last_clean":"2026-02-25T15:19:28.115952+0000","last_became_active":"2026-02-25T15:13:41.271609+0000","last_became_peered":"2026-02-25T15:13:41.271609+0000","last_unstale":"2026-02-25T15:19:28.115952+0000","last_undegraded":"2026-02-25T15:19:28.115952+0000","last_fullsized":"2026-02-25T15:19:28.115952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:52:28.798855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.463001+0000","last_change":"2026-02-25T15:13:40.970698+0000","last_active":"2026-02-25T15:19:28.463001+0000","last_peered":"2026-02-25T15:19:28.463001+0000","last_clean":"2026-02-25T15:19:28.463001+0000","last_became_active":"2026-02-25T15:13:40.968637+0000","last_became_peered":"2026-02-25T15:13:40.968637+0000","last_unstale":"2026-02-25T15:19:28.463001+0000","last_undegraded":"2026-02-25T15:19:28.463001+0000","last_fullsized":"2026-02-25T15:19:28.463001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:43:07.137572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.239117+0000","last_change":"2026-02-25T15:19:32.239117+0000","last_active":"2026-02-25T15:19:32.239117+0000","last_peered":"2026-02-25T15:19:32.239117+0000","last_clean":"2026-02-25T15:19:32.239117+0000","last_became_active":"2026-02-25T15:13:40.949974+0000","last_became_peered":"2026-02-25T15:13:40.949974+0000","last_unstale":"2026-02-25T15:19:32.239117+0000","last_undegraded":"2026-02-25T15:19:32.239117+0000","last_fullsized":"2026-02-25T15:19:32.239117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.237287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.237287+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.237287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:48:29.768575+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":651,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.466220+0000","last_change":"2026-02-25T15:13:41.003202+0000","last_active":"2026-02-25T15:19:28.466220+0000","last_peered":"2026-02-25T15:19:28.466220+0000","last_clean":"2026-02-25T15:19:28.466220+0000","last_became_active":"2026-02-25T15:13:40.988676+0000","last_became_peered":"2026-02-25T15:13:40.988676+0000","last_unstale":"2026-02-25T15:19:28.466220+0000","last_undegraded":"2026-02-25T15:19:28.466220+0000","last_fullsized":"2026-02-25T15:19:28.466220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:24:11.988588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.692822+0000","last_change":"2026-02-25T15:13:40.749992+0000","last_active":"2026-02-25T15:19:28.692822+0000","last_peered":"2026-02-25T15:19:28.692822+0000","last_clean":"2026-02-25T15:19:28.692822+0000","last_became_active":"2026-02-25T15:13:40.743919+0000","last_became_peered":"2026-02-25T15:13:40.743919+0000","last_unstale":"2026-02-25T15:19:28.692822+0000","last_undegraded":"2026-02-25T15:19:28.692822+0000","last_fullsized":"2026-02-25T15:19:28.692822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:26:24.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.465533+0000","last_change":"2026-02-25T15:13:41.344196+0000","last_active":"2026-02-25T15:19:28.465533+0000","last_peered":"2026-02-25T15:19:28.465533+0000","last_clean":"2026-02-25T15:19:28.465533+0000","last_became_active":"2026-02-25T15:13:41.340878+0000","last_became_peered":"2026-02-25T15:13:41.340878+0000","last_unstale":"2026-02-25T15:19:28.465533+0000","last_undegraded":"2026-02-25T15:19:28.465533+0000","last_fullsized":"2026-02-25T15:19:28.465533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:16:19.205261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":649,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.135243+0000","last_change":"2026-02-25T15:13:40.966222+0000","last_active":"2026-02-25T15:19:28.135243+0000","last_peered":"2026-02-25T15:19:28.135243+0000","last_clean":"2026-02-25T15:19:28.135243+0000","last_became_active":"2026-02-25T15:13:40.959639+0000","last_became_peered":"2026-02-25T15:13:40.959639+0000","last_unstale":"2026-02-25T15:19:28.135243+0000","last_undegraded":"2026-02-25T15:19:28.135243+0000","last_fullsized":"2026-02-25T15:19:28.135243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:00:51.139281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":655,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:31.221604+0000","last_change":"2026-02-25T15:19:31.221604+0000","last_active":"2026-02-25T15:19:31.221604+0000","last_peered":"2026-02-25T15:19:31.221604+0000","last_clean":"2026-02-25T15:19:31.221604+0000","last_became_active":"2026-02-25T15:13:41.104041+0000","last_became_peered":"2026-02-25T15:13:41.104041+0000","last_unstale":"2026-02-25T15:19:31.221604+0000","last_undegraded":"2026-02-25T15:19:31.221604+0000","last_fullsized":"2026-02-25T15:19:31.221604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:31.216890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:31.216890+0000","last_clean_scrub_stamp":"2026-02-25T15:19:31.216890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:02:52.717685+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.467621+0000","last_change":"2026-02-25T15:13:41.920429+0000","last_active":"2026-02-25T15:19:28.467621+0000","last_peered":"2026-02-25T15:19:28.467621+0000","last_clean":"2026-02-25T15:19:28.467621+0000","last_became_active":"2026-02-25T15:13:41.918321+0000","last_became_peered":"2026-02-25T15:13:41.918321+0000","last_unstale":"2026-02-25T15:19:28.467621+0000","last_undegraded":"2026-02-25T15:19:28.467621+0000","last_fullsized":"2026-02-25T15:19:28.467621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:57:47.179868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":650,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.693599+0000","last_change":"2026-02-25T15:13:41.080682+0000","last_active":"2026-02-25T15:19:28.693599+0000","last_peered":"2026-02-25T15:19:28.693599+0000","last_clean":"2026-02-25T15:19:28.693599+0000","last_became_active":"2026-02-25T15:13:41.078571+0000","last_became_peered":"2026-02-25T15:13:41.078571+0000","last_unstale":"2026-02-25T15:19:28.693599+0000","last_undegraded":"2026-02-25T15:19:28.693599+0000","last_fullsized":"2026-02-25T15:19:28.693599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:59:53.550632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":657,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:30.925632+0000","last_change":"2026-02-25T15:19:30.925632+0000","last_active":"2026-02-25T15:19:30.925632+0000","last_peered":"2026-02-25T15:19:30.925632+0000","last_clean":"2026-02-25T15:19:30.925632+0000","last_became_active":"2026-02-25T15:13:41.027073+0000","last_became_peered":"2026-02-25T15:13:41.027073+0000","last_unstale":"2026-02-25T15:19:30.925632+0000","last_undegraded":"2026-02-25T15:19:30.925632+0000","last_fullsized":"2026-02-25T15:19:30.925632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:30.920588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:30.920588+0000","last_clean_scrub_stamp":"2026-02-25T15:19:30.920588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:06.397972+0000","scrub_duration":120,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.464758+0000","last_change":"2026-02-25T15:13:40.948864+0000","last_active":"2026-02-25T15:19:28.464758+0000","last_peered":"2026-02-25T15:19:28.464758+0000","last_clean":"2026-02-25T15:19:28.464758+0000","last_became_active":"2026-02-25T15:13:40.944589+0000","last_became_peered":"2026-02-25T15:13:40.944589+0000","last_unstale":"2026-02-25T15:19:28.464758+0000","last_undegraded":"2026-02-25T15:19:28.464758+0000","last_fullsized":"2026-02-25T15:19:28.464758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:57:01.500928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.468104+0000","last_change":"2026-02-25T15:13:42.005732+0000","last_active":"2026-02-25T15:19:28.468104+0000","last_peered":"2026-02-25T15:19:28.468104+0000","last_clean":"2026-02-25T15:19:28.468104+0000","last_became_active":"2026-02-25T15:13:42.003162+0000","last_became_peered":"2026-02-25T15:13:42.003162+0000","last_unstale":"2026-02-25T15:19:28.468104+0000","last_undegraded":"2026-02-25T15:19:28.468104+0000","last_fullsized":"2026-02-25T15:19:28.468104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:38:43.188701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":648,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.472924+0000","last_change":"2026-02-25T15:13:41.042732+0000","last_active":"2026-02-25T15:19:28.472924+0000","last_peered":"2026-02-25T15:19:28.472924+0000","last_clean":"2026-02-25T15:19:28.472924+0000","last_became_active":"2026-02-25T15:13:41.040468+0000","last_became_peered":"2026-02-25T15:13:41.040468+0000","last_unstale":"2026-02-25T15:19:28.472924+0000","last_undegraded":"2026-02-25T15:19:28.472924+0000","last_fullsized":"2026-02-25T15:19:28.472924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:14:52.942685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.470677+0000","last_change":"2026-02-25T15:13:40.464514+0000","last_active":"2026-02-25T15:19:28.470677+0000","last_peered":"2026-02-25T15:19:28.470677+0000","last_clean":"2026-02-25T15:19:28.470677+0000","last_became_active":"2026-02-25T15:13:40.462421+0000","last_became_peered":"2026-02-25T15:13:40.462421+0000","last_unstale":"2026-02-25T15:19:28.470677+0000","last_undegraded":"2026-02-25T15:19:28.470677+0000","last_fullsized":"2026-02-25T15:19:28.470677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:13:19.955826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":652,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.469381+0000","last_change":"2026-02-25T15:13:40.746985+0000","last_active":"2026-02-25T15:19:28.469381+0000","last_peered":"2026-02-25T15:19:28.469381+0000","last_clean":"2026-02-25T15:19:28.469381+0000","last_became_active":"2026-02-25T15:13:40.744228+0000","last_became_peered":"2026-02-25T15:13:40.744228+0000","last_unstale":"2026-02-25T15:19:28.469381+0000","last_undegraded":"2026-02-25T15:19:28.469381+0000","last_fullsized":"2026-02-25T15:19:28.469381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:17:18.195998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.1","version":"33'11","reported_seq":678,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.461460+0000","last_change":"2026-02-25T15:13:40.735103+0000","last_active":"2026-02-25T15:19:28.461460+0000","last_peered":"2026-02-25T15:19:28.461460+0000","last_clean":"2026-02-25T15:19:28.461460+0000","last_became_active":"2026-02-25T15:13:40.703448+0000","last_became_peered":"2026-02-25T15:13:40.703448+0000","last_unstale":"2026-02-25T15:19:28.461460+0000","last_undegraded":"2026-02-25T15:19:28.461460+0000","last_fullsized":"2026-02-25T15:19:28.461460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:12:02.614079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:30.438504+0000","last_change":"2026-02-25T15:19:30.438504+0000","last_active":"2026-02-25T15:19:30.438504+0000","last_peered":"2026-02-25T15:19:30.438504+0000","last_clean":"2026-02-25T15:19:30.438504+0000","last_became_active":"2026-02-25T15:13:41.233579+0000","last_became_peered":"2026-02-25T15:13:41.233579+0000","last_unstale":"2026-02-25T15:19:30.438504+0000","last_undegraded":"2026-02-25T15:19:30.438504+0000","last_fullsized":"2026-02-25T15:19:30.438504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:30.433126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:30.433126+0000","last_clean_scrub_stamp":"2026-02-25T15:19:30.433126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:52:47.968903+0000","scrub_duration":125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":650,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.114227+0000","last_change":"2026-02-25T15:13:41.023468+0000","last_active":"2026-02-25T15:19:28.114227+0000","last_peered":"2026-02-25T15:19:28.114227+0000","last_clean":"2026-02-25T15:19:28.114227+0000","last_became_active":"2026-02-25T15:13:41.021310+0000","last_became_peered":"2026-02-25T15:13:41.021310+0000","last_unstale":"2026-02-25T15:19:28.114227+0000","last_undegraded":"2026-02-25T15:19:28.114227+0000","last_fullsized":"2026-02-25T15:19:28.114227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:59:17.205188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":650,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.696258+0000","last_change":"2026-02-25T15:13:40.703490+0000","last_active":"2026-02-25T15:19:28.696258+0000","last_peered":"2026-02-25T15:19:28.696258+0000","last_clean":"2026-02-25T15:19:28.696258+0000","last_became_active":"2026-02-25T15:13:40.701282+0000","last_became_peered":"2026-02-25T15:13:40.701282+0000","last_unstale":"2026-02-25T15:19:28.696258+0000","last_undegraded":"2026-02-25T15:19:28.696258+0000","last_fullsized":"2026-02-25T15:19:28.696258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:13:38.304328+0000","last_clean_scrub_stamp":"2026-02-25T15:13:38.304328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:33:36.654692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,12],"acting":[5,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":666,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.471708+0000","last_change":"2026-02-25T15:13:02.846272+0000","last_active":"2026-02-25T15:19:28.471708+0000","last_peered":"2026-02-25T15:19:28.471708+0000","last_clean":"2026-02-25T15:19:28.471708+0000","last_became_active":"2026-02-25T15:13:01.240693+0000","last_became_peered":"2026-02-25T15:13:01.240693+0000","last_unstale":"2026-02-25T15:19:28.471708+0000","last_undegraded":"2026-02-25T15:19:28.471708+0000","last_fullsized":"2026-02-25T15:19:28.471708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068336521999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,15],"acting":[12,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":668,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.469051+0000","last_change":"2026-02-25T15:13:03.354671+0000","last_active":"2026-02-25T15:19:28.469051+0000","last_peered":"2026-02-25T15:19:28.469051+0000","last_clean":"2026-02-25T15:19:28.469051+0000","last_became_active":"2026-02-25T15:13:01.107596+0000","last_became_peered":"2026-02-25T15:13:01.107596+0000","last_unstale":"2026-02-25T15:19:28.469051+0000","last_undegraded":"2026-02-25T15:19:28.469051+0000","last_fullsized":"2026-02-25T15:19:28.469051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:21.484744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043275358999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":666,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.116497+0000","last_change":"2026-02-25T15:13:04.197397+0000","last_active":"2026-02-25T15:19:28.116497+0000","last_peered":"2026-02-25T15:19:28.116497+0000","last_clean":"2026-02-25T15:19:28.116497+0000","last_became_active":"2026-02-25T15:13:00.886357+0000","last_became_peered":"2026-02-25T15:13:00.886357+0000","last_unstale":"2026-02-25T15:19:28.116497+0000","last_undegraded":"2026-02-25T15:19:28.116497+0000","last_fullsized":"2026-02-25T15:19:28.116497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:21:14.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047817094999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":666,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.115585+0000","last_change":"2026-02-25T15:13:04.192793+0000","last_active":"2026-02-25T15:19:28.115585+0000","last_peered":"2026-02-25T15:19:28.115585+0000","last_clean":"2026-02-25T15:19:28.115585+0000","last_became_active":"2026-02-25T15:13:01.030043+0000","last_became_peered":"2026-02-25T15:13:01.030043+0000","last_unstale":"2026-02-25T15:19:28.115585+0000","last_undegraded":"2026-02-25T15:19:28.115585+0000","last_fullsized":"2026-02-25T15:19:28.115585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:56:20.078816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047341022000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14],"acting":[11,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"352'3","reported_seq":677,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:30.933553+0000","last_change":"2026-02-25T15:19:30.933553+0000","last_active":"2026-02-25T15:19:30.933553+0000","last_peered":"2026-02-25T15:19:30.933553+0000","last_clean":"2026-02-25T15:19:30.933553+0000","last_became_active":"2026-02-25T15:13:01.242716+0000","last_became_peered":"2026-02-25T15:13:01.242716+0000","last_unstale":"2026-02-25T15:19:30.933553+0000","last_undegraded":"2026-02-25T15:19:30.933553+0000","last_fullsized":"2026-02-25T15:19:30.933553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"352'3","last_scrub_stamp":"2026-02-25T15:19:30.931562+0000","last_deep_scrub":"352'3","last_deep_scrub_stamp":"2026-02-25T15:19:30.931562+0000","last_clean_scrub_stamp":"2026-02-25T15:19:30.931562+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:29:08.844598+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0.073362477999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,8],"acting":[12,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":667,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.131849+0000","last_change":"2026-02-25T15:13:03.340291+0000","last_active":"2026-02-25T15:19:28.131849+0000","last_peered":"2026-02-25T15:19:28.131849+0000","last_clean":"2026-02-25T15:19:28.131849+0000","last_became_active":"2026-02-25T15:13:01.167595+0000","last_became_peered":"2026-02-25T15:13:01.167595+0000","last_unstale":"2026-02-25T15:19:28.131849+0000","last_undegraded":"2026-02-25T15:19:28.131849+0000","last_fullsized":"2026-02-25T15:19:28.131849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:48:42.136927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030257392000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":670,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.464499+0000","last_change":"2026-02-25T15:13:03.344370+0000","last_active":"2026-02-25T15:19:28.464499+0000","last_peered":"2026-02-25T15:19:28.464499+0000","last_clean":"2026-02-25T15:19:28.464499+0000","last_became_active":"2026-02-25T15:13:01.165967+0000","last_became_peered":"2026-02-25T15:13:01.165967+0000","last_unstale":"2026-02-25T15:19:28.464499+0000","last_undegraded":"2026-02-25T15:19:28.464499+0000","last_fullsized":"2026-02-25T15:19:28.464499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:41:44.607565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030945777000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"26'1","reported_seq":667,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:28.472615+0000","last_change":"2026-02-25T15:13:02.837950+0000","last_active":"2026-02-25T15:19:28.472615+0000","last_peered":"2026-02-25T15:19:28.472615+0000","last_clean":"2026-02-25T15:19:28.472615+0000","last_became_active":"2026-02-25T15:13:01.049643+0000","last_became_peered":"2026-02-25T15:13:01.049643+0000","last_unstale":"2026-02-25T15:19:28.472615+0000","last_undegraded":"2026-02-25T15:19:28.472615+0000","last_fullsized":"2026-02-25T15:19:28.472615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:12:59.498201+0000","last_clean_scrub_stamp":"2026-02-25T15:12:59.498201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:51:09.091771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059457101999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"1.0","version":"352'34","reported_seq":723,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:31.329298+0000","last_change":"2026-02-25T15:19:31.329298+0000","last_active":"2026-02-25T15:19:31.329298+0000","last_peered":"2026-02-25T15:19:31.329298+0000","last_clean":"2026-02-25T15:19:31.329298+0000","last_became_active":"2026-02-25T15:12:53.235995+0000","last_became_peered":"2026-02-25T15:12:53.235995+0000","last_unstale":"2026-02-25T15:19:31.329298+0000","last_undegraded":"2026-02-25T15:19:31.329298+0000","last_fullsized":"2026-02-25T15:19:31.329298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"352'34","last_scrub_stamp":"2026-02-25T15:19:31.328290+0000","last_deep_scrub":"352'34","last_deep_scrub_stamp":"2026-02-25T15:19:31.328290+0000","last_clean_scrub_stamp":"2026-02-25T15:19:31.328290+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:38:58.609040+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280594,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51992,"kb_used_data":6984,"kb_used_omap":4679,"kb_used_meta":40312,"kb_avail":94319848,"statfs":{"total":96636764160,"available":96583524352,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4792230,"internal_metadata":41279578},"hb_peers":[0,1,4,5,6,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280594,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222244,"internal_metadata":27368412},"hb_peers":[1,2,3,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280595,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4536700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220070,"internal_metadata":27370586},"hb_peers":[1,4,5,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313298,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":3025,"kb_used_meta":23918,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3097754,"internal_metadata":24492902},"hb_peers":[0,1,2,3,4,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":8641,"kb_used_meta":18302,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8848431,"internal_metadata":18742225},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218584,"internal_metadata":27372072},"hb_peers":[1,3,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280595,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34396,"kb_used_data":7436,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337444,"statfs":{"total":96636764160,"available":96601542656,"internally_reserved":0,"allocated":7614464,"data_stored":4995961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220345,"internal_metadata":27370311},"hb_peers":[0,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280594,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217327,"internal_metadata":27373329},"hb_peers":[1,3,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280595,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219675,"internal_metadata":27370981},"hb_peers":[0,1,2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280594,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34400,"kb_used_data":7440,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337440,"statfs":{"total":96636764160,"available":96601538560,"internally_reserved":0,"allocated":7618560,"data_stored":4995966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220215,"internal_metadata":27370441},"hb_peers":[0,1,2,3,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280594,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":2927,"kb_used_meta":24016,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4536686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2997987,"internal_metadata":24592669},"hb_peers":[0,1,2,4,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280594,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218716,"internal_metadata":27371940},"hb_peers":[0,1,2,3,4,5,6,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280594,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4536700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220200,"internal_metadata":27370456},"hb_peers":[1,2,3,4,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280596,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":182,"kb_used_meta":26761,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187370,"internal_metadata":27403286},"hb_peers":[0,2,3,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280595,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":3022,"kb_used_meta":23921,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3094892,"internal_metadata":24495764},"hb_peers":[1,2,3,5,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280594,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138420,"internal_metadata":27452236},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:19:35.993 INFO:tasks.ceph:pgid 34.1f last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.993 INFO:tasks.ceph:pgid 34.1e last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.993 INFO:tasks.ceph:pgid 34.19 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.993 INFO:tasks.ceph:pgid 34.18 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.993 INFO:tasks.ceph:pgid 34.1b last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.994 INFO:tasks.ceph:pgid 34.1a last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.994 INFO:tasks.ceph:pgid 34.15 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.994 INFO:tasks.ceph:pgid 34.14 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.994 INFO:tasks.ceph:pgid 34.17 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.994 INFO:tasks.ceph:pgid 34.11 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.994 INFO:tasks.ceph:pgid 34.10 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.995 INFO:tasks.ceph:pgid 34.12 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.995 INFO:tasks.ceph:pgid 34.d last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.995 INFO:tasks.ceph:pgid 34.c last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.995 INFO:tasks.ceph:pgid 34.f last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.995 INFO:tasks.ceph:pgid 34.9 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.995 INFO:tasks.ceph:pgid 34.8 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.996 INFO:tasks.ceph:pgid 34.a last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.996 INFO:tasks.ceph:pgid 34.5 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.996 INFO:tasks.ceph:pgid 34.4 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.996 INFO:tasks.ceph:pgid 34.7 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.996 INFO:tasks.ceph:pgid 34.6 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.996 INFO:tasks.ceph:pgid 34.1 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.996 INFO:tasks.ceph:pgid 34.3 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.997 INFO:tasks.ceph:pgid 34.2 last_scrub_stamp 2026-02-25T15:13:38.304328+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=13, tm_sec=38, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.997 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-25T15:12:59.498201+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=12, tm_sec=59, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.997 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-25T15:12:59.498201+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=12, tm_sec=59, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.997 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-25T15:12:59.498201+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=12, tm_sec=59, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.997 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-25T15:12:59.498201+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=12, tm_sec=59, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.997 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-25T15:12:59.498201+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=12, tm_sec=59, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.998 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-25T15:12:59.498201+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=12, tm_sec=59, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.998 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-25T15:12:59.498201+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=12, tm_sec=59, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:19:35.998 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-25T15:19:43.138 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:44.916 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:43.140 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:44.919 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:43.151 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:07:44.930 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:43.163 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:44.902 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:43.164 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:44.941 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:43.164 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:44.904 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:43.165 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:44.942 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:43.176 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:07:44.916 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:43.178 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:07:44.956 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:19:55.999 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:19:56.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.064+0000 7fb58754c640 10 monclient: get_monmap_and_config 2026-02-25T15:19:56.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.064+0000 7fb58754c640 10 monclient: build_initial_monmap 2026-02-25T15:19:56.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.064+0000 7fb58754c640 10 monclient: monmap: 2026-02-25T15:19:56.066 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:56.066 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.066 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:56.065390+0000 2026-02-25T15:19:56.066 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:56.065390+0000 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.064+0000 7fb58754c640 1 Processor -- start 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.064+0000 7fb58754c640 1 -- start start 2026-02-25T15:19:56.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.064+0000 7fb58754c640 10 monclient: init 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 10 monclient(hunting): picked mon.noname-a con 0x7fb580058da0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 10 monclient(hunting): picked mon.noname-c con 0x7fb5800b0410 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 10 monclient(hunting): picked mon.noname-b con 0x7fb5801626a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5801655c0 con 0x7fb580058da0 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5800b12b0 con 0x7fb5801626a0 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5800b1590 con 0x7fb5800b0410 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:56.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.065+0000 7fb58754c640 10 monclient(hunting): authenticate will time out at 3765.654856s 2026-02-25T15:19:56.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.066+0000 7fb5852c1640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb580058da0 0x7fb5801647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:54416/0 (socket says 10.20.193.78:54416) 2026-02-25T15:19:56.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.066+0000 7fb5852c1640 1 -- 10.20.193.78:0/2602542439 learned_addr learned my addr 10.20.193.78:0/2602542439 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:56.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737603100 0 0) 0x7fb5801655c0 con 0x7fb580058da0 2026-02-25T15:19:56.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): my global_id is 30969 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb568003610 con 0x7fb580058da0 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767075039 0 0) 0x7fb5800b1590 con 0x7fb5800b0410 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): my global_id is 27800 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5801655c0 con 0x7fb5800b0410 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862650278 0 0) 0x7fb5800b12b0 con 0x7fb5801626a0 2026-02-25T15:19:56.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 10 monclient(hunting): my global_id is 30259 2026-02-25T15:19:56.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.067+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5800b1590 con 0x7fb5801626a0 2026-02-25T15:19:56.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3236377512 0 0) 0x7fb568003610 con 0x7fb580058da0 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 >> v1:10.20.193.167:6789/0 conn(0x7fb5800b0410 legacy=0x7fb580164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 >> v1:10.20.193.155:6789/0 conn(0x7fb5801626a0 legacy=0x7fb5801c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 1 monclient: found mon.noname-a 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5800b1870 con 0x7fb580058da0 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 10 monclient: _finish_auth 0 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb570002df0 con 0x7fb580058da0 2026-02-25T15:19:56.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb56ffff640 10 monclient: dump: 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb58754c640 5 monclient: authenticate success, global_id 30969 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.069+0000 7fb58754c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb570002fc0 con 0x7fb580058da0 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb56ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb56ffff640 1 -- 10.20.193.78:0/2602542439 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb570003400 con 0x7fb580058da0 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb56ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb56ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb56ffff640 10 monclient: dump: 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.079 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb58754c640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb58754c640 4 set_mon_vals no callback set 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb58754c640 10 monclient: shutdown 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb58754c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb58754c640 1 -- 10.20.193.78:0/2602542439 >> v1:10.20.193.78:6789/0 conn(0x7fb580058da0 legacy=0x7fb5801647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb58754c640 1 -- 10.20.193.78:0/2602542439 shutdown_connections 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.070+0000 7fb58754c640 1 -- 10.20.193.78:0/2602542439 >> 10.20.193.78:0/2602542439 conn(0x7fb5800b65f0 msgr2=0x7fb5800b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:56.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 1 -- 10.20.193.78:0/2602542439 shutdown_connections 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 1 -- 10.20.193.78:0/2602542439 wait complete. 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 10 monclient: build_initial_monmap 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 10 monclient: monmap: 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:56.081 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 1 librados: starting msgr at 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 1 librados: starting objecter 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 1 Processor -- start 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 1 -- start start 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 1 librados: setting wanted keys 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 1 librados: calling monclient init 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.071+0000 7fb58754c640 10 monclient: init 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 10 monclient(hunting): picked mon.noname-b con 0x7fb580058da0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 10 monclient(hunting): picked mon.noname-a con 0x7fb5800b0410 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:56.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 10 monclient(hunting): picked mon.noname-c con 0x7fb5801626a0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5801fb690 con 0x7fb5800b0410 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5801372c0 con 0x7fb580058da0 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5801fe5a0 con 0x7fb5801626a0 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb58754c640 10 monclient(hunting): authenticate will time out at 3765.661243s 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb584ac0640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb5800b0410 0x7fb5801faf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:54428/0 (socket says 10.20.193.78:54428) 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb584ac0640 1 -- 10.20.193.78:0/1268710550 learned_addr learned my addr 10.20.193.78:0/1268710550 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb56dffb640 10 client.?.objecter ms_handle_connect 0x7fb5800b0410 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb56dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb56dffb640 10 client.?.objecter ms_handle_connect 0x7fb5801626a0 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.072+0000 7fb56dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 client.?.objecter ms_handle_connect 0x7fb580058da0 2026-02-25T15:19:56.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312145346 0 0) 0x7fb5801fb690 con 0x7fb5800b0410 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 monclient(hunting): my global_id is 30972 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb550003610 con 0x7fb5800b0410 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662978464 0 0) 0x7fb5801fe5a0 con 0x7fb5801626a0 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 10 monclient(hunting): my global_id is 27803 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.073+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5801fb690 con 0x7fb5801626a0 2026-02-25T15:19:56.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.074+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065518785 0 0) 0x7fb5801372c0 con 0x7fb580058da0 2026-02-25T15:19:56.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.074+0000 7fb56dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.074+0000 7fb56dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.074+0000 7fb56dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.074+0000 7fb56dffb640 10 monclient(hunting): my global_id is 30262 2026-02-25T15:19:56.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.074+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5801fe5a0 con 0x7fb580058da0 2026-02-25T15:19:56.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3157583000 0 0) 0x7fb5801fb690 con 0x7fb5801626a0 2026-02-25T15:19:56.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5801372c0 con 0x7fb5801626a0 2026-02-25T15:19:56.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb57c003330 con 0x7fb5801626a0 2026-02-25T15:19:56.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:56.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:19:56.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): dump: 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4033396298 0 0) 0x7fb550003610 con 0x7fb5800b0410 2026-02-25T15:19:56.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5801fb690 con 0x7fb5800b0410 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb574003190 con 0x7fb5800b0410 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): dump: 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.090 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4017412848 0 0) 0x7fb5801fe5a0 con 0x7fb580058da0 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb550003610 con 0x7fb580058da0 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb570003310 con 0x7fb580058da0 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.076+0000 7fb56dffb640 10 monclient(hunting): dump: 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.091 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 37658730 0 0) 0x7fb5801372c0 con 0x7fb5801626a0 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 >> v1:10.20.193.155:6789/0 conn(0x7fb580058da0 legacy=0x7fb580136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 >> v1:10.20.193.78:6789/0 conn(0x7fb5800b0410 legacy=0x7fb5801faf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 1 monclient: found mon.c 2026-02-25T15:19:56.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5801fe880 con 0x7fb5801626a0 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 10 monclient: _finish_auth 0 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb56dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 5 monclient: authenticate success, global_id 27803 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 10 monclient: _renew_subs 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.167:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb5801feb60 con 0x7fb5801626a0 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 10 client.27803.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 10 monclient: _renew_subs 2026-02-25T15:19:56.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:56.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.167:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5801ff360 con 0x7fb5801626a0 2026-02-25T15:19:56.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 1 librados: init done 2026-02-25T15:19:56.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:56.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:56.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.167:6789/0 2026-02-25T15:19:56.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.078+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.167:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5801398c0 con 0x7fb5801626a0 2026-02-25T15:19:56.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb57c003a80 con 0x7fb5801626a0 2026-02-25T15:19:56.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:56.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fb57c003dd0 con 0x7fb5801626a0 2026-02-25T15:19:56.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:56.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:56.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56dffb640 10 monclient: dump: 2026-02-25T15:19:56.171 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.171 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56f7fe640 4 set_mon_vals no callback set 2026-02-25T15:19:56.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fb57c01cc40 con 0x7fb5801626a0 2026-02-25T15:19:56.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb5852c1640 10 monclient: get_auth_request con 0x7fb550077ed0 auth_method 0 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.169+0000 7fb56dffb640 10 client.27803.objecter ms_handle_connect 0x7fb550077ed0 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.170+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fb57c0922a0 con 0x7fb5801626a0 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.170+0000 7fb56dffb640 10 client.27803.objecter ms_dispatch2 0x7fb580000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.170+0000 7fb56dffb640 3 client.27803.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.170+0000 7fb56dffb640 3 client.27803.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.170+0000 7fb56dffb640 20 client.27803.objecter dump_active .. 0 homeless 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.171+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mon.2 v1:10.20.193.167:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb57c05ccd0 con 0x7fb5801626a0 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.171+0000 7fb56dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:56.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.171+0000 7fb56dffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:56.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.275+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 --> v1:10.20.193.78:6800/3497602169 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb58015ebd0 con 0x7fb550077ed0 2026-02-25T15:19:56.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.276+0000 7fb56dffb640 1 -- 10.20.193.78:0/1268710550 <== mgr.4107 v1:10.20.193.78:6800/3497602169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125261 (unknown 2965378022 0 3992745018) 0x7fb58015ebd0 con 0x7fb550077ed0 2026-02-25T15:19:56.280 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-25T15:19:56.280 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-25T15:19:56.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 10 librados: watch_flush enter 2026-02-25T15:19:56.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 10 librados: watch_flush exit 2026-02-25T15:19:56.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 20 client.27803.objecter shutdown clearing up homeless session... 2026-02-25T15:19:56.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 10 client.27803.objecter successfully canceled tick 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 >> v1:10.20.193.78:6800/3497602169 conn(0x7fb550077ed0 legacy=0x7fb550098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 10 monclient: shutdown 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 >> v1:10.20.193.167:6789/0 conn(0x7fb5801626a0 legacy=0x7fb58013e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 shutdown_connections 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 >> 10.20.193.78:0/1268710550 conn(0x7fb5800b65f0 msgr2=0x7fb5800566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 shutdown_connections 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 1 -- 10.20.193.78:0/1268710550 wait complete. 2026-02-25T15:19:56.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.277+0000 7fb58754c640 1 librados: shutdown 2026-02-25T15:19:56.288 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2026-02-25T15:19:54.811547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":562072,"kb_used_data":112664,"kb_used_omap":24545,"kb_used_meta":424606,"kb_avail":1509387368,"statfs":{"total":1546188226560,"available":1545612664832,"internally_reserved":0,"allocated":115367936,"data_stored":73505504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134460,"internal_metadata":434797188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002194"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.294519+0000","last_change":"2026-02-25T15:19:32.294519+0000","last_active":"2026-02-25T15:19:32.294519+0000","last_peered":"2026-02-25T15:19:32.294519+0000","last_clean":"2026-02-25T15:19:32.294519+0000","last_became_active":"2026-02-25T15:13:41.228177+0000","last_became_peered":"2026-02-25T15:13:41.228177+0000","last_unstale":"2026-02-25T15:19:32.294519+0000","last_undegraded":"2026-02-25T15:19:32.294519+0000","last_fullsized":"2026-02-25T15:19:32.294519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.292814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.292814+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.292814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:31:11.741837+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.382064+0000","last_change":"2026-02-25T15:19:32.382064+0000","last_active":"2026-02-25T15:19:32.382064+0000","last_peered":"2026-02-25T15:19:32.382064+0000","last_clean":"2026-02-25T15:19:32.382064+0000","last_became_active":"2026-02-25T15:13:41.568996+0000","last_became_peered":"2026-02-25T15:13:41.568996+0000","last_unstale":"2026-02-25T15:19:32.382064+0000","last_undegraded":"2026-02-25T15:19:32.382064+0000","last_fullsized":"2026-02-25T15:19:32.382064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.381095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.381095+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.381095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:49:58.654066+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:35.714747+0000","last_change":"2026-02-25T15:19:35.714747+0000","last_active":"2026-02-25T15:19:35.714747+0000","last_peered":"2026-02-25T15:19:35.714747+0000","last_clean":"2026-02-25T15:19:35.714747+0000","last_became_active":"2026-02-25T15:13:41.269950+0000","last_became_peered":"2026-02-25T15:13:41.269950+0000","last_unstale":"2026-02-25T15:19:35.714747+0000","last_undegraded":"2026-02-25T15:19:35.714747+0000","last_fullsized":"2026-02-25T15:19:35.714747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:35.713095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:35.713095+0000","last_clean_scrub_stamp":"2026-02-25T15:19:35.713095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:26:52.827503+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:31.791801+0000","last_change":"2026-02-25T15:19:31.790903+0000","last_active":"2026-02-25T15:19:31.791801+0000","last_peered":"2026-02-25T15:19:31.791801+0000","last_clean":"2026-02-25T15:19:31.791801+0000","last_became_active":"2026-02-25T15:13:40.989776+0000","last_became_peered":"2026-02-25T15:13:40.989776+0000","last_unstale":"2026-02-25T15:19:31.791801+0000","last_undegraded":"2026-02-25T15:19:31.791801+0000","last_fullsized":"2026-02-25T15:19:31.791801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:31.789063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:31.789063+0000","last_clean_scrub_stamp":"2026-02-25T15:19:31.789063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:22:04.761807+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":656,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:36.547785+0000","last_change":"2026-02-25T15:19:36.547785+0000","last_active":"2026-02-25T15:19:36.547785+0000","last_peered":"2026-02-25T15:19:36.547785+0000","last_clean":"2026-02-25T15:19:36.547785+0000","last_became_active":"2026-02-25T15:13:41.090430+0000","last_became_peered":"2026-02-25T15:13:41.090430+0000","last_unstale":"2026-02-25T15:19:36.547785+0000","last_undegraded":"2026-02-25T15:19:36.547785+0000","last_fullsized":"2026-02-25T15:19:36.547785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:36.546023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:36.546023+0000","last_clean_scrub_stamp":"2026-02-25T15:19:36.546023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:49:02.586310+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":656,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:37.596495+0000","last_change":"2026-02-25T15:19:37.596495+0000","last_active":"2026-02-25T15:19:37.596495+0000","last_peered":"2026-02-25T15:19:37.596495+0000","last_clean":"2026-02-25T15:19:37.596495+0000","last_became_active":"2026-02-25T15:13:41.036970+0000","last_became_peered":"2026-02-25T15:13:41.036970+0000","last_unstale":"2026-02-25T15:19:37.596495+0000","last_undegraded":"2026-02-25T15:19:37.596495+0000","last_fullsized":"2026-02-25T15:19:37.596495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:37.595057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:37.595057+0000","last_clean_scrub_stamp":"2026-02-25T15:19:37.595057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:56:38.661635+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:37.616540+0000","last_change":"2026-02-25T15:19:37.616540+0000","last_active":"2026-02-25T15:19:37.616540+0000","last_peered":"2026-02-25T15:19:37.616540+0000","last_clean":"2026-02-25T15:19:37.616540+0000","last_became_active":"2026-02-25T15:13:41.097058+0000","last_became_peered":"2026-02-25T15:13:41.097058+0000","last_unstale":"2026-02-25T15:19:37.616540+0000","last_undegraded":"2026-02-25T15:19:37.616540+0000","last_fullsized":"2026-02-25T15:19:37.616540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:37.614937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:37.614937+0000","last_clean_scrub_stamp":"2026-02-25T15:19:37.614937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:19:53.333809+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:35.543113+0000","last_change":"2026-02-25T15:19:35.543113+0000","last_active":"2026-02-25T15:19:35.543113+0000","last_peered":"2026-02-25T15:19:35.543113+0000","last_clean":"2026-02-25T15:19:35.543113+0000","last_became_active":"2026-02-25T15:13:40.967270+0000","last_became_peered":"2026-02-25T15:13:40.967270+0000","last_unstale":"2026-02-25T15:19:35.543113+0000","last_undegraded":"2026-02-25T15:19:35.543113+0000","last_fullsized":"2026-02-25T15:19:35.543113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:35.541368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:35.541368+0000","last_clean_scrub_stamp":"2026-02-25T15:19:35.541368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:45:55.978487+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":655,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:33.198443+0000","last_change":"2026-02-25T15:19:33.198443+0000","last_active":"2026-02-25T15:19:33.198443+0000","last_peered":"2026-02-25T15:19:33.198443+0000","last_clean":"2026-02-25T15:19:33.198443+0000","last_became_active":"2026-02-25T15:13:42.528480+0000","last_became_peered":"2026-02-25T15:13:42.528480+0000","last_unstale":"2026-02-25T15:19:33.198443+0000","last_undegraded":"2026-02-25T15:19:33.198443+0000","last_fullsized":"2026-02-25T15:19:33.198443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:33.196445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:33.196445+0000","last_clean_scrub_stamp":"2026-02-25T15:19:33.196445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:51:39.551717+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:33.068322+0000","last_change":"2026-02-25T15:19:33.068322+0000","last_active":"2026-02-25T15:19:33.068322+0000","last_peered":"2026-02-25T15:19:33.068322+0000","last_clean":"2026-02-25T15:19:33.068322+0000","last_became_active":"2026-02-25T15:13:40.708195+0000","last_became_peered":"2026-02-25T15:13:40.708195+0000","last_unstale":"2026-02-25T15:19:33.068322+0000","last_undegraded":"2026-02-25T15:19:33.068322+0000","last_fullsized":"2026-02-25T15:19:33.068322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:33.066454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:33.066454+0000","last_clean_scrub_stamp":"2026-02-25T15:19:33.066454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:26:46.546662+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:34.694551+0000","last_change":"2026-02-25T15:19:34.694551+0000","last_active":"2026-02-25T15:19:34.694551+0000","last_peered":"2026-02-25T15:19:34.694551+0000","last_clean":"2026-02-25T15:19:34.694551+0000","last_became_active":"2026-02-25T15:13:41.096638+0000","last_became_peered":"2026-02-25T15:13:41.096638+0000","last_unstale":"2026-02-25T15:19:34.694551+0000","last_undegraded":"2026-02-25T15:19:34.694551+0000","last_fullsized":"2026-02-25T15:19:34.694551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:34.692777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:34.692777+0000","last_clean_scrub_stamp":"2026-02-25T15:19:34.692777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:04:17.346829+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:31.416214+0000","last_change":"2026-02-25T15:19:31.416214+0000","last_active":"2026-02-25T15:19:31.416214+0000","last_peered":"2026-02-25T15:19:31.416214+0000","last_clean":"2026-02-25T15:19:31.416214+0000","last_became_active":"2026-02-25T15:13:40.929107+0000","last_became_peered":"2026-02-25T15:13:40.929107+0000","last_unstale":"2026-02-25T15:19:31.416214+0000","last_undegraded":"2026-02-25T15:19:31.416214+0000","last_fullsized":"2026-02-25T15:19:31.416214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:31.414445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:31.414445+0000","last_clean_scrub_stamp":"2026-02-25T15:19:31.414445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:04:15.554489+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":653,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:33.394137+0000","last_change":"2026-02-25T15:19:33.394137+0000","last_active":"2026-02-25T15:19:33.394137+0000","last_peered":"2026-02-25T15:19:33.394137+0000","last_clean":"2026-02-25T15:19:33.394137+0000","last_became_active":"2026-02-25T15:13:41.271609+0000","last_became_peered":"2026-02-25T15:13:41.271609+0000","last_unstale":"2026-02-25T15:19:33.394137+0000","last_undegraded":"2026-02-25T15:19:33.394137+0000","last_fullsized":"2026-02-25T15:19:33.394137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:33.392146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:33.392146+0000","last_clean_scrub_stamp":"2026-02-25T15:19:33.392146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:44:23.642950+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:36.588458+0000","last_change":"2026-02-25T15:19:36.588458+0000","last_active":"2026-02-25T15:19:36.588458+0000","last_peered":"2026-02-25T15:19:36.588458+0000","last_clean":"2026-02-25T15:19:36.588458+0000","last_became_active":"2026-02-25T15:13:40.968637+0000","last_became_peered":"2026-02-25T15:13:40.968637+0000","last_unstale":"2026-02-25T15:19:36.588458+0000","last_undegraded":"2026-02-25T15:19:36.588458+0000","last_fullsized":"2026-02-25T15:19:36.588458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:36.586740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:36.586740+0000","last_clean_scrub_stamp":"2026-02-25T15:19:36.586740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:08:04.247675+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.239117+0000","last_change":"2026-02-25T15:19:32.239117+0000","last_active":"2026-02-25T15:19:32.239117+0000","last_peered":"2026-02-25T15:19:32.239117+0000","last_clean":"2026-02-25T15:19:32.239117+0000","last_became_active":"2026-02-25T15:13:40.949974+0000","last_became_peered":"2026-02-25T15:13:40.949974+0000","last_unstale":"2026-02-25T15:19:32.239117+0000","last_undegraded":"2026-02-25T15:19:32.239117+0000","last_fullsized":"2026-02-25T15:19:32.239117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.237287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.237287+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.237287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:48:29.768575+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:34.650014+0000","last_change":"2026-02-25T15:19:34.650014+0000","last_active":"2026-02-25T15:19:34.650014+0000","last_peered":"2026-02-25T15:19:34.650014+0000","last_clean":"2026-02-25T15:19:34.650014+0000","last_became_active":"2026-02-25T15:13:40.988676+0000","last_became_peered":"2026-02-25T15:13:40.988676+0000","last_unstale":"2026-02-25T15:19:34.650014+0000","last_undegraded":"2026-02-25T15:19:34.650014+0000","last_fullsized":"2026-02-25T15:19:34.650014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:34.645314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:34.645314+0000","last_clean_scrub_stamp":"2026-02-25T15:19:34.645314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:22:39.883700+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:33.757372+0000","last_change":"2026-02-25T15:19:33.757372+0000","last_active":"2026-02-25T15:19:33.757372+0000","last_peered":"2026-02-25T15:19:33.757372+0000","last_clean":"2026-02-25T15:19:33.757372+0000","last_became_active":"2026-02-25T15:13:40.743919+0000","last_became_peered":"2026-02-25T15:13:40.743919+0000","last_unstale":"2026-02-25T15:19:33.757372+0000","last_undegraded":"2026-02-25T15:19:33.757372+0000","last_fullsized":"2026-02-25T15:19:33.757372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:33.752884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:33.752884+0000","last_clean_scrub_stamp":"2026-02-25T15:19:33.752884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:43:12.929567+0000","scrub_duration":89,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:37.201734+0000","last_change":"2026-02-25T15:19:37.201734+0000","last_active":"2026-02-25T15:19:37.201734+0000","last_peered":"2026-02-25T15:19:37.201734+0000","last_clean":"2026-02-25T15:19:37.201734+0000","last_became_active":"2026-02-25T15:13:41.340878+0000","last_became_peered":"2026-02-25T15:13:41.340878+0000","last_unstale":"2026-02-25T15:19:37.201734+0000","last_undegraded":"2026-02-25T15:19:37.201734+0000","last_fullsized":"2026-02-25T15:19:37.201734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:37.199827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:37.199827+0000","last_clean_scrub_stamp":"2026-02-25T15:19:37.199827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:07:55.023350+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":657,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:35.639065+0000","last_change":"2026-02-25T15:19:35.639065+0000","last_active":"2026-02-25T15:19:35.639065+0000","last_peered":"2026-02-25T15:19:35.639065+0000","last_clean":"2026-02-25T15:19:35.639065+0000","last_became_active":"2026-02-25T15:13:40.959639+0000","last_became_peered":"2026-02-25T15:13:40.959639+0000","last_unstale":"2026-02-25T15:19:35.639065+0000","last_undegraded":"2026-02-25T15:19:35.639065+0000","last_fullsized":"2026-02-25T15:19:35.639065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:35.638275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:35.638275+0000","last_clean_scrub_stamp":"2026-02-25T15:19:35.638275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:39:37.545407+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":655,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:31.221604+0000","last_change":"2026-02-25T15:19:31.221604+0000","last_active":"2026-02-25T15:19:31.221604+0000","last_peered":"2026-02-25T15:19:31.221604+0000","last_clean":"2026-02-25T15:19:31.221604+0000","last_became_active":"2026-02-25T15:13:41.104041+0000","last_became_peered":"2026-02-25T15:13:41.104041+0000","last_unstale":"2026-02-25T15:19:31.221604+0000","last_undegraded":"2026-02-25T15:19:31.221604+0000","last_fullsized":"2026-02-25T15:19:31.221604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:31.216890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:31.216890+0000","last_clean_scrub_stamp":"2026-02-25T15:19:31.216890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:02:52.717685+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:36.197791+0000","last_change":"2026-02-25T15:19:36.197791+0000","last_active":"2026-02-25T15:19:36.197791+0000","last_peered":"2026-02-25T15:19:36.197791+0000","last_clean":"2026-02-25T15:19:36.197791+0000","last_became_active":"2026-02-25T15:13:41.918321+0000","last_became_peered":"2026-02-25T15:13:41.918321+0000","last_unstale":"2026-02-25T15:19:36.197791+0000","last_undegraded":"2026-02-25T15:19:36.197791+0000","last_fullsized":"2026-02-25T15:19:36.197791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:36.195942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:36.195942+0000","last_clean_scrub_stamp":"2026-02-25T15:19:36.195942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:59:17.282087+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:34.023529+0000","last_change":"2026-02-25T15:19:34.023529+0000","last_active":"2026-02-25T15:19:34.023529+0000","last_peered":"2026-02-25T15:19:34.023529+0000","last_clean":"2026-02-25T15:19:34.023529+0000","last_became_active":"2026-02-25T15:13:41.078571+0000","last_became_peered":"2026-02-25T15:13:41.078571+0000","last_unstale":"2026-02-25T15:19:34.023529+0000","last_undegraded":"2026-02-25T15:19:34.023529+0000","last_fullsized":"2026-02-25T15:19:34.023529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:34.022767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:34.022767+0000","last_clean_scrub_stamp":"2026-02-25T15:19:34.022767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:05:08.623505+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":657,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:30.925632+0000","last_change":"2026-02-25T15:19:30.925632+0000","last_active":"2026-02-25T15:19:30.925632+0000","last_peered":"2026-02-25T15:19:30.925632+0000","last_clean":"2026-02-25T15:19:30.925632+0000","last_became_active":"2026-02-25T15:13:41.027073+0000","last_became_peered":"2026-02-25T15:13:41.027073+0000","last_unstale":"2026-02-25T15:19:30.925632+0000","last_undegraded":"2026-02-25T15:19:30.925632+0000","last_fullsized":"2026-02-25T15:19:30.925632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:30.920588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:30.920588+0000","last_clean_scrub_stamp":"2026-02-25T15:19:30.920588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:06.397972+0000","scrub_duration":120,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:35.611234+0000","last_change":"2026-02-25T15:19:35.611234+0000","last_active":"2026-02-25T15:19:35.611234+0000","last_peered":"2026-02-25T15:19:35.611234+0000","last_clean":"2026-02-25T15:19:35.611234+0000","last_became_active":"2026-02-25T15:13:40.944589+0000","last_became_peered":"2026-02-25T15:13:40.944589+0000","last_unstale":"2026-02-25T15:19:35.611234+0000","last_undegraded":"2026-02-25T15:19:35.611234+0000","last_fullsized":"2026-02-25T15:19:35.611234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:35.610488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:35.610488+0000","last_clean_scrub_stamp":"2026-02-25T15:19:35.610488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:09:29.888245+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":655,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.160176+0000","last_change":"2026-02-25T15:19:32.160176+0000","last_active":"2026-02-25T15:19:32.160176+0000","last_peered":"2026-02-25T15:19:32.160176+0000","last_clean":"2026-02-25T15:19:32.160176+0000","last_became_active":"2026-02-25T15:13:42.003162+0000","last_became_peered":"2026-02-25T15:13:42.003162+0000","last_unstale":"2026-02-25T15:19:32.160176+0000","last_undegraded":"2026-02-25T15:19:32.160176+0000","last_fullsized":"2026-02-25T15:19:32.160176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.158653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.158653+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.158653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:05:44.223773+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":656,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:35.659637+0000","last_change":"2026-02-25T15:19:35.659637+0000","last_active":"2026-02-25T15:19:35.659637+0000","last_peered":"2026-02-25T15:19:35.659637+0000","last_clean":"2026-02-25T15:19:35.659637+0000","last_became_active":"2026-02-25T15:13:41.040468+0000","last_became_peered":"2026-02-25T15:13:41.040468+0000","last_unstale":"2026-02-25T15:19:35.659637+0000","last_undegraded":"2026-02-25T15:19:35.659637+0000","last_fullsized":"2026-02-25T15:19:35.659637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:35.653856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:35.653856+0000","last_clean_scrub_stamp":"2026-02-25T15:19:35.653856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:07:39.879443+0000","scrub_duration":100,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:35.192164+0000","last_change":"2026-02-25T15:19:35.192164+0000","last_active":"2026-02-25T15:19:35.192164+0000","last_peered":"2026-02-25T15:19:35.192164+0000","last_clean":"2026-02-25T15:19:35.192164+0000","last_became_active":"2026-02-25T15:13:40.462421+0000","last_became_peered":"2026-02-25T15:13:40.462421+0000","last_unstale":"2026-02-25T15:19:35.192164+0000","last_undegraded":"2026-02-25T15:19:35.192164+0000","last_fullsized":"2026-02-25T15:19:35.192164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:35.190668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:35.190668+0000","last_clean_scrub_stamp":"2026-02-25T15:19:35.190668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:01:41.403987+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":660,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:33.198560+0000","last_change":"2026-02-25T15:19:33.198560+0000","last_active":"2026-02-25T15:19:33.198560+0000","last_peered":"2026-02-25T15:19:33.198560+0000","last_clean":"2026-02-25T15:19:33.198560+0000","last_became_active":"2026-02-25T15:13:40.744228+0000","last_became_peered":"2026-02-25T15:13:40.744228+0000","last_unstale":"2026-02-25T15:19:33.198560+0000","last_undegraded":"2026-02-25T15:19:33.198560+0000","last_fullsized":"2026-02-25T15:19:33.198560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:33.196812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:33.196812+0000","last_clean_scrub_stamp":"2026-02-25T15:19:33.196812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:56:47.713426+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.1","version":"352'12","reported_seq":687,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:33.647262+0000","last_change":"2026-02-25T15:19:33.647262+0000","last_active":"2026-02-25T15:19:33.647262+0000","last_peered":"2026-02-25T15:19:33.647262+0000","last_clean":"2026-02-25T15:19:33.647262+0000","last_became_active":"2026-02-25T15:13:40.703448+0000","last_became_peered":"2026-02-25T15:13:40.703448+0000","last_unstale":"2026-02-25T15:19:33.647262+0000","last_undegraded":"2026-02-25T15:19:33.647262+0000","last_fullsized":"2026-02-25T15:19:33.647262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"352'12","last_scrub_stamp":"2026-02-25T15:19:33.645849+0000","last_deep_scrub":"352'12","last_deep_scrub_stamp":"2026-02-25T15:19:33.645849+0000","last_clean_scrub_stamp":"2026-02-25T15:19:33.645849+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:48:21.535477+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:30.439337+0000","last_change":"2026-02-25T15:19:30.438504+0000","last_active":"2026-02-25T15:19:30.439337+0000","last_peered":"2026-02-25T15:19:30.439337+0000","last_clean":"2026-02-25T15:19:30.439337+0000","last_became_active":"2026-02-25T15:13:41.233579+0000","last_became_peered":"2026-02-25T15:13:41.233579+0000","last_unstale":"2026-02-25T15:19:30.439337+0000","last_undegraded":"2026-02-25T15:19:30.439337+0000","last_fullsized":"2026-02-25T15:19:30.439337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:30.433126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:30.433126+0000","last_clean_scrub_stamp":"2026-02-25T15:19:30.433126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:52:47.968903+0000","scrub_duration":125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:36.626182+0000","last_change":"2026-02-25T15:19:36.626182+0000","last_active":"2026-02-25T15:19:36.626182+0000","last_peered":"2026-02-25T15:19:36.626182+0000","last_clean":"2026-02-25T15:19:36.626182+0000","last_became_active":"2026-02-25T15:13:41.021310+0000","last_became_peered":"2026-02-25T15:13:41.021310+0000","last_unstale":"2026-02-25T15:19:36.626182+0000","last_undegraded":"2026-02-25T15:19:36.626182+0000","last_fullsized":"2026-02-25T15:19:36.626182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:36.624531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:36.624531+0000","last_clean_scrub_stamp":"2026-02-25T15:19:36.624531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:23:42.080401+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":658,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.006150+0000","last_change":"2026-02-25T15:19:32.006150+0000","last_active":"2026-02-25T15:19:32.006150+0000","last_peered":"2026-02-25T15:19:32.006150+0000","last_clean":"2026-02-25T15:19:32.006150+0000","last_became_active":"2026-02-25T15:13:40.701282+0000","last_became_peered":"2026-02-25T15:13:40.701282+0000","last_unstale":"2026-02-25T15:19:32.006150+0000","last_undegraded":"2026-02-25T15:19:32.006150+0000","last_fullsized":"2026-02-25T15:19:32.006150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.004165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.004165+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.004165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:33:08.332052+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,12],"acting":[5,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":674,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:32.925686+0000","last_change":"2026-02-25T15:19:32.925686+0000","last_active":"2026-02-25T15:19:32.925686+0000","last_peered":"2026-02-25T15:19:32.925686+0000","last_clean":"2026-02-25T15:19:32.925686+0000","last_became_active":"2026-02-25T15:13:01.240693+0000","last_became_peered":"2026-02-25T15:13:01.240693+0000","last_unstale":"2026-02-25T15:19:32.925686+0000","last_undegraded":"2026-02-25T15:19:32.925686+0000","last_fullsized":"2026-02-25T15:19:32.925686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:32.924079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:32.924079+0000","last_clean_scrub_stamp":"2026-02-25T15:19:32.924079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:27:10.246630+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.068336521999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,15],"acting":[12,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":676,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:34.592211+0000","last_change":"2026-02-25T15:19:34.592211+0000","last_active":"2026-02-25T15:19:34.592211+0000","last_peered":"2026-02-25T15:19:34.592211+0000","last_clean":"2026-02-25T15:19:34.592211+0000","last_became_active":"2026-02-25T15:13:01.107596+0000","last_became_peered":"2026-02-25T15:13:01.107596+0000","last_unstale":"2026-02-25T15:19:34.592211+0000","last_undegraded":"2026-02-25T15:19:34.592211+0000","last_fullsized":"2026-02-25T15:19:34.592211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:34.590561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:34.590561+0000","last_clean_scrub_stamp":"2026-02-25T15:19:34.590561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:41:39.162957+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.043275358999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":674,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:37.678034+0000","last_change":"2026-02-25T15:19:37.678034+0000","last_active":"2026-02-25T15:19:37.678034+0000","last_peered":"2026-02-25T15:19:37.678034+0000","last_clean":"2026-02-25T15:19:37.678034+0000","last_became_active":"2026-02-25T15:13:00.886357+0000","last_became_peered":"2026-02-25T15:13:00.886357+0000","last_unstale":"2026-02-25T15:19:37.678034+0000","last_undegraded":"2026-02-25T15:19:37.678034+0000","last_fullsized":"2026-02-25T15:19:37.678034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:37.676403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:37.676403+0000","last_clean_scrub_stamp":"2026-02-25T15:19:37.676403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:42:57.829363+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0.047817094999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":674,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:35.645090+0000","last_change":"2026-02-25T15:19:35.645090+0000","last_active":"2026-02-25T15:19:35.645090+0000","last_peered":"2026-02-25T15:19:35.645090+0000","last_clean":"2026-02-25T15:19:35.645090+0000","last_became_active":"2026-02-25T15:13:01.030043+0000","last_became_peered":"2026-02-25T15:13:01.030043+0000","last_unstale":"2026-02-25T15:19:35.645090+0000","last_undegraded":"2026-02-25T15:19:35.645090+0000","last_fullsized":"2026-02-25T15:19:35.645090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:35.643252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:35.643252+0000","last_clean_scrub_stamp":"2026-02-25T15:19:35.643252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:57:36.836610+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.047341022000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14],"acting":[11,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"352'3","reported_seq":677,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:30.933553+0000","last_change":"2026-02-25T15:19:30.933553+0000","last_active":"2026-02-25T15:19:30.933553+0000","last_peered":"2026-02-25T15:19:30.933553+0000","last_clean":"2026-02-25T15:19:30.933553+0000","last_became_active":"2026-02-25T15:13:01.242716+0000","last_became_peered":"2026-02-25T15:13:01.242716+0000","last_unstale":"2026-02-25T15:19:30.933553+0000","last_undegraded":"2026-02-25T15:19:30.933553+0000","last_fullsized":"2026-02-25T15:19:30.933553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"352'3","last_scrub_stamp":"2026-02-25T15:19:30.931562+0000","last_deep_scrub":"352'3","last_deep_scrub_stamp":"2026-02-25T15:19:30.931562+0000","last_clean_scrub_stamp":"2026-02-25T15:19:30.931562+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:29:08.844598+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0.073362477999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,8],"acting":[12,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":675,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:34.750827+0000","last_change":"2026-02-25T15:19:34.750827+0000","last_active":"2026-02-25T15:19:34.750827+0000","last_peered":"2026-02-25T15:19:34.750827+0000","last_clean":"2026-02-25T15:19:34.750827+0000","last_became_active":"2026-02-25T15:13:01.167595+0000","last_became_peered":"2026-02-25T15:13:01.167595+0000","last_unstale":"2026-02-25T15:19:34.750827+0000","last_undegraded":"2026-02-25T15:19:34.750827+0000","last_fullsized":"2026-02-25T15:19:34.750827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:34.746484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:34.746484+0000","last_clean_scrub_stamp":"2026-02-25T15:19:34.746484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:28:09.407007+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0.030257392000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":678,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:34.202265+0000","last_change":"2026-02-25T15:19:34.202265+0000","last_active":"2026-02-25T15:19:34.202265+0000","last_peered":"2026-02-25T15:19:34.202265+0000","last_clean":"2026-02-25T15:19:34.202265+0000","last_became_active":"2026-02-25T15:13:01.165967+0000","last_became_peered":"2026-02-25T15:13:01.165967+0000","last_unstale":"2026-02-25T15:19:34.202265+0000","last_undegraded":"2026-02-25T15:19:34.202265+0000","last_fullsized":"2026-02-25T15:19:34.202265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:19:34.200125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:19:34.200125+0000","last_clean_scrub_stamp":"2026-02-25T15:19:34.200125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:21.002232+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.030945777000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,8],"acting":[13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.3","version":"352'2","reported_seq":676,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:31.897242+0000","last_change":"2026-02-25T15:19:31.897242+0000","last_active":"2026-02-25T15:19:31.897242+0000","last_peered":"2026-02-25T15:19:31.897242+0000","last_clean":"2026-02-25T15:19:31.897242+0000","last_became_active":"2026-02-25T15:13:01.049643+0000","last_became_peered":"2026-02-25T15:13:01.049643+0000","last_unstale":"2026-02-25T15:19:31.897242+0000","last_undegraded":"2026-02-25T15:19:31.897242+0000","last_fullsized":"2026-02-25T15:19:31.897242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"352'2","last_scrub_stamp":"2026-02-25T15:19:31.895872+0000","last_deep_scrub":"352'2","last_deep_scrub_stamp":"2026-02-25T15:19:31.895872+0000","last_clean_scrub_stamp":"2026-02-25T15:19:31.895872+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:37:12.678349+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.059457101999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"1.0","version":"352'34","reported_seq":723,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-25T15:19:31.329298+0000","last_change":"2026-02-25T15:19:31.329298+0000","last_active":"2026-02-25T15:19:31.329298+0000","last_peered":"2026-02-25T15:19:31.329298+0000","last_clean":"2026-02-25T15:19:31.329298+0000","last_became_active":"2026-02-25T15:12:53.235995+0000","last_became_peered":"2026-02-25T15:12:53.235995+0000","last_unstale":"2026-02-25T15:19:31.329298+0000","last_undegraded":"2026-02-25T15:19:31.329298+0000","last_fullsized":"2026-02-25T15:19:31.329298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"352'34","last_scrub_stamp":"2026-02-25T15:19:31.328290+0000","last_deep_scrub":"352'34","last_deep_scrub_stamp":"2026-02-25T15:19:31.328290+0000","last_clean_scrub_stamp":"2026-02-25T15:19:31.328290+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:38:58.609040+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280598,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51992,"kb_used_data":6984,"kb_used_omap":4679,"kb_used_meta":40312,"kb_avail":94319848,"statfs":{"total":96636764160,"available":96583524352,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4792230,"internal_metadata":41279578},"hb_peers":[0,1,4,5,6,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280598,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222244,"internal_metadata":27368412},"hb_peers":[1,2,3,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280599,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4536700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220070,"internal_metadata":27370586},"hb_peers":[1,4,5,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313302,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":3025,"kb_used_meta":23918,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3097754,"internal_metadata":24492902},"hb_peers":[0,1,2,3,4,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313302,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":8641,"kb_used_meta":18302,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8848431,"internal_metadata":18742225},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280598,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218584,"internal_metadata":27372072},"hb_peers":[1,3,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280599,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34396,"kb_used_data":7436,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337444,"statfs":{"total":96636764160,"available":96601542656,"internally_reserved":0,"allocated":7614464,"data_stored":4995961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220345,"internal_metadata":27370311},"hb_peers":[0,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280598,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217327,"internal_metadata":27373329},"hb_peers":[1,3,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280599,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219675,"internal_metadata":27370981},"hb_peers":[0,1,2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280598,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34400,"kb_used_data":7440,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337440,"statfs":{"total":96636764160,"available":96601538560,"internally_reserved":0,"allocated":7618560,"data_stored":4995966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220215,"internal_metadata":27370441},"hb_peers":[0,1,2,3,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280598,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":2927,"kb_used_meta":24016,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4536686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2997987,"internal_metadata":24592669},"hb_peers":[0,1,2,4,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280598,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218716,"internal_metadata":27371940},"hb_peers":[0,1,2,3,4,5,6,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":22,"seq":94489280598,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4536700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220200,"internal_metadata":27370456},"hb_peers":[1,2,3,4,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280600,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":182,"kb_used_meta":26761,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187370,"internal_metadata":27403286},"hb_peers":[0,2,3,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280599,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":3022,"kb_used_meta":23921,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3094892,"internal_metadata":24495764},"hb_peers":[1,2,3,5,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280598,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4536681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138420,"internal_metadata":27452236},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:19:56.293 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-25T15:19:56.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.356+0000 7fa8cdba2640 10 monclient: get_monmap_and_config 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.356+0000 7fa8cdba2640 10 monclient: build_initial_monmap 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.356+0000 7fa8cdba2640 10 monclient: monmap: 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:19:56.357478+0000 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:19:56.357478+0000 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.359 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:56.360 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:56.360 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:56.360 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.356+0000 7fa8cdba2640 1 Processor -- start 2026-02-25T15:19:56.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 1 -- start start 2026-02-25T15:19:56.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 10 monclient: init 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 10 monclient(hunting): picked mon.noname-c con 0x7fa8c815afd0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 10 monclient(hunting): picked mon.noname-b con 0x7fa8c815b3a0 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 10 monclient(hunting): picked mon.noname-a con 0x7fa8c8163890 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c8162380 con 0x7fa8c8163890 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c80b1c30 con 0x7fa8c815b3a0 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c80b1f10 con 0x7fa8c815afd0 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.357+0000 7fa8cdba2640 10 monclient(hunting): authenticate will time out at 3765.946600s 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.358+0000 7fa8c7fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa8c8163890 0x7fa8c8164480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:54442/0 (socket says 10.20.193.78:54442) 2026-02-25T15:19:56.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.358+0000 7fa8c7fff640 1 -- 10.20.193.78:0/1971948953 learned_addr learned my addr 10.20.193.78:0/1971948953 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149179448 0 0) 0x7fa8c8162380 con 0x7fa8c8163890 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): my global_id is 30975 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8ac003610 con 0x7fa8c8163890 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385919815 0 0) 0x7fa8c80b1f10 con 0x7fa8c815afd0 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): my global_id is 27806 2026-02-25T15:19:56.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c8162380 con 0x7fa8c815afd0 2026-02-25T15:19:56.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015265744 0 0) 0x7fa8c80b1c30 con 0x7fa8c815b3a0 2026-02-25T15:19:56.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 10 monclient(hunting): my global_id is 30265 2026-02-25T15:19:56.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.359+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c80b1f10 con 0x7fa8c815b3a0 2026-02-25T15:19:56.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.360+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2911034333 0 0) 0x7fa8ac003610 con 0x7fa8c8163890 2026-02-25T15:19:56.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.360+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 >> v1:10.20.193.167:6789/0 conn(0x7fa8c815afd0 legacy=0x7fa8c8059be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 >> v1:10.20.193.155:6789/0 conn(0x7fa8c815b3a0 legacy=0x7fa8c805d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: _finish_hunting 0 2026-02-25T15:19:56.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 1 monclient: found mon.noname-a 2026-02-25T15:19:56.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:56.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c80b21f0 con 0x7fa8c8163890 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: _finish_auth 0 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: _check_auth_tickets 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa8bc003170 con 0x7fa8c8163890 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: dump: 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.373 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8cdba2640 5 monclient: authenticate success, global_id 30975 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8cdba2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8bc003340 con 0x7fa8c8163890 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 1 -- 10.20.193.78:0/1971948953 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa8bc003780 con 0x7fa8c8163890 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:56.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8c67fc640 10 monclient: dump: 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8cdba2640 10 monclient: get_monmap_and_config success 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.361+0000 7fa8cdba2640 4 set_mon_vals no callback set 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 10 monclient: shutdown 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 -- 10.20.193.78:0/1971948953 >> v1:10.20.193.78:6789/0 conn(0x7fa8c8163890 legacy=0x7fa8c8164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 -- 10.20.193.78:0/1971948953 shutdown_connections 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 -- 10.20.193.78:0/1971948953 >> 10.20.193.78:0/1971948953 conn(0x7fa8c80b2f10 msgr2=0x7fa8c80b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 -- 10.20.193.78:0/1971948953 shutdown_connections 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 -- 10.20.193.78:0/1971948953 wait complete. 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 10 monclient: build_initial_monmap 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 10 monclient: monmap: 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:19:56.376 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.noname-b 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.noname-c 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 librados: starting msgr at 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 librados: starting objecter 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 Processor -- start 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 -- start start 2026-02-25T15:19:56.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 librados: setting wanted keys 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 1 librados: calling monclient init 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.362+0000 7fa8cdba2640 10 monclient: init 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 10 monclient: _reopen_session rank -1 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 10 monclient(hunting): picked mon.noname-c con 0x7fa8c815afd0 addr v1:10.20.193.167:6789/0 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 10 monclient(hunting): picked mon.noname-a con 0x7fa8c815b3a0 addr v1:10.20.193.78:6789/0 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 10 monclient(hunting): picked mon.noname-b con 0x7fa8c8163890 addr v1:10.20.193.155:6789/0 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c805d150 con 0x7fa8c815b3a0 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 1 -- --> v1:10.20.193.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c8161bd0 con 0x7fa8c8163890 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 1 -- --> v1:10.20.193.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c805c8b0 con 0x7fa8c815afd0 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 10 monclient(hunting): _renew_subs 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8cdba2640 10 monclient(hunting): authenticate will time out at 3765.952332s 2026-02-25T15:19:56.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8c7fff640 1 --1- >> v1:10.20.193.155:6789/0 conn(0x7fa8c8163890 0x7fa8c81593a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.155:6789/0 says I am v1:10.20.193.78:46042/0 (socket says 10.20.193.78:46042) 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8c7fff640 1 -- 10.20.193.78:0/316087935 learned_addr learned my addr 10.20.193.78:0/316087935 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8a3fff640 10 client.?.objecter ms_handle_connect 0x7fa8c8163890 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8a3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8a3fff640 10 client.?.objecter ms_handle_connect 0x7fa8c815afd0 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.363+0000 7fa8a3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.364+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870498427 0 0) 0x7fa8c8161bd0 con 0x7fa8c8163890 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.364+0000 7fa8a3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.364+0000 7fa8a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.364+0000 7fa8a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.364+0000 7fa8a3fff640 10 monclient(hunting): my global_id is 30268 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.364+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa898003610 con 0x7fa8c8163890 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.364+0000 7fa8a3fff640 10 client.?.objecter ms_handle_connect 0x7fa8c815b3a0 2026-02-25T15:19:56.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.364+0000 7fa8a3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.2 v1:10.20.193.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043275231 0 0) 0x7fa8c805c8b0 con 0x7fa8c815afd0 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 10 monclient(hunting): my global_id is 27809 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c8161bd0 con 0x7fa8c815afd0 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943216207 0 0) 0x7fa8c805d150 con 0x7fa8c815b3a0 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 10 monclient(hunting): my global_id is 30978 2026-02-25T15:19:56.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.365+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c805c8b0 con 0x7fa8c815b3a0 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1306485639 0 0) 0x7fa898003610 con 0x7fa8c8163890 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.155:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8c805d150 con 0x7fa8c8163890 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa8bc003690 con 0x7fa8c8163890 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 10 monclient(hunting): dump: 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.381 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.2 v1:10.20.193.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 535164524 0 0) 0x7fa8c8161bd0 con 0x7fa8c815afd0 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.167:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa898003610 con 0x7fa8c815afd0 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.2 v1:10.20.193.167:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa8b40030a0 con 0x7fa8c815afd0 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.367+0000 7fa8a3fff640 10 monclient(hunting): dump: 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.382 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1087527678 0 0) 0x7fa8c805c8b0 con 0x7fa8c815b3a0 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8c8161bd0 con 0x7fa8c815b3a0 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa8b8003090 con 0x7fa8c815b3a0 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:19:56.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 10 monclient(hunting): dump: 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 267636300 0 0) 0x7fa8c805d150 con 0x7fa8c8163890 2026-02-25T15:19:56.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 >> v1:10.20.193.167:6789/0 conn(0x7fa8c815afd0 legacy=0x7fa8c81614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 >> v1:10.20.193.78:6789/0 conn(0x7fa8c815b3a0 legacy=0x7fa8c81fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 1 monclient: found mon.b 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c805cb90 con 0x7fa8c8163890 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 10 monclient: _finish_auth 0 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 5 monclient: authenticate success, global_id 30268 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 10 monclient: _renew_subs 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.155:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c805ce70 con 0x7fa8c8163890 2026-02-25T15:19:56.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 10 client.30268.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:19:56.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 10 monclient: _renew_subs 2026-02-25T15:19:56.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:56.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.155:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa8c81fce00 con 0x7fa8c8163890 2026-02-25T15:19:56.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.368+0000 7fa8cdba2640 1 librados: init done 2026-02-25T15:19:56.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.369+0000 7fa8cdba2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:56.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.369+0000 7fa8cdba2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:56.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.369+0000 7fa8cdba2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:56.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.369+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.155:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c80ae160 con 0x7fa8c8163890 2026-02-25T15:19:56.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.460+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8bc0032f0 con 0x7fa8c8163890 2026-02-25T15:19:56.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.460+0000 7fa8a3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:19:56.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.460+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2585387515 0 0) 0x7fa8bc004f00 con 0x7fa8c8163890 2026-02-25T15:19:56.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.460+0000 7fa8a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:19:56.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.460+0000 7fa8a3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:19:56.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.460+0000 7fa8c5ffb640 4 set_mon_vals no callback set 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.460+0000 7fa8a3fff640 10 monclient: dump: 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:fsid 609bd52f-adc3-49d3-9ae3-11e4ae0954b8 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-25T15:11:30.869253+0000 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.155:6789/0 mon.b 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.167:6789/0 mon.c 2026-02-25T15:19:56.464 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:19:56.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.461+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 3022021885 0 0) 0x7fa8bc01dd70 con 0x7fa8c8163890 2026-02-25T15:19:56.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.462+0000 7fa8c77fe640 10 monclient: get_auth_request con 0x7fa898077e90 auth_method 0 2026-02-25T15:19:56.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.462+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 8 ==== osd_map(352..352 src has 1..352) ==== 8955+0+0 (unknown 2015078111 0 0) 0x7fa8bc093300 con 0x7fa8c8163890 2026-02-25T15:19:56.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.462+0000 7fa8a3fff640 10 client.30268.objecter ms_dispatch2 0x7fa8c8000b90 osd_map(352..352 src has 1..352) 2026-02-25T15:19:56.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.462+0000 7fa8a3fff640 3 client.30268.objecter handle_osd_map got epochs [352,352] > 0 2026-02-25T15:19:56.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.462+0000 7fa8a3fff640 3 client.30268.objecter handle_osd_map decoding full epoch 352 2026-02-25T15:19:56.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.462+0000 7fa8a3fff640 20 client.30268.objecter dump_active .. 0 homeless 2026-02-25T15:19:56.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.462+0000 7fa8a3fff640 10 client.30268.objecter ms_handle_connect 0x7fa898077e90 2026-02-25T15:19:56.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.463+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa8bc05dd30 con 0x7fa8c8163890 2026-02-25T15:19:56.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.463+0000 7fa8a3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:19:56.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.463+0000 7fa8a3fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:19:56.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.569+0000 7fa8cdba2640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-25T15:19:56.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.569+0000 7fa8cdba2640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-25T15:19:56.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.569+0000 7fa8cdba2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.155:6789/0 2026-02-25T15:19:56.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.569+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 --> v1:10.20.193.155:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa8c8059eb0 con 0x7fa8c8163890 2026-02-25T15:19:56.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.664+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7fa8bc05d630 con 0x7fa8c8163890 2026-02-25T15:19:56.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.664+0000 7fa8a3fff640 10 monclient: handle_config config(1 keys) 2026-02-25T15:19:56.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.664+0000 7fa8c5ffb640 4 set_mon_vals no callback set 2026-02-25T15:19:56.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.664+0000 7fa8c5ffb640 10 set_mon_vals mon_health_to_clog = false 2026-02-25T15:19:56.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.664+0000 7fa8a3fff640 1 -- 10.20.193.78:0/316087935 <== mon.1 v1:10.20.193.155:6789/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7fa8bc062d10 con 0x7fa8c8163890 2026-02-25T15:19:56.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.664+0000 7fa8a3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-25T15:19:56.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.664+0000 7fa8a3fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:19:56.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 10 librados: watch_flush enter 2026-02-25T15:19:56.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 10 librados: watch_flush exit 2026-02-25T15:19:56.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 20 client.30268.objecter shutdown clearing up homeless session... 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 10 client.30268.objecter successfully canceled tick 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 >> v1:10.20.193.78:6800/3497602169 conn(0x7fa898077e90 legacy=0x7fa898098340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 10 monclient: shutdown 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 >> v1:10.20.193.155:6789/0 conn(0x7fa8c8163890 legacy=0x7fa8c81593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 shutdown_connections 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 >> 10.20.193.78:0/316087935 conn(0x7fa8c80b2f10 msgr2=0x7fa8c80a8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 shutdown_connections 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 1 -- 10.20.193.78:0/316087935 wait complete. 2026-02-25T15:19:56.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-25T15:19:56.666+0000 7fa8cdba2640 1 librados: shutdown 2026-02-25T15:19:56.677 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-25T15:19:56.677 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-25T15:19:56.678 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-25T15:19:56.678 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:19:56.685 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-25T15:19:56.678+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 45238) UID: 0 2026-02-25T15:19:56.685 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-25T15:19:56.679+0000 c765640 -1 osd.0 352 *** Got signal Terminated *** 2026-02-25T15:20:02.780 INFO:tasks.ceph.osd.0:Stopped 2026-02-25T15:20:02.780 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-25T15:20:02.781 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:02.787 INFO:tasks.ceph.osd.4.trial078.stderr:2026-02-25T15:20:02.781+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 45240) UID: 0 2026-02-25T15:20:02.787 INFO:tasks.ceph.osd.4.trial078.stderr:2026-02-25T15:20:02.782+0000 c765640 -1 osd.4 354 *** Got signal Terminated *** 2026-02-25T15:20:04.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-25T15:20:08.178 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:09.957 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.181 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:09.960 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.184 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:09.962 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.187 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:09.964 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.192 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:09.971 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.197 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:09.975 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.206 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:09.946 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.208 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:09.947 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.218 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:09.957 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:08.882 INFO:tasks.ceph.osd.4:Stopped 2026-02-25T15:20:08.882 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-25T15:20:08.883 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:08.889 INFO:tasks.ceph.osd.8.trial078.stderr:2026-02-25T15:20:08.883+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 45244) UID: 0 2026-02-25T15:20:08.889 INFO:tasks.ceph.osd.8.trial078.stderr:2026-02-25T15:20:08.884+0000 c765640 -1 osd.8 356 *** Got signal Terminated *** 2026-02-25T15:20:11.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-25T15:20:14.984 INFO:tasks.ceph.osd.8:Stopped 2026-02-25T15:20:14.984 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-25T15:20:14.984 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:14.990 INFO:tasks.ceph.osd.12.trial078.stderr:2026-02-25T15:20:14.984+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 45246) UID: 0 2026-02-25T15:20:14.990 INFO:tasks.ceph.osd.12.trial078.stderr:2026-02-25T15:20:14.985+0000 c765640 -1 osd.12 358 *** Got signal Terminated *** 2026-02-25T15:20:18.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 is failed for ~0s 2026-02-25T15:20:21.086 INFO:tasks.ceph.osd.12:Stopped 2026-02-25T15:20:21.086 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-25T15:20:21.086 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:21.094 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-25T15:20:21.088+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 44339) UID: 0 2026-02-25T15:20:21.094 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-25T15:20:21.088+0000 c765640 -1 osd.1 360 *** Got signal Terminated *** 2026-02-25T15:20:24.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-25T15:20:24.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 has been restored 2026-02-25T15:20:27.188 INFO:tasks.ceph.osd.1:Stopped 2026-02-25T15:20:27.189 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-25T15:20:27.189 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:27.196 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-25T15:20:27.190+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 44343) UID: 0 2026-02-25T15:20:27.197 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-25T15:20:27.191+0000 c765640 -1 osd.5 362 *** Got signal Terminated *** 2026-02-25T15:20:28.262 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:30.040 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:28.264 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:30.043 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:28.275 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:30.054 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:28.290 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:30.029 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:28.291 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:30.030 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:28.291 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:30.068 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:28.292 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:30.069 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:28.304 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:30.044 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:28.305 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:30.082 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:31.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2026-02-25T15:20:31.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-25T15:20:33.290 INFO:tasks.ceph.osd.5:Stopped 2026-02-25T15:20:33.291 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-25T15:20:33.291 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:33.298 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-25T15:20:33.292+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 44346) UID: 0 2026-02-25T15:20:33.298 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-25T15:20:33.293+0000 c765640 -1 osd.9 364 *** Got signal Terminated *** 2026-02-25T15:20:37.915 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2026-02-25T15:20:37.915 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2026-02-25T15:20:39.392 INFO:tasks.ceph.osd.9:Stopped 2026-02-25T15:20:39.392 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-25T15:20:39.392 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:39.407 INFO:tasks.ceph.osd.13.trial155.stderr:2026-02-25T15:20:39.401+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 44349) UID: 0 2026-02-25T15:20:39.407 INFO:tasks.ceph.osd.13.trial155.stderr:2026-02-25T15:20:39.402+0000 c765640 -1 osd.13 366 *** Got signal Terminated *** 2026-02-25T15:20:44.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-25T15:20:44.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 has been restored 2026-02-25T15:20:45.494 INFO:tasks.ceph.osd.13:Stopped 2026-02-25T15:20:45.495 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-25T15:20:45.495 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:45.502 INFO:tasks.ceph.osd.2.trial167.stderr:2026-02-25T15:20:45.496+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 44115) UID: 0 2026-02-25T15:20:45.502 INFO:tasks.ceph.osd.2.trial167.stderr:2026-02-25T15:20:45.497+0000 c765640 -1 osd.2 368 *** Got signal Terminated *** 2026-02-25T15:20:48.254 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:50.032 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:48.254 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:50.032 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:48.255 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:50.034 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:48.256 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:50.033 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:48.266 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:08:50.045 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:48.267 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:08:50.044 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:48.282 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:50.021 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:48.282 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:50.022 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:48.293 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:08:50.033 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:20:50.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-25T15:20:50.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-25T15:20:51.596 INFO:tasks.ceph.osd.2:Stopped 2026-02-25T15:20:51.597 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-25T15:20:51.597 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:51.605 INFO:tasks.ceph.osd.6.trial167.stderr:2026-02-25T15:20:51.598+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 44116) UID: 0 2026-02-25T15:20:51.605 INFO:tasks.ceph.osd.6.trial167.stderr:2026-02-25T15:20:51.599+0000 c765640 -1 osd.6 370 *** Got signal Terminated *** 2026-02-25T15:20:56.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2026-02-25T15:20:56.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-25T15:20:57.699 INFO:tasks.ceph.osd.6:Stopped 2026-02-25T15:20:57.699 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-25T15:20:57.699 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:20:57.706 INFO:tasks.ceph.osd.10.trial167.stderr:2026-02-25T15:20:57.700+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 44120) UID: 0 2026-02-25T15:20:57.706 INFO:tasks.ceph.osd.10.trial167.stderr:2026-02-25T15:20:57.701+0000 c765640 -1 osd.10 372 *** Got signal Terminated *** 2026-02-25T15:21:02.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 is failed for ~0s 2026-02-25T15:21:02.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2026-02-25T15:21:03.801 INFO:tasks.ceph.osd.10:Stopped 2026-02-25T15:21:03.802 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-25T15:21:03.802 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:03.810 INFO:tasks.ceph.osd.14.trial167.stderr:2026-02-25T15:21:03.803+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 44123) UID: 0 2026-02-25T15:21:03.810 INFO:tasks.ceph.osd.14.trial167.stderr:2026-02-25T15:21:03.804+0000 c765640 -1 osd.14 376 *** Got signal Terminated *** 2026-02-25T15:21:08.299 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:10.078 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.301 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:10.078 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.301 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:10.080 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.303 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:10.080 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.314 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:10.093 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.314 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:10.091 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.325 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:10.065 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.326 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:10.066 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.338 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:10.078 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:08.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-25T15:21:08.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 has been restored 2026-02-25T15:21:09.903 INFO:tasks.ceph.osd.14:Stopped 2026-02-25T15:21:09.903 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-25T15:21:09.904 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:09.921 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-25T15:21:09.915+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 44098) UID: 0 2026-02-25T15:21:09.922 INFO:tasks.ceph.osd.3.trial174.stderr:2026-02-25T15:21:09.916+0000 c765640 -1 osd.3 378 *** Got signal Terminated *** 2026-02-25T15:21:10.351 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:12.130 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:10.352 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:12.131 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:10.359 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:12.137 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:10.376 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:12.153 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:10.377 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:12.154 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:10.379 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:12.118 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:10.379 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:12.119 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:10.383 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:12.161 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:10.385 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:12.125 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:14.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-25T15:21:14.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-25T15:21:16.005 INFO:tasks.ceph.osd.3:Stopped 2026-02-25T15:21:16.006 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-25T15:21:16.006 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:16.013 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-25T15:21:16.006+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 44099) UID: 0 2026-02-25T15:21:16.014 INFO:tasks.ceph.osd.7.trial174.stderr:2026-02-25T15:21:16.007+0000 c765640 -1 osd.7 378 *** Got signal Terminated *** 2026-02-25T15:21:19.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-25T15:21:19.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-25T15:21:22.108 INFO:tasks.ceph.osd.7:Stopped 2026-02-25T15:21:22.108 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-25T15:21:22.109 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:22.116 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-25T15:21:22.109+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 44104) UID: 0 2026-02-25T15:21:22.116 INFO:tasks.ceph.osd.11.trial174.stderr:2026-02-25T15:21:22.110+0000 c765640 -1 osd.11 378 *** Got signal Terminated *** 2026-02-25T15:21:25.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-25T15:21:28.211 INFO:tasks.ceph.osd.11:Stopped 2026-02-25T15:21:28.211 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-25T15:21:28.211 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:28.218 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-25T15:21:28.211+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 44105) UID: 0 2026-02-25T15:21:28.218 INFO:tasks.ceph.osd.15.trial174.stderr:2026-02-25T15:21:28.212+0000 c765640 -1 osd.15 378 *** Got signal Terminated *** 2026-02-25T15:21:28.332 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:30.110 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:28.333 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:30.112 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:28.341 INFO:tasks.ceph.mon.a.trial078.stderr:==00:00:09:30.120 44773== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:28.357 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:30.134 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:28.357 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:30.097 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:28.358 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:30.134 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:28.358 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:30.097 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:28.365 INFO:tasks.ceph.mon.b.trial155.stderr:==00:00:09:30.142 44107== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:28.365 INFO:tasks.ceph.mon.c.trial167.stderr:==00:00:09:30.104 43880== Warning: unimplemented fcntl command: 1036 2026-02-25T15:21:31.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2026-02-25T15:21:34.313 INFO:tasks.ceph.osd.15:Stopped 2026-02-25T15:21:34.313 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-25T15:21:34.313 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-25T15:21:34.313 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:34.314 INFO:tasks.ceph.mgr.y.trial078.stderr:2026-02-25T15:21:34.312+0000 7f72696a5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 44821) UID: 0 2026-02-25T15:21:34.314 INFO:tasks.ceph.mgr.y.trial078.stderr:2026-02-25T15:21:34.312+0000 7f72696a5640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-25T15:21:34.346 INFO:tasks.ceph.mgr.y:Stopped 2026-02-25T15:21:34.346 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-25T15:21:34.346 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:34.374 INFO:tasks.ceph.mgr.x:Stopped 2026-02-25T15:21:34.374 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-25T15:21:34.374 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-25T15:21:34.375 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:34.395 INFO:tasks.ceph.mon.a.trial078.stderr:2026-02-25T15:21:34.387+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 44771) UID: 0 2026-02-25T15:21:34.396 INFO:tasks.ceph.mon.a.trial078.stderr:2026-02-25T15:21:34.387+0000 add7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-25T15:21:36.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-25T15:21:36.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2026-02-25T15:21:40.475 INFO:tasks.ceph.mon.a:Stopped 2026-02-25T15:21:40.476 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-25T15:21:40.476 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:40.484 INFO:tasks.ceph.mon.b.trial155.stderr:2026-02-25T15:21:40.476+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 44105) UID: 0 2026-02-25T15:21:40.484 INFO:tasks.ceph.mon.b.trial155.stderr:2026-02-25T15:21:40.476+0000 add7640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-25T15:21:41.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-25T15:21:41.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-25T15:21:46.576 INFO:tasks.ceph.mon.b:Stopped 2026-02-25T15:21:46.577 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-25T15:21:46.577 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:21:46.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2026-02-25T15:21:46.586 INFO:tasks.ceph.mon.c.trial167.stderr:2026-02-25T15:21:46.577+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 43878) UID: 0 2026-02-25T15:21:46.586 INFO:tasks.ceph.mon.c.trial167.stderr:2026-02-25T15:21:46.577+0000 add7640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-25T15:21:51.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-25T15:21:51.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-25T15:21:52.679 INFO:tasks.ceph.mon.c:Stopped 2026-02-25T15:21:52.679 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-25T15:21:52.680 DEBUG:teuthology.orchestra.run.trial078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-25T15:21:52.711 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:21:52.711 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-25T15:21:52.781 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:21:52.781 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-25T15:21:52.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:21:52.856 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-25T15:21:52.930 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:21:52.931 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-25T15:21:53.003 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:21:53.004 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-25T15:21:53.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:21:53.038 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-25T15:21:53.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:21:53.114 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-25T15:21:53.184 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:21:53.185 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-25T15:21:53.304 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:21:53.304 DEBUG:teuthology.orchestra.run.trial167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-25T15:21:53.344 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:21:53.345 DEBUG:teuthology.orchestra.run.trial167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-25T15:21:53.415 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:21:53.416 DEBUG:teuthology.orchestra.run.trial167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-25T15:21:53.490 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:21:53.490 DEBUG:teuthology.orchestra.run.trial167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-25T15:21:53.561 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:21:53.561 DEBUG:teuthology.orchestra.run.trial174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-25T15:21:53.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:21:53.600 DEBUG:teuthology.orchestra.run.trial174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-25T15:21:53.687 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:21:53.687 DEBUG:teuthology.orchestra.run.trial174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-25T15:21:53.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:21:53.717 DEBUG:teuthology.orchestra.run.trial174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-25T15:21:53.793 INFO:tasks.ceph:Archiving mon data... 2026-02-25T15:21:53.795 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/data/mon.a.tgz 2026-02-25T15:21:53.795 DEBUG:teuthology.orchestra.run.trial078:> mktemp 2026-02-25T15:21:53.813 INFO:teuthology.orchestra.run.trial078.stdout:/tmp/tmp.zJwNnXNO7B 2026-02-25T15:21:53.814 DEBUG:teuthology.orchestra.run.trial078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zJwNnXNO7B 2026-02-25T15:21:53.956 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0666 /tmp/tmp.zJwNnXNO7B 2026-02-25T15:21:54.038 DEBUG:teuthology.orchestra.remote:trial078:/tmp/tmp.zJwNnXNO7B is 621KB 2026-02-25T15:21:54.111 DEBUG:teuthology.orchestra.run.trial078:> rm -fr /tmp/tmp.zJwNnXNO7B 2026-02-25T15:21:54.128 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/data/mon.b.tgz 2026-02-25T15:21:54.128 DEBUG:teuthology.orchestra.run.trial155:> mktemp 2026-02-25T15:21:54.146 INFO:teuthology.orchestra.run.trial155.stdout:/tmp/tmp.UDPjooTQw8 2026-02-25T15:21:54.146 DEBUG:teuthology.orchestra.run.trial155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.UDPjooTQw8 2026-02-25T15:21:54.290 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0666 /tmp/tmp.UDPjooTQw8 2026-02-25T15:21:54.373 DEBUG:teuthology.orchestra.remote:trial155:/tmp/tmp.UDPjooTQw8 is 622KB 2026-02-25T15:21:54.472 DEBUG:teuthology.orchestra.run.trial155:> rm -fr /tmp/tmp.UDPjooTQw8 2026-02-25T15:21:54.490 DEBUG:teuthology.misc:Transferring archived files from trial167:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/data/mon.c.tgz 2026-02-25T15:21:54.490 DEBUG:teuthology.orchestra.run.trial167:> mktemp 2026-02-25T15:21:54.508 INFO:teuthology.orchestra.run.trial167.stdout:/tmp/tmp.VMKwr62qsG 2026-02-25T15:21:54.509 DEBUG:teuthology.orchestra.run.trial167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VMKwr62qsG 2026-02-25T15:21:54.650 DEBUG:teuthology.orchestra.run.trial167:> sudo chmod 0666 /tmp/tmp.VMKwr62qsG 2026-02-25T15:21:54.733 DEBUG:teuthology.orchestra.remote:trial167:/tmp/tmp.VMKwr62qsG is 621KB 2026-02-25T15:21:54.824 DEBUG:teuthology.orchestra.run.trial167:> rm -fr /tmp/tmp.VMKwr62qsG 2026-02-25T15:21:54.841 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-25T15:21:54.841 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T15:21:54.844 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T15:21:54.847 DEBUG:teuthology.orchestra.run.trial167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T15:21:54.883 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T15:21:55.137 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T15:21:55.395 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T15:21:55.652 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T15:21:55.864 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T15:21:55.864 INFO:tasks.ceph:Archiving crash dumps... 2026-02-25T15:21:55.866 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial078/crash 2026-02-25T15:21:55.867 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T15:21:55.894 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial155/crash 2026-02-25T15:21:55.895 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T15:21:55.921 DEBUG:teuthology.misc:Transferring archived files from trial167:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial167/crash 2026-02-25T15:21:55.923 DEBUG:teuthology.orchestra.run.trial167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T15:21:55.949 DEBUG:teuthology.misc:Transferring archived files from trial174:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial174/crash 2026-02-25T15:21:55.950 DEBUG:teuthology.orchestra.run.trial174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T15:21:55.978 INFO:tasks.ceph:Compressing logs... 2026-02-25T15:21:55.978 DEBUG:teuthology.orchestra.run.trial078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:21:55.981 DEBUG:teuthology.orchestra.run.trial155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:21:55.984 DEBUG:teuthology.orchestra.run.trial167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:21:55.994 DEBUG:teuthology.orchestra.run.trial174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:21:56.004 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49659.log 2026-02-25T15:21:56.005 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-25T15:21:56.005 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51975.log 2026-02-25T15:21:56.005 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-mon.a.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.49659.log.gz 2026-02-25T15:21:56.005 INFO:teuthology.orchestra.run.trial078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51877.log 2026-02-25T15:21:56.005 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51219.log 2026-02-25T15:21:56.005 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51975.log.gz 2026-02-25T15:21:56.005 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52122.log 2026-02-25T15:21:56.018 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-25T15:21:56.018 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-25T15:21:56.018 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/valgrind/osd.13.log: 65.9% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/valgrind/osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr: 65.7% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-25T15:21:56.019 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-25T15:21:56.020 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-25T15:21:56.020 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T15:21:56.020 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-25T15:21:56.020 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T15:21:56.020 INFO:teuthology.orchestra.run.trial155.stderr: 91.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T15:21:56.027 INFO:teuthology.orchestra.run.trial167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/valgrind/osd.6.log: 66.0% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-25T15:21:56.028 INFO:teuthology.orchestra.run.trial167.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T15:21:56.029 INFO:teuthology.orchestra.run.trial167.stderr: 91.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51219.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51877.log.gz 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50827.log 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51219.log.gz 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52122.log.gz 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51779.log 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48828.log 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51779.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50827.log.gz 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53200.log 2026-02-25T15:21:56.044 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48828.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51779.log.gz 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48828.log.gz 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52171.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-mgr.y.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53200.log.gz 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49063.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52318.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52171.log.gz 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53347.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49063.log.gz 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51730.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49663.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52318.log.gz 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51730.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53347.log.gz 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50416.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49633.log 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51730.log.gz 2026-02-25T15:21:56.045 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50416.log: gzip 87.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49663.log.gz -- 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr: /var/log/ceph/ceph-client.admin.50101.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49633.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50416.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49633.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51214.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51681.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50101.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51214.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51366.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51214.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51681.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52661.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52514.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50328.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51366.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52612.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52661.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49662.log 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52612.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52514.log.gz 2026-02-25T15:21:56.046 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52612.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49662.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38475.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51583.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49662.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51464.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.tmp-client.admin.38475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50381.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38475.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49639.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49661.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51464.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53249.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50381.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49661.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49639.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44824.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53249.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49661.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53249.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.44824.log: /var/log/ceph/valgrind/osd.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr: 65.7% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-25T15:21:56.047 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/valgrind/osd.12.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.44824.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/valgrind/mon.a.log: 65.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49112.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49664.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49112.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45278.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49664.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49112.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51534.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49664.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.45278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49635.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49629.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45278.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr: 87.2%/var/log/ceph/ceph-client.admin.49635.log: -- replaced with /var/log/ceph/ceph-client.admin.51534.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49627.log 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2026-02-25T15:21:56.048 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49627.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49629.log.gz -5 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52073.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49620.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49627.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52857.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52073.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53102.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52073.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52857.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52857.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49660.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.12.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53102.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51415.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49660.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51415.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49660.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52759.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51415.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51926.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53394.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52759.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51926.log.gz 2026-02-25T15:21:56.049 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50411.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49645.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53394.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48905.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52955.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48905.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.50411.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48905.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50219.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52955.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52367.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53053.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50219.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44931.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53053.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52367.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53298.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53053.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.44931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49658.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.44931.log.gz 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50410.log 2026-02-25T15:21:56.050 INFO:teuthology.orchestra.run.trial078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53298.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50413.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50410.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49658.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52465.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50410.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50978.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr: 85.9%/var/log/ceph/ceph-client.admin.52465.log: -- replaced with /var/log/ceph/ceph-client.admin.50413.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51828.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50978.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52465.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52416.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr: 91.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50978.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49210.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51828.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45301.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49656.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52416.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49210.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.45301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52269.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45301.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53151.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52269.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49656.log.gz 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51216.log 2026-02-25T15:21:56.051 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53151.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52269.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51093.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51216.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53151.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51218.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51216.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52710.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51093.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51077.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.51218.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53004.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51077.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52710.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50414.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51077.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53004.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50414.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53004.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52563.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50414.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48998.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52563.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr: 87.2%/var/log/ceph/ceph-client.admin.48998.log: -- replaced with /var/log/ceph/ceph-client.admin.52563.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51632.log 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.8.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48998.log.gz 2026-02-25T15:21:56.052 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50421.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50984.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr: 87.2%/var/log/ceph/ceph-client.admin.50421.log: -- replaced with /var/log/ceph/ceph-client.admin.51632.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49161.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50421.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47118.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50984.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50415.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49161.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52808.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50415.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47118.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45347.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50415.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52906.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.45347.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52808.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49644.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45347.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50380.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49644.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52906.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48975.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50380.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49644.log.gz 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50099.log 2026-02-25T15:21:56.053 INFO:teuthology.orchestra.run.trial078.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50380.log.gz 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50420.log 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48975.log.gz 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50858.log 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50921.log 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50420.log.gz 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50404.log 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50858.log.gz 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52024.log 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50921.log.gz 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50404.log: 86.5%/var/log/ceph/ceph-client.admin.52024.log: -- replaced with /var/log/ceph/ceph-client.admin.50404.log.gz 2026-02-25T15:21:56.054 INFO:teuthology.orchestra.run.trial078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52024.log.gz 2026-02-25T15:21:56.056 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53351.log 2026-02-25T15:21:56.056 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48578.log 2026-02-25T15:21:56.056 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.53351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43934.log 2026-02-25T15:21:56.056 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43793.log 2026-02-25T15:21:56.056 INFO:teuthology.orchestra.run.trial174.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48578.log.gz 2026-02-25T15:21:56.056 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47962.log 2026-02-25T15:21:56.056 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48363.log 2026-02-25T15:21:56.056 INFO:teuthology.orchestra.run.trial174.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43934.log.gz 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47962.log: 90.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.53351.log.gz -5 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47853.log 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43793.log.gz 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50672.log 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48428.log 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.50672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48825.log 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48428.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48727.log 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48290.log 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.50672.log.gz 2026-02-25T15:21:56.057 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50135.log 2026-02-25T15:21:56.058 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48246.log 2026-02-25T15:21:56.058 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.50135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48133.log 2026-02-25T15:21:56.058 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50047.log 2026-02-25T15:21:56.058 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50671.log 2026-02-25T15:21:56.058 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.50047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48525.log 2026-02-25T15:21:56.058 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.50671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2026-02-25T15:21:56.058 INFO:teuthology.orchestra.run.trial174.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.50135.log.gz 2026-02-25T15:21:56.058 INFO:teuthology.orchestra.run.trial174.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50047.log.gz 2026-02-25T15:21:56.059 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48381.log 2026-02-25T15:21:56.059 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 2026-02-25T15:21:56.059 INFO:teuthology.orchestra.run.trial174.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48133.log.gz 2026-02-25T15:21:56.059 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43746.log 2026-02-25T15:21:56.059 INFO:teuthology.orchestra.run.trial174.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50671.log.gz 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43463.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.48525.log.gz 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48290.log.gz 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gz 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43746.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43557.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43746.log.gz 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48680.log 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48825.log.gz 86.0% 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2026-02-25T15:21:56.060 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-25T15:21:56.061 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48680.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-25T15:21:56.061 INFO:teuthology.orchestra.run.trial174.stderr: 90.8%/var/log/ceph/valgrind/osd.7.log: -- replaced with /var/log/ceph/ceph-client.admin.48246.log.gz 2026-02-25T15:21:56.061 INFO:teuthology.orchestra.run.trial174.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-25T15:21:56.061 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-25T15:21:56.061 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/valgrind/osd.11.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-25T15:21:56.061 INFO:teuthology.orchestra.run.trial174.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-25T15:21:56.061 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43699.log 2026-02-25T15:21:56.061 INFO:teuthology.orchestra.run.trial174.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-25T15:21:56.062 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43311.log 2026-02-25T15:21:56.062 INFO:teuthology.orchestra.run.trial174.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-25T15:21:56.062 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43699.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-25T15:21:56.062 INFO:teuthology.orchestra.run.trial174.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.48381.log.gz 2026-02-25T15:21:56.062 INFO:teuthology.orchestra.run.trial174.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43699.log.gz 2026-02-25T15:21:56.062 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43311.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.47853.log.gzgzip 2026-02-25T15:21:56.062 INFO:teuthology.orchestra.run.trial174.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49924.log 2026-02-25T15:21:56.062 INFO:teuthology.orchestra.run.trial174.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43311.log.gz 2026-02-25T15:21:56.063 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48096.log 2026-02-25T15:21:56.063 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.49924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2026-02-25T15:21:56.063 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47831.log 2026-02-25T15:21:56.063 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48096.log: /var/log/ceph/ceph-client.admin.43264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50133.log 2026-02-25T15:21:56.063 INFO:teuthology.orchestra.run.trial174.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2026-02-25T15:21:56.064 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48320.log 2026-02-25T15:21:56.064 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.50133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48162.log 2026-02-25T15:21:56.064 INFO:teuthology.orchestra.run.trial174.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.49924.log.gz 2026-02-25T15:21:56.064 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48520.log 2026-02-25T15:21:56.064 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53350.log 2026-02-25T15:21:56.064 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48786.log 2026-02-25T15:21:56.065 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.53350.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50133.log.gz 2026-02-25T15:21:56.065 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48583.log 2026-02-25T15:21:56.065 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53353.log 2026-02-25T15:21:56.065 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48786.log: /var/log/ceph/ceph-client.admin.48583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48170.log 2026-02-25T15:21:56.066 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.53353.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.48520.log.gz 2026-02-25T15:21:56.066 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53352.log 2026-02-25T15:21:56.066 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48170.log: gzip -5 89.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48162.log.gz /var/log/ceph/ceph-client.admin.48607.log 2026-02-25T15:21:56.066 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:21:56.066 INFO:teuthology.orchestra.run.trial174.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47831.log.gz 2026-02-25T15:21:56.066 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.53352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48330.log 2026-02-25T15:21:56.067 INFO:teuthology.orchestra.run.trial174.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2026-02-25T15:21:56.067 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48607.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.48583.log.gz 2026-02-25T15:21:56.067 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48568.log 2026-02-25T15:21:56.067 INFO:teuthology.orchestra.run.trial174.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.48727.log.gz 2026-02-25T15:21:56.067 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48822.log 2026-02-25T15:21:56.068 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48330.log: /var/log/ceph/ceph-client.admin.48568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2026-02-25T15:21:56.068 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48822.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53353.log.gz 2026-02-25T15:21:56.068 INFO:teuthology.orchestra.run.trial174.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.53352.log.gz 87.7% 2026-02-25T15:21:56.068 INFO:teuthology.orchestra.run.trial174.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48568.log.gz 2026-02-25T15:21:56.068 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2026-02-25T15:21:56.068 INFO:teuthology.orchestra.run.trial174.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48320.log.gz 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48208.log 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47897.log 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48330.log.gz 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48096.log.gz 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48779.log 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48068.log 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47791.log 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48170.log.gz 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47935.log 2026-02-25T15:21:56.069 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57939.log 2026-02-25T15:21:56.070 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49925.log 2026-02-25T15:21:56.070 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.57939.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48779.log.gz 2026-02-25T15:21:56.070 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43840.log 2026-02-25T15:21:56.070 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.49925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43416.log 2026-02-25T15:21:56.071 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43840.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49925.log.gz 2026-02-25T15:21:56.071 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47995.log 2026-02-25T15:21:56.071 INFO:teuthology.orchestra.run.trial174.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43840.log.gz 2026-02-25T15:21:56.071 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50134.log 2026-02-25T15:21:56.071 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43416.log: /var/log/ceph/ceph-client.admin.47995.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.57939.log.gz 2026-02-25T15:21:56.071 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- 86.0% /var/log/ceph/ceph-client.admin.57934.log 2026-02-25T15:21:56.072 INFO:teuthology.orchestra.run.trial174.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43416.log.gz 2026-02-25T15:21:56.072 INFO:teuthology.orchestra.run.trial174.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.47935.log.gz 2026-02-25T15:21:56.072 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.50134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43652.log 2026-02-25T15:21:56.072 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.57934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48830.log 2026-02-25T15:21:56.072 INFO:teuthology.orchestra.run.trial174.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48068.log.gz 2026-02-25T15:21:56.072 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47911.log 2026-02-25T15:21:56.072 INFO:teuthology.orchestra.run.trial174.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48607.log.gz 2026-02-25T15:21:56.073 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48830.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43652.log.gz 2026-02-25T15:21:56.073 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50048.log 2026-02-25T15:21:56.073 INFO:teuthology.orchestra.run.trial174.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48208.log.gz 2026-02-25T15:21:56.073 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48029.log 2026-02-25T15:21:56.073 INFO:teuthology.orchestra.run.trial174.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50134.log.gz 2026-02-25T15:21:56.073 INFO:teuthology.orchestra.run.trial174.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.48822.log.gz 2026-02-25T15:21:56.073 INFO:teuthology.orchestra.run.trial174.stderr: 90.2%/var/log/ceph/ceph-client.admin.50048.log: -- replaced with /var/log/ceph/ceph-client.admin.57934.log.gz 2026-02-25T15:21:56.073 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50046.log 2026-02-25T15:21:56.074 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5/var/log/ceph/ceph-client.admin.48029.log: --verbose -- /var/log/ceph/ceph-client.admin.48585.log 2026-02-25T15:21:56.074 INFO:teuthology.orchestra.run.trial174.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.48786.log.gz 2026-02-25T15:21:56.074 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.50046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48674.log 2026-02-25T15:21:56.074 INFO:teuthology.orchestra.run.trial174.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.48680.log.gz 2026-02-25T15:21:56.074 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43981.log 2026-02-25T15:21:56.074 INFO:teuthology.orchestra.run.trial174.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50048.log.gz 2026-02-25T15:21:56.074 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48549.log 2026-02-25T15:21:56.074 INFO:teuthology.orchestra.run.trial174.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48585.log.gz 2026-02-25T15:21:56.075 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43981.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.47911.log.gz 2026-02-25T15:21:56.075 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-25T15:21:56.075 INFO:teuthology.orchestra.run.trial174.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43981.log.gz 2026-02-25T15:21:56.075 INFO:teuthology.orchestra.run.trial174.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48674.log.gz 2026-02-25T15:21:56.075 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50673.log 2026-02-25T15:21:56.075 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48549.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.50046.log.gz 2026-02-25T15:21:56.075 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47812.log 2026-02-25T15:21:56.075 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.50673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57925.log 2026-02-25T15:21:56.076 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.47812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2026-02-25T15:21:56.076 INFO:teuthology.orchestra.run.trial078.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-25T15:21:56.076 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.57925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53354.log 2026-02-25T15:21:56.077 INFO:teuthology.orchestra.run.trial174.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.48363.log.gz 2026-02-25T15:21:56.077 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2026-02-25T15:21:56.077 INFO:teuthology.orchestra.run.trial174.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48029.log.gz 2026-02-25T15:21:56.077 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.53354.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50673.log.gz 2026-02-25T15:21:56.077 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43887.log 2026-02-25T15:21:56.077 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48574.log 2026-02-25T15:21:56.077 INFO:teuthology.orchestra.run.trial174.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2026-02-25T15:21:56.077 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.43887.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-25T15:21:56.078 INFO:teuthology.orchestra.run.trial174.stderr: 86.1%/var/log/ceph/ceph-client.admin.48574.log: -- replaced with /var/log/ceph/ceph-client.admin.43887.log.gz 2026-02-25T15:21:56.078 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48533.log 2026-02-25T15:21:56.078 INFO:teuthology.orchestra.run.trial174.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.57925.log.gz 2026-02-25T15:21:56.078 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-osd.15.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48549.log.gz 2026-02-25T15:21:56.078 INFO:teuthology.orchestra.run.trial174.stderr:/var/log/ceph/ceph-client.admin.48533.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.53354.log.gz 2026-02-25T15:21:56.078 INFO:teuthology.orchestra.run.trial174.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48533.log.gz 2026-02-25T15:21:56.079 INFO:teuthology.orchestra.run.trial174.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.48574.log.gz 2026-02-25T15:21:56.080 INFO:teuthology.orchestra.run.trial174.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-25T15:21:56.081 INFO:teuthology.orchestra.run.trial174.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2026-02-25T15:21:56.086 INFO:teuthology.orchestra.run.trial174.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47791.log.gz 2026-02-25T15:21:56.091 INFO:teuthology.orchestra.run.trial174.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.48830.log.gz 2026-02-25T15:21:56.096 INFO:teuthology.orchestra.run.trial174.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.47897.log.gz 2026-02-25T15:21:56.105 INFO:teuthology.orchestra.run.trial174.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.47812.log.gz 2026-02-25T15:21:56.116 INFO:teuthology.orchestra.run.trial174.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.47995.log.gz 2026-02-25T15:21:56.535 INFO:teuthology.orchestra.run.trial174.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47962.log.gz 2026-02-25T15:21:56.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-25T15:21:56.627 INFO:teuthology.orchestra.run.trial167.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-25T15:21:56.717 INFO:teuthology.orchestra.run.trial155.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-25T15:21:56.780 INFO:teuthology.orchestra.run.trial155.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-25T15:21:56.786 INFO:teuthology.orchestra.run.trial167.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-25T15:21:56.797 INFO:teuthology.orchestra.run.trial155.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-25T15:21:56.810 INFO:teuthology.orchestra.run.trial155.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-25T15:21:56.814 INFO:teuthology.orchestra.run.trial174.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-25T15:21:56.827 INFO:teuthology.orchestra.run.trial155.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-25T15:21:56.828 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-25T15:21:56.828 INFO:teuthology.orchestra.run.trial155.stderr:real 0m0.830s 2026-02-25T15:21:56.828 INFO:teuthology.orchestra.run.trial155.stderr:user 0m3.712s 2026-02-25T15:21:56.828 INFO:teuthology.orchestra.run.trial155.stderr:sys 0m0.195s 2026-02-25T15:21:56.830 INFO:teuthology.orchestra.run.trial078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-25T15:21:56.836 INFO:teuthology.orchestra.run.trial167.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-25T15:21:56.848 INFO:teuthology.orchestra.run.trial167.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-25T15:21:56.851 INFO:teuthology.orchestra.run.trial167.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-25T15:21:56.852 INFO:teuthology.orchestra.run.trial167.stderr: 2026-02-25T15:21:56.852 INFO:teuthology.orchestra.run.trial167.stderr:real 0m0.846s 2026-02-25T15:21:56.852 INFO:teuthology.orchestra.run.trial167.stderr:user 0m3.689s 2026-02-25T15:21:56.853 INFO:teuthology.orchestra.run.trial167.stderr:sys 0m0.192s 2026-02-25T15:21:56.853 INFO:teuthology.orchestra.run.trial078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-25T15:21:56.861 INFO:teuthology.orchestra.run.trial174.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-25T15:21:56.906 INFO:teuthology.orchestra.run.trial078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-25T15:21:56.917 INFO:teuthology.orchestra.run.trial174.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-25T15:21:56.921 INFO:teuthology.orchestra.run.trial174.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-25T15:21:56.922 INFO:teuthology.orchestra.run.trial174.stderr: 2026-02-25T15:21:56.922 INFO:teuthology.orchestra.run.trial174.stderr:real 0m0.877s 2026-02-25T15:21:56.922 INFO:teuthology.orchestra.run.trial174.stderr:user 0m3.850s 2026-02-25T15:21:56.923 INFO:teuthology.orchestra.run.trial174.stderr:sys 0m0.260s 2026-02-25T15:21:56.978 INFO:teuthology.orchestra.run.trial078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-25T15:21:57.081 INFO:teuthology.orchestra.run.trial078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-25T15:21:57.083 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-25T15:21:57.083 INFO:teuthology.orchestra.run.trial078.stderr:real 0m1.088s 2026-02-25T15:21:57.083 INFO:teuthology.orchestra.run.trial078.stderr:user 0m4.476s 2026-02-25T15:21:57.083 INFO:teuthology.orchestra.run.trial078.stderr:sys 0m0.266s 2026-02-25T15:21:57.084 INFO:tasks.ceph:Archiving logs... 2026-02-25T15:21:57.085 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial078/log 2026-02-25T15:21:57.086 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T15:21:57.658 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial155/log 2026-02-25T15:21:57.659 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T15:21:58.014 DEBUG:teuthology.misc:Transferring archived files from trial167:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial167/log 2026-02-25T15:21:58.015 DEBUG:teuthology.orchestra.run.trial167:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T15:21:58.377 DEBUG:teuthology.misc:Transferring archived files from trial174:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial174/log 2026-02-25T15:21:58.378 DEBUG:teuthology.orchestra.run.trial174:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T15:21:58.780 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-25T15:21:58.791 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-25T15:21:58.791 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T15:21:58.793 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T15:21:58.795 DEBUG:teuthology.orchestra.run.trial167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T15:21:58.797 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T15:22:03.836 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-25T15:22:03.847 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-25T15:22:03.847 DEBUG:teuthology.orchestra.run.trial078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T15:22:03.849 DEBUG:teuthology.orchestra.run.trial155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T15:22:03.851 DEBUG:teuthology.orchestra.run.trial167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T15:22:03.853 DEBUG:teuthology.orchestra.run.trial174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T15:22:03.863 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-25T15:22:03.865 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-25T15:22:03.867 INFO:teuthology.orchestra.run.trial167.stderr:bash: line 1: ntpq: command not found 2026-02-25T15:22:03.870 INFO:teuthology.orchestra.run.trial174.stderr:bash: line 1: ntpq: command not found 2026-02-25T15:22:03.926 INFO:teuthology.orchestra.run.trial167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T15:22:03.927 INFO:teuthology.orchestra.run.trial167.stdout:=============================================================================== 2026-02-25T15:22:03.927 INFO:teuthology.orchestra.run.trial167.stdout:^+ 149.248.12.167.vultruser> 2 9 377 201 +2313us[+2543us] +/- 37ms 2026-02-25T15:22:03.927 INFO:teuthology.orchestra.run.trial167.stdout:^- 161.35.230.200 2 8 377 74 +417us[ +649us] +/- 85ms 2026-02-25T15:22:03.927 INFO:teuthology.orchestra.run.trial167.stdout:^+ us-east-2.clearnet.pw 2 9 377 456 -1745us[-1518us] +/- 59ms 2026-02-25T15:22:03.927 INFO:teuthology.orchestra.run.trial167.stdout:^* 50.218.103.254 2 8 375 68 +647us[ +879us] +/- 33ms 2026-02-25T15:22:03.928 INFO:teuthology.orchestra.run.trial174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T15:22:03.928 INFO:teuthology.orchestra.run.trial174.stdout:=============================================================================== 2026-02-25T15:22:03.928 INFO:teuthology.orchestra.run.trial174.stdout:^+ 149.248.12.167.vultruser> 2 9 377 207 +1821us[+1978us] +/- 36ms 2026-02-25T15:22:03.928 INFO:teuthology.orchestra.run.trial174.stdout:^+ 144.202.66.214.vultruser> 3 8 377 123 -116us[ -116us] +/- 33ms 2026-02-25T15:22:03.928 INFO:teuthology.orchestra.run.trial174.stdout:^+ us-east-2.clearnet.pw 2 9 377 402 -1078us[ -923us] +/- 60ms 2026-02-25T15:22:03.928 INFO:teuthology.orchestra.run.trial174.stdout:^* 50.218.103.254 2 8 75 194 +790us[ +947us] +/- 31ms 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial078.stdout:^+ 149.248.12.167.vultruser> 2 9 377 192 +230us[ +230us] +/- 35ms 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial078.stdout:^- ntp11.kernfusion.at 2 6 377 0 -484us[ -484us] +/- 72ms 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial078.stdout:^+ us-east-2.clearnet.pw 2 7 377 4 -1551us[-1551us] +/- 65ms 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial078.stdout:^* 50.218.103.254 2 7 376 660 +1417us[+1411us] +/- 52ms 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial155.stdout:^+ 149.248.12.167.vultruser> 2 9 377 197 +345us[ +305us] +/- 36ms 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial155.stdout:^- 161.35.230.200 2 7 377 7 +551us[ +464us] +/- 86ms 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial155.stdout:^+ us-east-2.clearnet.pw 2 7 377 136 -1582us[-1637us] +/- 63ms 2026-02-25T15:22:03.929 INFO:teuthology.orchestra.run.trial155.stdout:^* 50.218.103.254 2 6 355 6 +571us[ +484us] +/- 34ms 2026-02-25T15:22:03.929 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-25T15:22:03.941 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-25T15:22:03.941 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-25T15:22:03.956 DEBUG:teuthology.orchestra.run.trial078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T15:22:04.023 DEBUG:teuthology.orchestra.run.trial155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T15:22:04.078 DEBUG:teuthology.orchestra.run.trial167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T15:22:04.134 DEBUG:teuthology.orchestra.run.trial174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T15:22:04.190 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T15:22:04.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:22:04.218 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T15:22:04.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:22:04.247 DEBUG:teuthology.orchestra.run.trial167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T15:22:04.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:22:04.274 DEBUG:teuthology.orchestra.run.trial174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T15:22:04.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:22:04.303 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-25T15:22:04.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-25T15:22:04.334 INFO:teuthology.task.internal:Duration was 3552.242549 seconds 2026-02-25T15:22:04.334 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-25T15:22:04.349 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-25T15:22:04.349 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T15:22:04.352 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T15:22:04.355 DEBUG:teuthology.orchestra.run.trial167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T15:22:04.358 DEBUG:teuthology.orchestra.run.trial174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T15:22:04.388 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T15:22:04.391 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T15:22:04.393 INFO:teuthology.orchestra.run.trial167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T15:22:04.395 INFO:teuthology.orchestra.run.trial174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T15:22:04.827 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-25T15:22:04.827 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial078.front.sepia.ceph.com 2026-02-25T15:22:04.828 DEBUG:teuthology.orchestra.run.trial078:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T15:22:04.847 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial155.front.sepia.ceph.com 2026-02-25T15:22:04.848 DEBUG:teuthology.orchestra.run.trial155:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T15:22:04.885 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial167.front.sepia.ceph.com 2026-02-25T15:22:04.885 DEBUG:teuthology.orchestra.run.trial167:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T15:22:04.906 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial174.front.sepia.ceph.com 2026-02-25T15:22:04.906 DEBUG:teuthology.orchestra.run.trial174:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T15:22:04.926 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-25T15:22:04.926 DEBUG:teuthology.orchestra.run.trial078:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:22:04.928 DEBUG:teuthology.orchestra.run.trial155:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:22:04.930 DEBUG:teuthology.orchestra.run.trial167:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:22:04.947 DEBUG:teuthology.orchestra.run.trial174:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:22:05.029 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-25T15:22:05.029 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:22:05.031 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:22:05.034 DEBUG:teuthology.orchestra.run.trial167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:22:05.036 DEBUG:teuthology.orchestra.run.trial174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:22:05.052 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T15:22:05.053 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T15:22:05.053 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:22:05.053 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T15:22:05.053 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T15:22:05.055 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T15:22:05.056 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T15:22:05.056 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T15:22:05.056 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:22:05.056 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T15:22:05.057 INFO:teuthology.orchestra.run.trial167.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T15:22:05.058 INFO:teuthology.orchestra.run.trial167.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T15:22:05.058 INFO:teuthology.orchestra.run.trial167.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:22:05.058 INFO:teuthology.orchestra.run.trial167.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T15:22:05.058 INFO:teuthology.orchestra.run.trial167.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T15:22:05.059 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T15:22:05.060 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T15:22:05.061 INFO:teuthology.orchestra.run.trial174.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T15:22:05.061 INFO:teuthology.orchestra.run.trial174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:22:05.061 INFO:teuthology.orchestra.run.trial174.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T15:22:05.062 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T15:22:05.065 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T15:22:05.068 INFO:teuthology.orchestra.run.trial167.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T15:22:05.071 INFO:teuthology.orchestra.run.trial174.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T15:22:05.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-25T15:22:05.090 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-25T15:22:05.090 DEBUG:teuthology.orchestra.run.trial078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T15:22:05.128 DEBUG:teuthology.orchestra.run.trial155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T15:22:05.151 DEBUG:teuthology.orchestra.run.trial167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T15:22:05.177 DEBUG:teuthology.orchestra.run.trial174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T15:22:05.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-25T15:22:05.220 DEBUG:teuthology.orchestra.run.trial078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:22:05.223 DEBUG:teuthology.orchestra.run.trial155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:22:05.226 DEBUG:teuthology.orchestra.run.trial167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:22:05.228 DEBUG:teuthology.orchestra.run.trial174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:22:05.245 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = core 2026-02-25T15:22:05.248 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = core 2026-02-25T15:22:05.250 INFO:teuthology.orchestra.run.trial167.stdout:kernel.core_pattern = core 2026-02-25T15:22:05.267 INFO:teuthology.orchestra.run.trial174.stdout:kernel.core_pattern = core 2026-02-25T15:22:05.281 DEBUG:teuthology.orchestra.run.trial078:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:22:05.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:22:05.314 DEBUG:teuthology.orchestra.run.trial155:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:22:05.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:22:05.329 DEBUG:teuthology.orchestra.run.trial167:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:22:05.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:22:05.345 DEBUG:teuthology.orchestra.run.trial174:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:22:05.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:22:05.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-25T15:22:05.378 INFO:teuthology.task.internal:Transferring archived files... 2026-02-25T15:22:05.379 DEBUG:teuthology.misc:Transferring archived files from trial078:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial078 2026-02-25T15:22:05.379 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T15:22:05.415 DEBUG:teuthology.misc:Transferring archived files from trial155:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial155 2026-02-25T15:22:05.416 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T15:22:05.452 DEBUG:teuthology.misc:Transferring archived files from trial167:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial167 2026-02-25T15:22:05.453 DEBUG:teuthology.orchestra.run.trial167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T15:22:05.489 DEBUG:teuthology.misc:Transferring archived files from trial174:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:09:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/70221/remote/trial174 2026-02-25T15:22:05.490 DEBUG:teuthology.orchestra.run.trial174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T15:22:05.538 INFO:teuthology.task.internal:Removing archive directory... 2026-02-25T15:22:05.538 DEBUG:teuthology.orchestra.run.trial078:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T15:22:05.541 DEBUG:teuthology.orchestra.run.trial155:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T15:22:05.544 DEBUG:teuthology.orchestra.run.trial167:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T15:22:05.546 DEBUG:teuthology.orchestra.run.trial174:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T15:22:05.576 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-25T15:22:05.597 INFO:teuthology.task.internal:Not uploading archives. 2026-02-25T15:22:05.597 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-25T15:22:05.613 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-25T15:22:05.614 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T15:22:05.616 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T15:22:05.618 DEBUG:teuthology.orchestra.run.trial167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T15:22:05.621 DEBUG:teuthology.orchestra.run.trial174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T15:22:05.629 INFO:teuthology.orchestra.run.trial078.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 15:22 /home/ubuntu/cephtest 2026-02-25T15:22:05.632 INFO:teuthology.orchestra.run.trial155.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 15:22 /home/ubuntu/cephtest 2026-02-25T15:22:05.634 INFO:teuthology.orchestra.run.trial167.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 15:22 /home/ubuntu/cephtest 2026-02-25T15:22:05.637 INFO:teuthology.orchestra.run.trial174.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 15:22 /home/ubuntu/cephtest 2026-02-25T15:22:05.638 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-25T15:22:05.655 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-25T15:22:05.693 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} duration: 3552.242548942566 flavor: default owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com success: true 2026-02-25T15:22:05.693 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:22:05.819 INFO:teuthology.run:pass